New latent class attack and detection method detailed in arXiv paper

Researchers have developed a new data poisoning technique called a latent class attack, which introduces a novel, unknown class of data and mislabels it as a known class. This attack could be used to bypass AI-based security systems by causing unknown entities to be classified as benign. To counter this, a post-training detection method called class subspace orthogonalization (CSO) has been proposed. CSO identifies inputs that are confidently classified into a known class but whose internal representations do not align with any existing class, thereby detecting the presence of the latent class attack. AI

IMPACT This research introduces a new method for data poisoning and a corresponding detection technique, potentially impacting the robustness of AI systems against adversarial manipulation.

RANK_REASON The cluster contains a research paper detailing a novel attack and defense mechanism in machine learning. [lever_c_demoted from research: ic=1 ai=1.0]

Read on arXiv cs.LG →

• AI-based access control systems
• data poisoning
• class subspace orthogonalization
• deep learning
• latent class attack

• paper
• safety

AI-generated summary · Google Gemini · from 1 sources. How we write summaries →