New information-theoretic framework enhances out-of-distribution detection in neural networks

Researchers have developed a novel information-theoretic framework for constructing features that improve out-of-distribution (OOD) detection in neural networks. This framework utilizes a two-term loss functional: one term separates in-distribution and OOD feature distributions using Kullback–Leibler divergence, while the second term, based on the information bottleneck principle, favors compressed features that retain OOD information. A variational procedure is employed to optimize this loss and generate OOD features, which has demonstrated superior performance on OOD benchmarks compared to existing methods. AI

IMPACT This framework offers a principled approach to constructing better features for out-of-distribution detection, potentially improving the reliability and safety of AI systems in real-world scenarios.

RANK_REASON The cluster contains an academic paper detailing a new theoretical framework and method for improving a specific aspect of machine learning (OOD detection). [lever_c_demoted from research: ic=1 ai=1.0]

Read on arXiv cs.LG →

• alphaXiv
• arXiv
• CatalyzeX Code Finder for Papers
• CORE Recommender
• DagsHub
• Gotit.pub
• Hugging Face
• IArxiv Recommender
• Influence Flower
• information bottleneck
• Kullback–Leibler divergence
• ScienceCast
• Sudeepta Mondal

• paper
• model release

AI-generated summary · Google Gemini · from 1 sources. How we write summaries →