PAC-bayesian learning
PulseAugur coverage of PAC-bayesian learning — every cluster mentioning PAC-bayesian learning across labs, papers, and developer communities, ranked by signal.
4 day(s) with sentiment data
-
New Bayesian Method Enhances Deep Learning Model Confidence
A new research paper proposes a novel approach to improve the confidence calibration of deep learning models by introducing a degenerate Gaussian distribution on parameter space. This method aims to bridge the gap betwe…
-
New method offers statistical and privacy guarantees for deep regression models
Researchers have developed a method to provide statistical and privacy guarantees for deep non-parametric regression models trained using Stochastic Gradient Langevin Dynamics (SGLD). By employing a PAC-Bayesian analysi…
-
New D-RPC method improves LLM reasoning distillation
Researchers have developed a new method called Distillation through Reasoning Path Compression (D-RPC) to improve the process of distilling reasoning from large language models (LLMs) into smaller ones. This technique a…
-
New PAC-Bayesian framework links Fisher rank to generalization
Researchers have developed a new PAC-Bayesian learning framework that connects generalization error in deep learning models to the Fisher information matrix. This framework defines a Fisher-aligned parameter distributio…
-
New framework ensures stability in identifying nonlinear systems
Researchers have developed a new framework called Internal Controller Identification (ICI) for identifying nonlinear systems, even those that are potentially unstable. This method generalizes the classical Youla paramet…
-
New PAC-Bayes Theory Achieves Dimension-Free Generalization for Deep Neural Networks
Researchers have developed a new PAC-Bayesian generalization theory for deep neural networks that is independent of network dimension. This approach shifts prior specification from internal parameters to the non-paramet…
-
New theory unifies generalization, validation, and information fusion in ML
A new theoretical framework, gamma-CUBV, has been proposed to unify generalization, validation, and information fusion in machine learning. This framework generalizes Cross Upper-Bound Validation (CUBV) by controlling t…
-
New Algorithm Derandomizes Stochastic Majority Votes Using PAC-Bayesian Theory
A new paper introduces a framework to derandomize stochastic majority votes, a key component in ensemble machine learning methods. By applying disintegrated PAC-Bayesian theory, the research transforms existing stochast…
-
New nonlinear dimensionality reduction techniques enhance Bayesian optimization
Researchers have developed new nonlinear dimensionality reduction techniques for Bayesian optimization, a method used for efficient global optimization of expensive black-box functions. The proposed approach, SDR-LSBO, …
-
New PAC-Bayesian Framework Quantifies Value of Privileged Information in ML
Researchers have developed a new PAC-Bayesian framework to quantify the value of privileged information (PI) in machine learning. This approach offers an algorithm-agnostic method to estimate the potential knowledge tra…
-
New PAC-Bayesian Bounds Developed for Partially Observed LTI Systems
Researchers have developed new PAC-Bayesian error bounds for partially observed stochastic linear time-invariant state-space systems that include inputs and sub-Gaussian noise. These bounds connect the expected predicti…
-
New FragileFlow Method Boosts Foundation Model Robustness
Researchers have introduced FragileFlow, a novel plug-in regularizer designed to enhance the robustness of foundation models, including LLMs and Vision-Language Models. This method addresses a failure mode where predict…
-
New PAC-Bayesian Framework Enhances Time Series VAE Guarantees
Researchers have developed a new PAC-Bayesian framework to provide generalization guarantees for Variational Autoencoders (VAEs) when applied to time series data. This framework extends existing PAC-Bayesian guarantees …
-
New paper explores information flow in martingales, unifying concentration inequalities
A new paper published on arXiv details advancements in understanding information flow within the path space of nonnegative martingales. The research introduces exact variational identities that apply even at arbitrary r…
-
New PAC-Bayes Theory Focuses on Behavioral Equivalence and Z-Information
A new research paper introduces PAC-Bayes theory that extends beyond parameter space, focusing on behavioral equivalence and Z-information. The study formalizes behavioral equivalence using a measurable behavior map and…
-
New sampling method boosts long-tailed learning accuracy
Researchers have developed a new method called Sharpness-Guided Equilibrium Sampling (SGS) to improve the performance of models trained on long-tailed datasets. SGS dynamically adjusts the sampling probability of data p…
-
MasFACT framework tackles topology forgetting in multi-agent LLM systems
Researchers have introduced MasFACT, a novel framework designed to address "topology forgetting" in continual multi-agent systems (MAS) powered by large language models. This issue arises when adapting to new tasks caus…
-
New PAC-Bayesian framework explains adversarial training overfitting
Researchers have developed a new PAC-Bayesian analytical framework to understand the phenomenon of robust overfitting in adversarial training. By modeling adversarial training with momentum SGD as a discrete-time dynami…
-
Entanglement, not parameters, governs quantum policy generalization
A new research paper proposes that entanglement, rather than the number of parameters, is the key factor determining generalization in quantum reinforcement learning policies. The study introduces a PAC-Bayesian framewo…
-
New PAC-Bayesian method offers control certification for quadratic systems
Researchers have developed a new method using PAC-Bayesian bounds to certify quadratic closed-loop control systems. This approach addresses challenges with unbounded and non-Lipschitz loss functions by employing System …