Fisher information
PulseAugur coverage of Fisher information — every cluster mentioning Fisher information across labs, papers, and developer communities, ranked by signal.
9 day(s) with sentiment data
-
New theory quantifies information loss in quantum circuits
Researchers have developed a theoretical framework to understand how information is lost in parameterized quantum circuits when using a fixed computational-basis measurement. They analyzed the quantum Fisher information…
-
Catastrophic forgetting in LLMs: How fine-tuning erodes capabilities
Fine-tuning large language models can lead to catastrophic forgetting, where a model loses previously acquired capabilities when optimized for a new objective. This phenomenon, rooted in gradient descent, causes the mod…
-
GFlowNet training methods explored via policy gradients and information geometry · 2 sources tracked
Two new research papers explore advanced training methods for Generative Flow Networks (GFlowNets). The first paper introduces a policy-gradient-based framework that bridges GFlowNet's flow balance with reinforcement le…
-
CalTwin improves medical world models with Fisher-Information regularization
Researchers have developed CalTwin, a novel regularization technique designed to improve the reliability of medical world models. This method addresses two key issues: covariate shift, which arises from data fragmentati…
-
New Bayesian Optimization Method RAMBO Tackles Multi-Regime Search Spaces
Researchers have developed a new Bayesian Optimization (BO) method called RAMBO, designed to handle multi-regime search spaces more effectively than standard BO. RAMBO utilizes a Dirichlet Process Mixture of Gaussian Pr…
-
New Fisher Widths Analyze Statistical Manifold Complexity
This paper introduces two new functionals, the primal Fisher width and the inverse-Fisher width, to analyze Gaussian-width complexity on statistical manifolds. These widths offer complementary insights into local parame…
-
New math paper details optimization on Wasserstein space
Researchers have developed new methods for optimizing functionals on Wasserstein spaces, a mathematical concept crucial for understanding probability distributions. The work establishes linear convergence for proximal d…
-
CoCurve method prunes LLMs by analyzing cross-module dependencies
Researchers have developed CoCurve, a novel training-free method for structured pruning of large language models (LLMs). Unlike previous methods that assess computational units independently, CoCurve considers the inter…
-
New GFWSVD method offers improved LLM compression by analyzing parameter correlations
Researchers have developed Generalized Fisher-Weighted SVD (GFWSVD), a novel technique for compressing large language models (LLMs). This method improves upon existing compression methods by accounting for both diagonal…
-
New Geometric Observability Index Enhances SE(3) Pose Estimation
Researchers have introduced the Geometric Observability Index (GOI), a novel metric for assessing the sensitivity of pose estimation in SE(3) environments. This index quantifies the influence of individual measurements …
-
New CuBAS framework uses information geometry for adaptive data sampling
Researchers have developed CuBAS (Curvature-Based Adaptive Sampling), a novel framework for selecting informative data points for supervised classification tasks. This method leverages information geometry, viewing a la…
-
OrthoTryOn framework enhances unified fashion generation by resolving task conflicts
Researchers have developed OrthoTryOn, a novel framework designed to improve unified fashion generation models. This approach tackles the issue of negative transfer and gradient conflict that arises when multiple distin…
-
New research explores causal inference and data synthesis for complex data types · 8 sources tracked
Several new research papers explore advancements in causal inference and data synthesis, particularly for tabular and temporal data. One paper introduces a benchmark framework to evaluate tabular synthesis models based …
-
New paper models belief formation geometry under noisy observation
A new arXiv paper explores the geometric costs associated with belief formation in finite systems that operate with noisy observations. The research models the process as optimal transport in Wasserstein space, reweight…
-
New 'Sparsity Curse' hinders merging of advanced RLVR AI models
A new research paper introduces the "Sparsity Curse" phenomenon, which describes how Reinforcement Learning with Verifiable Reward (RLVR) models, despite their advanced reasoning capabilities, become difficult to merge …
-
New framework analyzes diffusion model degradation via Fisher geometry
Researchers have developed a new framework to analyze latent-space degradation in diffusion models by quantifying latent-space diffusability using the rate of change of the Minimum Mean Squared Error (MMSE). This framew…
-
New algorithm improves sampling complexity for non-log-concave distributions
Researchers have developed a new algorithm for sampling from non-log-concave distributions, improving upon previous methods. The algorithm leverages recent advancements in log-concave sampling and utilizes a restricted …
-
TopoFisher learns topological summaries by maximizing Fisher information
Researchers have developed TopoFisher, a novel differentiable pipeline that learns topological summaries by maximizing Fisher information. This method optimizes trainable filtrations, vectorizations, and compressors wit…
-
New framework measures neural sensitivity beyond activation alignment
Researchers have developed a new framework to assess neural sensitivity beyond simple activation alignment. This approach uses local decodable information and Fisher information to measure a representation's ability to …
-
New physics framework links information geometry, jet substructure, and hypergraphs
Researchers have introduced a novel framework that bridges information geometry with jet substructure analysis in high-energy physics. This work demonstrates a triality between cumulant tensors, energy correlators, and …