Rényi entropy
PulseAugur coverage of Rényi entropy — every cluster mentioning Rényi entropy across labs, papers, and developer communities, ranked by signal.
2 day(s) with sentiment data
-
New 'Rényi Sharpness' metric shows strong generalization correlation
Researchers have introduced "Rényi sharpness," a new metric for evaluating neural network generalization that aims to improve upon existing methods. Unlike traditional sharpness measures that focus on average loss or ma…
-
New SAKE method boosts diversity in text diffusion models
Researchers have developed a new training-free guidance method called SAKE (Semantic-Aware Kernel Entropy) to improve diversity in text diffusion models. This method utilizes Rényi entropy over a Gram matrix to capture …
-
New Bounds Set for Rényi and Min-Entropy Estimation
Researchers have established new sample complexity bounds for estimating Rényi and min-entropy, which are fundamental concepts in information theory and property testing. The study provides precise characterizations for…
-
New Projective Maximum Entropy Framework Unifies Statistical Reference Distributions
Researchers have introduced Projective Maximum Entropy, a novel framework for constructing reference distributions in statistics. This approach addresses limitations with unnormalized statistical models and prescribed a…
-
New method uses heat-kernel entropy for manifold analysis
Researchers have developed a new method called heat-kernel entropy profiles to analyze weighted empirical measures on compact manifolds. This technique diffuses weighted atoms using intrinsic heat flow to track nonunifo…
-
New LP-SFT method preserves language model entropy structure
Researchers have introduced LP-SFT, a novel supervised fine-tuning method designed to preserve the inherent multimodal entropy structure of pretrained language models. Standard fine-tuning can degrade existing capabilit…
-
New LP-SFT method preserves language model capabilities during fine-tuning
Researchers have introduced LP-SFT, a novel supervised fine-tuning method designed to preserve the inherent entropy structure of pretrained language models. Standard fine-tuning can degrade existing capabilities by over…
-
New MAE uses multifractal analysis for better medical image diagnosis
Researchers have developed a new masked autoencoder (MAE) technique called Multifractal-Optimized Masked Autoencoder (MO-MAE) for medical image analysis. This method uses multifractal analysis, specifically Renyi entrop…
-
New bound links generalization gap to data entropy
Researchers have developed a new method to bound the generalization gap in machine learning models, which is a key factor in understanding overfitting. This novel approach establishes a model-independent upper bound for…