A new research paper explores the asymptotic behavior of generalized variational inference solutions when regularized by an $\alpha$-divergence. The study reveals that under certain conditions, the minimizer of this problem can be explicitly determined and exhibits a rescaling property. The paper details how the limit of this rescaled minimizer depends on the value of $\alpha$, leading to different distributions such as Student-t or Pearson type-II, and impacting the posterior width relative to the sampling error. The Kullback–Leibler divergence, corresponding to $\alpha=1$, is identified as the unique case where the posterior width matches the sampling scale and the limit is Gaussian. AI
IMPACT Provides theoretical insights into statistical inference methods that could inform future AI model development.
RANK_REASON Academic paper published on arXiv detailing theoretical statistical analysis. [lever_c_demoted from research: ic=1 ai=1.0]
- Ioar Casado-Telletxea
- Kullback–Leibler divergence
- logistic regression model
- Pearson type-II distribution
- Student-t distribution
AI-generated summary · Google Gemini · from 1 sources. How we write summaries →