arXiv paper finds error in concentration inequality proofs for reinforcement learning

A recent paper published on arXiv, titled "Time-Uniform Self-Normalized Concentration for Discounted Least Squares: Limits and Corrections," identifies a flaw in a widely used weighted extension of self-normalized concentration inequalities. The paper demonstrates with a Gaussian counterexample that the claimed time-uniform guarantee for discounted least-squares estimators in non-stationary problems is not valid. The authors pinpoint the proof error to the use of different Gaussian mixing distributions at different terminal times, which prevents the formation of a single supermartingale. They offer corrections for both finite and infinite horizons and discuss the implications for subsequent analyses. AI

IMPACT Identifies a flaw in theoretical underpinnings used in reinforcement learning analyses, potentially requiring corrections in downstream research.

RANK_REASON The cluster contains a single academic paper detailing theoretical findings and corrections in machine learning analysis. [lever_c_demoted from research: ic=1 ai=1.0]

Read on arXiv cs.LG →

• arXiv
• CatalyzeX
• computer science
• DagsHub
• Gaussian function
• Gotit.pub
• Hugging Face
• IArxiv
• machine learning
• ScienceCast
• Sub-Gaussian distribution
• Time-Uniform Self-Normalized Concentration for Discounted Least Squares: Limits and Corrections

• paper
• other

AI-generated summary · Google Gemini · from 1 sources. How we write summaries →