Richardson-Romberg extrapolation

New technique analyzes Q-learning convergence and bias in stochastic approximation

Researchers have developed a new technique for analyzing nonsmooth contractive stochastic approximation (SA) dynamics, particularly relevant to Q-learning. The study establishes weak convergence of iterates to a station…