Autoregressive models

Generative models learn rules across two distinct training timescales

Researchers have identified two distinct timescales in generative model training: the point at which generations become rule-valid ($\tau_{\mathrm{rule}}$) and the point at which models begin reproducing training sample…