Joon Hyeok Kim

Diffusion models' algorithmic generalization studied via modular arithmetic

Researchers have conducted a mechanistic study on how diffusion models achieve algorithmic generalization, using a modular addition task as a testbed. The study observed that in a single-image scenario, the model encode…