Successor Representations

Successor representations reveal emergent word class structures in language models

Researchers have applied successor representations (SRs), a principle from reinforcement learning, to natural language processing. By training a neural network on WikiText-103 to predict future word distributions across…