Alternative Tokenizations

New methods enable language models to learn complex graph search tasks at scale

Researchers have identified two key factors hindering language models' ability to learn latent multi-hop graph search at scale: the supervision signal and tokenization methods. By implementing multi-token prediction (MT…