Canine

Paper analyzes how data representation affects Transformer context

A new paper analyzes how different data representations impact Transformer model performance. Researchers found that breaking down data into smaller units, like characters or bytes, can increase prediction loss even wit…