ENTITY
SuperBPE
SuperBPE
PulseAugur coverage of SuperBPE — every cluster mentioning SuperBPE across labs, papers, and developer communities, ranked by signal.
Total · 30d
1
2 over 90d
Releases · 30d
0
0 over 90d
Papers · 30d
1
2 over 90d
TIER MIX · 90D
TOPICS
SENTIMENT · 30D
1 day(s) with sentiment data
RECENT · PAGE 1/1 · 2 TOTAL
-
New multi-word tokenizer Havon v4 outperforms GPT-4o on 204 languages
Researchers have developed a new multi-word tokenizer called Havon v4, which demonstrates improved efficiency over GPT-4o's tokenizer across 204 languages. Havon v4, particularly when trained with a larger vocabulary, r…
-
Superword tokenization algorithms achieve over 600x speedup
Researchers have developed significantly faster implementations of the BoundlessBPE and SuperBPE algorithms for tokenization, which extend Byte Pair Encoding (BPE) to create "superwords" that combine multiple pretokens.…