Try the Tech Radar #1 — TOON Cuts JSON Token Cost by 71% for LLM Context
A new data format called TOON (Token-Oriented Object Notation) has been developed to significantly reduce the token count for LLM context windows. TOON achieves this by reformatting JSON data into a more compact, CSV-like structure, eliminating redundant key repetitions and quotes where possible. This method can cut token usage by up to 71% for typical API responses, making it more efficient for LLM processing. AI
IMPACT Reduces LLM operational costs by making context windows more efficient, potentially enabling longer or more complex interactions.