A Lost Letter

LLM token pricing incentivizes low-value output, inflating costs

The current per-token pricing model for large language models creates a misalignment where providers are incentivized to generate more tokens, even if they are of low value or redundant. This "overthinking tax" leads to…