A performance benchmark comparing AI gateways found that LLM Gateway significantly outperforms OpenRouter in time to first token (TTFT). LLM Gateway achieved a median cold TTFT of 906ms and warm TTFT of 814ms, while OpenRouter took 1392ms and 1232ms respectively. The benchmark, using an open-source script by Ronny Badilla, measured various latency components including DNS, TCP connect, TLS handshake, and TTFB, revealing that OpenRouter's overhead occurs after the request is sent, not during connection establishment. AI
IMPACT LLM Gateway's superior performance could lead to faster user experiences and potentially influence adoption trends for AI infrastructure providers.
RANK_REASON Benchmark comparing performance of AI gateways. [lever_c_demoted from research: ic=1 ai=0.7]
- ai-gateways-benchmark
- Claude Haiku 4.5
- Cloudflare AI Gateway
- LLM Gateway
- OpenRouter
- Ronny Badilla
- Vercel
AI-generated summary · Google Gemini · from 1 sources. How we write summaries →
