A recent benchmark test evaluated four open decision models—Laya, d1, Clef-Flash, and Lev—on an RTX 4090 GPU to determine their local performance. The test involved reading nine Wikipedia articles about centipedes and identifying specific terms. Laya emerged as the fastest model, processing words at 3.9 ms per word and achieving 7,980 words in 32 seconds. While Lev demonstrated the highest accuracy in catching centipede names, it was significantly slower, taking 51.0 ms per word. AI
IMPACT Laya's speed advantage suggests it could be a preferred choice for applications requiring rapid local processing of decision models.
RANK_REASON Benchmark results for open decision models. [lever_c_demoted from research: ic=1 ai=1.0]
AI-generated summary · Google Gemini · from 1 sources. How we write summaries →