AI Does Multiplication Underneath. So Why Did Older Models Break at School Maths?
Large language models, despite being built on mathematical operations like multiplication, have historically struggled with basic arithmetic, such as comparing decimal numbers. This issue stems from how models use multiplication not for direct calculation, but for transforming and relating information between tokens via learned weights. While modern models are improving, their inability to recognize their own errors highlights a fundamental difference between their internal processes and human understanding of mathematics. AI
IMPACT Highlights a gap in LLM reasoning, suggesting current models may not reliably perform basic arithmetic despite underlying mathematical operations.
