JSON parsers tested on LLM output: jsonrepair leads, JSON.parse fails

A comparison of three JavaScript JSON parsers—standard JSON.parse, jsonrepair 3.15.0, and JSON5 2.2.3—reveals significant differences in their ability to handle malformed LLM output. While JSON.parse correctly identifies unrecoverable errors, JSON5 can only fix simple object literals. jsonrepair 3.15.0 demonstrates the most robust performance, successfully repairing five common LLM output errors including trailing commas, unquoted keys, comments, and incorrect boolean/null values, though it incorrectly parses a prose-based refusal as an array. AI

IMPACT Highlights the challenges of integrating LLM outputs into applications and the need for robust error-handling in parsing.

RANK_REASON The article compares the performance of different software tools (JSON parsers) on a specific task (handling malformed LLM output).

Read on dev.to — LLM tag →

• Javascript
• JSON
• JSON5
• JSON5 2.2.3
• JSON.parse
• jsonrepair
• jsonrepair 3.15.0
• LLM
• Python
• XML

• product
• infra

AI-generated summary · Google Gemini · from 1 sources. How we write summaries →