Brief

Researchers have developed a new method for improving Grammatical Error Correction (GEC) in large language models (LLMs) by focusing on retrieving relevant in-context demonstrations. Their approach, termed Grammatical Error Representation (GER), extracts internal states from LLMs that encode grammatical errors, rather than relying on semantic similarity. This GER-based retrieval significantly enhances few-shot performance on multilingual GEC tasks, achieving results comparable to closed-source models like Deepseek2.5 and GPT-4o-mini for high-resource languages and surpassing baselines for low-resource languages. AI

Researchers have developed a new method to address the over-correction problem in large language models used for grammatical error correction. Their training-free inference technique involves generating multiple correction candidates from a single model and then applying an edit-level majority vote. This approach has shown superior performance compared to standard decoding methods across nine diverse language benchmarks, while also maintaining consistent quality regardless of the input prompts. AI