PulseAugur
EN
LIVE 08:23:22

LLM essays outperform student essays on Korean writing rubric

A recent study published on arXiv explored the differences between essays written by students and those generated by large language models (LLMs) using a Korean writing rubric. The research found that LLM-generated essays significantly outperformed student essays, scoring an average of 18.35 points higher. Key factors contributing to this gap were orthographic norms and genre-appropriate register, where LLMs consistently achieved maximum scores. While LLMs excelled in these areas, human readers found student essays stronger in creativity and natural phrasing, indicating areas where human writing still holds an advantage. AI

IMPACT Highlights LLMs' current strengths in formal writing aspects, potentially influencing educational assessment strategies.

RANK_REASON Academic paper detailing research findings on LLM writing capabilities. [lever_c_demoted from research: ic=1 ai=1.0]

Read on arXiv cs.CL →

AI-generated summary · Google Gemini · from 1 sources. How we write summaries →

LLM essays outperform student essays on Korean writing rubric

COVERAGE [1]

  1. arXiv cs.CL TIER_1 English(EN) · Shinwoo Park, Yo-Sub Han ·

    When LLM Essays Outscore Student Essays: What a Korean Writing Rubric Rewards and Where Readers Disagree

    arXiv:2601.19913v4 Announce Type: replace Abstract: LLMs now help students plan, draft, and revise essays. Educational assessment therefore faces a basic question: how should student and LLM writing be compared? Rubrics assign points to content, organization, and expression. Thei…