PulseAugur
EN
LIVE 22:15:12

MLLMs struggle to match human aesthetic critique style, study finds

By PulseAugur Editorial · [2 sources] ·

A new research paper explores the capabilities of multimodal large language models (MLLMs) in generating aesthetic critiques, comparing their output to human evaluations. The study utilized the Reddit Photo Critique Dataset to assess five open-weight MLLMs across various prompt conditions. Findings indicate that while MLLMs can produce comprehensive critiques, their style differs significantly from human evaluations, often being more verbose and less selective, which challenges current evaluation metrics. AI

IMPACT Highlights limitations in current MLLM evaluation methods for open-ended generation, suggesting a need for new training and assessment strategies.

RANK_REASON Research paper published on arXiv evaluating MLLM capabilities.

Read on arXiv cs.CL →

AI-generated summary · Google Gemini · from 2 sources. How we write summaries →

MLLMs struggle to match human aesthetic critique style, study finds

How we ranked this

Signal score
0 / 100
Composite score across the factors below. Higher = stronger signal that this story matters right now.
Newsworthiness bucket
Research
Research paper published on arXiv evaluating MLLM capabilities.
Source corroboration
2 independent sources
Multiple independent publishers reporting the same story raises confidence that it's real and newsworthy.
Topics
paper, model release
Editorial topic classification. Feeds into how the story surfaces on /topic/<slug> hub pages and into the per-entity coverage mix.
AI-industry relevance
High
Clearly on-topic for AI-industry coverage.
Story freshness
101 days old
Aged out of breaking-news scoring windows; ranking reflects the durable signal from the full source set.

Full methodology in our editorial standards.

COVERAGE [2]

  1. arXiv cs.CL TIER_1 English(EN) · Sajjad Ghiasvand, Maryam Amirizaniani, Haniyeh Ehsani Oskouie, Mahnoosh Alizadeh, Ramtin Pedarsani ·

    Can MLLMs Critique Like Humans? Evaluating Open-Ended Aesthetic Reasoning in Multimodal Large Language Models

    arXiv:2606.29689v1 Announce Type: new Abstract: Open-ended aesthetic critique is a challenge for multimodal large language models (MLLMs): unlike multiple-choice aesthetic benchmarks, it has no single correct answer, and most aesthetic evaluation has measured models against numer…

  2. arXiv cs.CL TIER_1 English(EN) · Ramtin Pedarsani ·

    Can MLLMs Critique Like Humans? Evaluating Open-Ended Aesthetic Reasoning in Multimodal Large Language Models

    Open-ended aesthetic critique is a challenge for multimodal large language models (MLLMs): unlike multiple-choice aesthetic benchmarks, it has no single correct answer, and most aesthetic evaluation has measured models against numeric scores rather than the written critiques peop…

RELATED ENTITIES

RELATED TOPICS