Paeonia

New benchmark reveals LLMs struggle with Chinese poetry's logic

A new benchmark called Peony has been developed to evaluate how well large language models (LLMs) can understand the unique "poetic logic" found in modern Chinese poetry. This logic requires a holistic reasoning approac…