Post-training makes LLMs funnier but less diverse, study finds

A study investigated whether post-training enhances the humor of large language models, finding that while it generally makes them funnier, it also reduces response diversity. The research tracked 11 stages of post-training across models like Tulu 3, OLMo 3.1, and Qwen2.5, using over 2,300 head-to-head judgments from human raters. Results indicated that later training stages produced funnier jokes that were also more concise, but the models tended to repeat similar joke structures. AI

IMPACT This research suggests that while post-training can improve LLM humor, it may come at the cost of creative diversity, potentially impacting applications requiring varied and original responses.

RANK_REASON The cluster reports on a study analyzing the effects of post-training on LLM humor, which is a research finding. [lever_c_demoted from research: ic=1 ai=1.0]

Read on r/LocalLLaMA →

• Llama 3.1 70B
• OLMo 3.1 32B
• Qwen2.5
• Tulu 3

• model release
• other

AI-generated summary · Google Gemini · from 1 sources. How we write summaries →