PakBeaverTails

New Urdu benchmark reveals cultural mismatch in LLM alignment

A new benchmark called Pak3H has been developed to evaluate the cultural alignment of large language models (LLMs) in Urdu. This benchmark addresses the limitations of existing multilingual evaluations, which often rely…