MCqasim
PulseAugur coverage of MCqasim — every cluster mentioning MCqasim across labs, papers, and developer communities, ranked by signal.
1 day(s) with sentiment data
-
Hidden dates in LLM prompts skew evaluations, research finds · 2 sources tracked
A new research paper highlights a significant, previously overlooked factor impacting Large Language Model (LLM) evaluations: the automatic injection of the current date into system prompts. This hidden date variable ca…
-
Eloquence team details multilingual QA approach for Interspeech 2026 challenge
The Eloquence team detailed their submission for the Interspeech 2026 MLC-SLM challenge, focusing on multilingual multiple-choice question answering across 21 languages. They explored three methods: fine-tuning Voxtral-…
-
New framework audits MCQA benchmarks using model output distributions
Researchers have developed a new two-component probabilistic framework to audit multiple-choice question answering (MCQA) benchmarks. This framework analyzes model output distributions to assess benchmark quality and id…
-
Speech-to-SFT pipeline ablation reveals data quality gains don't always boost downstream performance
A new research paper published on arXiv details a factorial ablation study of a speech-to-SFT pipeline, investigating the impact of different refinement stages on data quality and downstream model performance. The study…
-
New GGC Framework Boosts Text-to-SPARQL Accuracy with Selective Correction
Researchers have introduced Generator-Gate-Corrector (GGC), a novel framework designed to improve the reliability of text-to-SPARQL generation using large language models. GGC first generates a query, then a gate determ…
-
New metrics reveal LLM persona instability in MCQA tasks
Researchers have developed new metrics to assess the instability of Large Language Model (LLM) persona-driven generations (PDGs) in multiple-choice question answering (MCQA) tasks. Their findings indicate that instabili…
-
Study compares LLM adaptation methods for French medical QA
A new study published on arXiv explores the effectiveness of different methods for adapting large language models (LLMs) to specialized domains and languages, using French medical question-answering as a case study. The…