PulseAugur
EN
LIVE 06:15:08

User seeks <15B local LLMs for Italian medical exam comparison

A user on the r/LocalLLaMA subreddit is seeking recommendations for local language models under 15 billion parameters. The goal is to test these models against the Italian medical exam for residents, which is expected to be released in a few weeks. The user aims to compare the performance of these smaller models against that of an average medical resident, noting that larger 32B models were sufficient for this comparison last year. AI

RANK_REASON This is a user query on a subreddit, not a news event.

Read on r/LocalLLaMA →

AI-generated summary · Google Gemini · from 1 sources. How we write summaries →

User seeks <15B local LLMs for Italian medical exam comparison

COVERAGE [1]

  1. r/LocalLLaMA TIER_1 English(EN) · /u/sebastianmicu24 ·

    <15B local models to test on medical benchmark?

    <!-- SC_OFF --><div class="md"><p>HI, in a few weeks the medical exam for italian residents will drop, and I would like to compare small models that run on my laptop against it. It would not be a standard benchmark for llms but it would give a sense on how much better does it per…