PulseAugur
EN
LIVE 17:59:48

Nemotron 3 Ultra leads new AI recruitment benchmark with 90.87 score

By PulseAugur Editorial · [1 sources] ·

The new Team Recruitment (Oracle) benchmark, developed by lforla, evaluates AI agents on their ability to query a résumé oracle and assemble a team that meets specific criteria. Currently, the leaderboard features two free-tier models from opencode-zen: Nemotron 3 Ultra, which achieved a score of 90.87, and HY3, with a score of 83.1. This benchmark differs from static knowledge tests by simulating a dynamic workflow that requires agents to plan queries, interpret structured data, and make decisions under constraints, aiming to assess performance based on outcome quality. AI

IMPACT Establishes a new evaluation method for AI agents, focusing on dynamic workflows and outcome quality rather than static knowledge recall.

RANK_REASON New benchmark and leaderboard release for AI agent evaluation. [lever_c_demoted from research: ic=1 ai=1.0]

Read on dev.to — LLM tag →

AI-generated summary · Google Gemini · from 1 sources. How we write summaries →

Nemotron 3 Ultra leads new AI recruitment benchmark with 90.87 score

How we ranked this

Signal score
27 / 100
Composite score across the factors below. Higher = stronger signal that this story matters right now.
Newsworthiness bucket
Tool
New benchmark and leaderboard release for AI agent evaluation. [lever_c_demoted from research: ic=1 ai=1.0]
Source corroboration
Single-source cluster
Only one publisher covered this so far. Single-source stories can still rank when the publisher is high-authority, but they lack cross-source corroboration.
Topics
product, other
Editorial topic classification. Feeds into how the story surfaces on /topic/<slug> hub pages and into the per-entity coverage mix.
AI-industry relevance
High
Clearly on-topic for AI-industry coverage.
Story freshness
Breaking (< 6h)
Fresh story with cross-source coverage still developing. Ranking may shift as more sources report.

Full methodology in our editorial standards.

COVERAGE [1]

  1. dev.to — LLM tag TIER_1 English(EN) · RESK ·

    Nemotron 3 Ultra Tops the Team Recruitment Benchmark with 90.87 — and It's Free

    <h2> Nemotron 3 Ultra Tops the Team Recruitment Benchmark with 90.87 — and It's Free </h2> <h3> TL;DR </h3> <p>lforla's new Team Recruitment (Oracle) benchmark evaluates how well an AI agent can query a résumé oracle and assemble a team that satisfies composition criteria. Right …

RELATED ENTITIES

RELATED TOPICS