PulseAugur
EN
LIVE 05:19:51

LLM benchmark 1rok pits GPT-5.5, Gemini 3.1, Grok 4.3 in stock-picking contest

By PulseAugur Editorial · [1 sources] ·

A new benchmark, dubbed 1rok, has been launched to evaluate the stock-picking capabilities of frontier large language models. The benchmark assigns each participating LLM a virtual portfolio of $100,000 and tasks them with selecting stocks weekly, with performance tracked against market outcomes. This initiative aims to provide a more practical, downstream evaluation of LLMs beyond traditional coding and reasoning benchmarks, focusing on decision-making under uncertainty. AI

IMPACT Provides a novel benchmark for evaluating LLM decision-making under uncertainty, moving beyond traditional coding and reasoning tasks.

RANK_REASON The article describes a new benchmark for evaluating LLMs on a specific downstream task (stock picking), which is a form of research and evaluation. [lever_c_demoted from research: ic=1 ai=1.0]

Read on dev.to — LLM tag →

AI-generated summary · Google Gemini · from 1 sources. How we write summaries →

LLM benchmark 1rok pits GPT-5.5, Gemini 3.1, Grok 4.3 in stock-picking contest

COVERAGE [1]

  1. dev.to — LLM tag TIER_1 English(EN) · Achal Jhawar ·

    Which LLM is the best stock picker? I built a benchmark to find out.

    <p>Every other week there's a new GPT-vs-Claude-vs-Gemini benchmark on coding or math or reasoning. None of them tell you whether the model can actually make a decision under uncertainty, where the answer isn't in the training data and the result shows up two weeks later in a P&a…

RELATED ENTITIES

RELATED TOPICS