PulseAugur
EN
LIVE 01:33:21

OpenAI Evals service shutting down; users urged to migrate

OpenAI is discontinuing its Evals service, with read-only access ending October 31st and full inaccessibility by November 30th. The Agent Builder and v1/prompts API will also be discontinued on the latter date. Users are advised to migrate their evals to Promptfoo, export results, or retrieve data via the Evals API to rebuild tests. The author introduces LLMShift, a tool designed to help users export their OpenAI Evals and run them against any LLM, including models from Anthropic. AI

IMPACT Users must migrate their LLM evaluation workflows to alternative tools like Promptfoo or LLMShift to continue testing models.

RANK_REASON The article describes a tool (LLMShift) for migrating from a discontinued service (OpenAI Evals).

Read on dev.to — LLM tag →

AI-generated summary · Google Gemini · from 1 sources. How we write summaries →

OpenAI Evals service shutting down; users urged to migrate

How we ranked this

Signal score
7 / 100
Composite score across the factors below. Higher = stronger signal that this story matters right now.
Newsworthiness bucket
Tool
The article describes a tool (LLMShift) for migrating from a discontinued service (OpenAI Evals).
Source corroboration
Single-source cluster
Only one publisher covered this so far. Single-source stories can still rank when the publisher is high-authority, but they lack cross-source corroboration.
Topics
product, infra
Editorial topic classification. Feeds into how the story surfaces on /topic/<slug> hub pages and into the per-entity coverage mix.
AI-industry relevance
High
Clearly on-topic for AI-industry coverage.
Story freshness
Same-day
Cluster formed today. Ranking reflects the current source set at time of score.

Full methodology in our editorial standards.

COVERAGE [1]

  1. dev.to — LLM tag TIER_1 English(EN) · Nzubechi Chukwu ·

    Your OpenAI Evals freeze on Saturday. Here's how to get them out, and keep testing on any model

    <p>OpenAI stops hosting its Evals service. As of Saturday, October 31st, your evals become read-only. As of Monday, November 30th, the Evals Dashboard and Evals API become inaccessible. Also on that day, the Agent Builder and reusable prompts (the <code>v1/prompts</code> API) are…