PulseAugur
EN
LIVE 01:09:26

Hetzner experiments with OpenAI-compatible LLM inference API

By PulseAugur Editorial · [1 sources] ·

Hetzner is experimenting with offering LLM inference services through an OpenAI-compatible API. This early-stage offering, currently without billing or SLAs, uses the Qwen/Qwen3.6-35B-A3B-FP8 model and is designed to gauge user interest and system scalability. Initial tests indicate fast performance, with a median time to first token of 153 ms and an output speed of 224 tokens per second. AI

IMPACT This experiment could signal a new trend in cloud providers offering direct LLM inference, potentially increasing competition and accessibility.

RANK_REASON Hetzner is experimenting with an LLM inference service, which is a product offering but not a frontier release or significant industry move.

Read on dev.to — LLM tag →

AI-generated summary · Google Gemini · from 1 sources. How we write summaries →

Hetzner experiments with OpenAI-compatible LLM inference API

How we ranked this

Signal score
0 / 100
Composite score across the factors below. Higher = stronger signal that this story matters right now.
Newsworthiness bucket
Tool
Hetzner is experimenting with an LLM inference service, which is a product offering but not a frontier release or significant industry move.
Source corroboration
Single-source cluster
Only one publisher covered this so far. Single-source stories can still rank when the publisher is high-authority, but they lack cross-source corroboration.
Topics
product, infra
Editorial topic classification. Feeds into how the story surfaces on /topic/<slug> hub pages and into the per-entity coverage mix.
AI-industry relevance
High
Clearly on-topic for AI-industry coverage.
Story freshness
64 days old
Aged out of breaking-news scoring windows; ranking reflects the durable signal from the full source set.

Full methodology in our editorial standards.

COVERAGE [1]

  1. dev.to — LLM tag TIER_1 Deutsch(DE) · Jonas Scholz ·

    Hetzner Inference: First Look

    <p>Hetzner is experimenting with LLM inference.</p> <p>That is not a sentence I expected to write, but I think it is pretty interesting :)</p> <p>Before anyone moves their production AI workloads to Hetzner: this is very much an <strong>experiment</strong>. There is no billing, n…

RELATED ENTITIES

RELATED TOPICS