PulseAugur
EN
LIVE 08:25:32

User runs MiMo-2.6-Pro on Jetson AGX Thor, touts open-source transparency

By PulseAugur Editorial · [1 sources] ·

A user on Reddit's r/LocalLLaMA subreddit shared their experience running the MiMo-2.6-Pro model on a Jetson AGX Thor, achieving a speed of 0.646 tokens per second. The user highlighted the ability to trace and replay every step of the inference process with open-source models, contrasting this with closed-source models where internal workings are not visible. The model, which is approximately 566GB in FP8 format, was loaded from disk and processed through 128GB of memory, with the user humorously comparing the speed to "hand-extruded hotdog manufacturing." AI

IMPACT Highlights the trade-offs between open-source model transparency and performance on consumer-grade hardware.

RANK_REASON User-generated content discussing the performance and transparency of an open-source model on specific hardware.

Read on r/LocalLLaMA →

AI-generated summary · Google Gemini · from 1 sources. How we write summaries →

User runs MiMo-2.6-Pro on Jetson AGX Thor, touts open-source transparency

How we ranked this

Signal score
1 / 100
Composite score across the factors below. Higher = stronger signal that this story matters right now.
Newsworthiness bucket
Tool
User-generated content discussing the performance and transparency of an open-source model on specific hardware.
Source corroboration
Single-source cluster
Only one publisher covered this so far. Single-source stories can still rank when the publisher is high-authority, but they lack cross-source corroboration.
Topics
model release, infra
Editorial topic classification. Feeds into how the story surfaces on /topic/<slug> hub pages and into the per-entity coverage mix.
AI-industry relevance
High
Clearly on-topic for AI-industry coverage.
Story freshness
Same-day
Cluster formed today. Ranking reflects the current source set at time of score.

Full methodology in our editorial standards.

COVERAGE [1]

  1. r/LocalLLaMA TIER_1 English(EN) · /u/Oswald_Hydrabot ·

    Dario: “With open source you can see the source code. Here we can’t see inside the model.” My 0.646 t/s MiMo-2.6-Pro crammed thru 128GB of Jetson AGX Thor: “Yeah, well, that’s just, like, your opinion, man.”

    <table> <tr><td> <a href="https://www.reddit.com/r/LocalLLaMA/comments/1x7sbxs/dario_with_open_source_you_can_see_the_source/"> <img alt="Dario: “With open source you can see the source code. Here we can’t see inside the model.” My 0.646 t/s MiMo-2.6-Pro crammed thru 128GB of Jet…

RELATED ENTITIES

RELATED TOPICS