PulseAugur
中
实时 00:37:05
English(EN) Perplexity has open sourced Lily, a Rust and Metal inference engine for running Qwen3.6-35B-A3B on Apple Silicon. The specialised engine achieves 1.23x faster p

Perplexity 开源适用于 Apple Silicon 的 Lily 推理引擎

作者 PulseAugur 编辑部 · [3 个来源] ·

Perplexity 已开源 Lily，一个使用 Rust 和 Metal 构建的专用推理引擎，用于在 Apple Silicon 上运行 Qwen3.6-35B-A3B 模型。该引擎专为狭窄的硬件优化而设计，与 MLX-LM 等通用框架相比，解码速度提高了 1.35 倍，预填充速度提高了 1.23 倍。Lily 的架构绕过了 PyTorch 和 MLX 等传统框架，利用手工编写的 Metal 内核进行执行，并提供了一个与 OpenAI 兼容的 API。 AI

影响 像 Lily 这样的专用推理引擎可以通过超越通用框架的性能优化，加速在消费级硬件上的本地 AI 模型部署。

排序理由 Perplexity 开源了一个专用推理引擎 Lily，这是一个在特定硬件上运行特定模型的工具。

在 Mastodon — mastodon.social 阅读 →

AI 生成摘要 · Google Gemini · 来自 3 个来源。 我们如何撰写摘要 →

Perplexity 开源适用于 Apple Silicon 的 Lily 推理引擎

本文如何被排名

Signal score
0 / 100
Composite score across the factors below. Higher = stronger signal that this story matters right now.
Newsworthiness bucket
Tool
Perplexity 开源了一个专用推理引擎 Lily，这是一个在特定硬件上运行特定模型的工具。
Source corroboration
3 independent sources
Multiple independent publishers reporting the same story raises confidence that it's real and newsworthy.
Topics
infra, product
Editorial topic classification. Feeds into how the story surfaces on /topic/<slug> hub pages and into the per-entity coverage mix.
AI-industry relevance
High
Clearly on-topic for AI-industry coverage.
Story freshness
12 days old
Aged out of breaking-news scoring windows; ranking reflects the durable signal from the full source set.
Coverage growth since scoring
+1 source(s) since last score
New sources have picked up this story since our last re-score. Score will update on the next scoring pass.

完整方法见我们的编辑标准。

报道来源 [3]

  1. MarkTechPost TIER_1 English(EN) · Asif Razzaq ·

    Perplexity 开源 Lily：一款用于 Apple Silicon 上 Qwen3.6-35B-A3B 的 Rust + Metal 推理引擎

    <p>Perplexity has open sourced Lily, the local inference engine behind Hybrid Compute in Perplexity Computer. Built in Rust with custom Metal kernels for one model on one chip family, it averages 1.23x MLX-LM's prefill throughput and 1.35x its decode throughput on a 40-core, 128 …

  2. r/LocalLLaMA TIER_1 English(EN) · /u/saltexx ·

    我们开源了 Paddock，一个拥有自研 CUDA 内核的 Rust/C++ 推理引擎（MIT/Apache-2.0）

    <!-- SC_OFF --><div class="md"><p>I'm one of the developers. We said in August it would go open source in September and it did last night. MIT or Apache-2.0, pick one. The repo you see is our internal repo, kernels included, so from now on everything happens in public.</p> <p>It'…

  3. Mastodon — mastodon.social TIER_1 English(EN) · [email protected] ·

    Perplexity 开源了 Lily，一个用于在 Apple Silicon 上运行 Qwen3.6-35B-A3B 的 Rust 和 Metal 推理引擎。该专用引擎实现了 1.23 倍的 p

    Perplexity has open sourced Lily, a Rust and Metal inference engine for running Qwen3.6-35B-A3B on Apple Silicon. The specialised engine achieves 1.23x faster prefill and 1.35x faster decode than MLX-LM, demonstrating how narrow hardware optimisation can beat general-purpose fram…

相关实体

相关话题