ONNX
PulseAugur coverage of ONNX — every cluster mentioning ONNX across labs, papers, and developer communities, ranked by signal.
- used by DJ software 90%
- used by ONNX Runtime Web 90%
- used by tensorrt 70%
- used by GGUF 70%
- used by WebGPU 70%
- used by Docker 70%
- used by qdrant 70%
- used by NVIDIA Jetson Orin Nano 8GB 70%
- used by graphics processing unit 70%
- used by Raspberry Pi 5 70%
- used by Anmol Mishra 70%
- used by Audio Developer Conference 70%
14 day(s) with sentiment data
-
Developer Slashes OpenAI Latency by 99% with Semantic Caching Tool
A developer has created HyperCache-LLM, an open-source semantic caching proxy designed to reduce response latency and costs for AI chatbots. The tool intercepts user queries, using a local ONNX embedding model to check …
-
Liquid AI's LFM3-1.7B model fits in 1GB, claims benchmark win over Qwen3.5-9B
Liquid AI has released LFM3-1.7B, a new 1.73 billion parameter text model that can fit into 1 GB of memory and process up to 256K tokens of context. While Liquid AI's own benchmarks suggest LFM3-1.7B outperforms Qwen3.5…
-
NamiAgent tutorial simplifies local AI agent development, highlights speech input latency
The NamiAgent project has released a tutorial for building a local AI agent from scratch, emphasizing a simple Python-based loop that interacts with OpenAI-compatible models and executes tools. The tutorial covers vario…
-
KlangAI releases state-of-the-art Danish ASR model pianissimo-da
KlangAI has released pianissimo-da, a new Danish Automatic Speech Recognition (ASR) model. This model is available in multiple formats including GGUF, ONNX, MLX, and CoreML, and is hosted on Hugging Face. It is describe…
-
New open-source tool simplifies LLM quantization for desktop users
A new open-source desktop workspace called iQuantize has been released, designed to streamline the process of quantizing large language models. This tool supports conversions to GGUF, MLX, and ONNX formats, allowing use…
-
Vektor 2.0.4 adds Hacker News recommendations and procedural memory
Vektor has released version 2.0.4, introducing significant upgrades to its memory and recommendation features. The update integrates Hacker News book and video recommendations, allowing users to search and filter these …
-
AI agent apps run entirely in-browser using Laya decision model
A developer has created four AI agent applications that run entirely within a web browser using Laya, a 421M-parameter decision model from ConvAI Innovations, and WebGPU. These applications require no server or API keys…
-
MLOps: Model Serving Requires a Contract, Not Just Containers
Serving machine learning models effectively requires more than just containerization; it necessitates defining a clear contract that outlines how the model will be accessed and interact with other systems. This contract…
-
LiquidAI d1-Omni-2B: A decision model that hears but doesn't speak
The LiquidAI d1-Omni-2B model, designed as a "decision model" rather than a traditional chat assistant, can process various inputs including audio but does not generate spoken or written responses. It answers a set of p…
-
Liquid Ai releases LFM3 open models for local small business use
Liquid Ai has released a new family of open-weight models called LFM3, designed for small businesses and local deployment. The LFM3-1.7B model, which fits into approximately 1 GB of memory, is particularly suited for ta…
-
AI agent workflow streamlines PyTorch deployment on NPUs
Researchers have developed AIPC, an AI-driven agent workflow designed to streamline the deployment and optimization of PyTorch inference projects, particularly for on-device NPUs. This system utilizes structured skills …
-
AWS SageMaker SDK v3 streamlines edge computer vision model management
Amazon Web Services has updated its SageMaker SDK to version 3, introducing a new approach for managing computer vision models at the edge. This update replaces the older SageMaker Edge Manager with SageMaker Neo for op…
-
Liquid AI releases LFM2.5-24B-A2B for efficient agent tasks
Liquid AI has released LFM2.5-24B-A2B, a large open-weight model designed for agentic tasks. This model utilizes a mixture-of-experts approach, activating approximately 2 billion parameters per token out of its total 24…
-
MLOps pipeline built with NVIDIA Triton, ONNX, Docker, and WSL2
This article details the construction of an MLOps inference pipeline, emphasizing the integration of NVIDIA Triton, ONNX, Docker, and Windows Subsystem for Linux (WSL2). It guides users through training a machine learni…
-
Open-source Microduck robot enables sim-to-real walking policy training
Hugging Face and Pollen Robotics have released Microduck, an affordable open-source bipedal robot. Developers can now train walking policies for Microduck using NVIDIA's Isaac Lab and Newton simulation frameworks. The t…
-
Guide details AI production deployment on .NET and Azure
This article provides a comprehensive guide to deploying AI applications from prototype to production, focusing on .NET and Azure. It covers essential MLOps and LLMOps practices such as model deployment patterns, versio…
-
LLMs run in-browser via WebGPU, cutting inference costs
A new approach allows large language models to run directly within a web browser using WebGPU and Transformers.js, eliminating the need for server-side inference. This method, demonstrated in the BEINGS chatroom applica…
-
Music AI Model HTDemucs Runs Entirely in Browser via ONNX and WebGPU
A music AI model called HTDemucs has been successfully exported to ONNX and is now running entirely within a web browser using onnxruntime-web and WebGPU. This approach allows for stem separation, which previously requi…
-
New research explores advanced quantization for edge AI accelerators
Two new research papers explore advanced quantization techniques for deep neural networks (DNNs) on edge devices. The first paper introduces ShiftQAT, a quantization-aware training flow for the MAX7800x family of CNN ac…
-
Spark X2.5 surpasses 2M downloads; Spark-X2.6 coming soon
Spark X2.5 has surpassed 2 million cumulative downloads across various distribution channels, with nearly half of these originating from community-made derivative builds. The project is also preparing to release Spark-X…