PulseAugur
EN
LIVE 17:11:06

Browser extensions can now run AI models locally

Browser extensions can now integrate small, on-device AI models for tasks like summarization and question answering without relying on cloud servers. Two primary methods exist: utilizing Chrome's built-in Gemini Nano model via a Prompt API for simplicity, or employing the Transformers.js library with WebGPU to run custom, user-selected models directly in the browser. While the built-in model offers ease of use and zero setup, it is limited to English and less accurate. The Transformers.js approach provides greater control over model choice and behavior but requires more development effort and a one-time download for the user. AI

IMPACT Enables more sophisticated, privacy-preserving AI features directly within web applications.

RANK_REASON Describes a new capability for browser extensions using existing or new libraries to run AI models locally.

Read on Towards AI →

AI-generated summary · Google Gemini · from 1 sources. How we write summaries →

Browser extensions can now run AI models locally

COVERAGE [1]

  1. Towards AI TIER_1 English(EN) · Yashraj Behera ·

    Yes, Your Browser Can Run Its Own Tiny AI. Here’s How

    <p><em>A browser extension that reads the page you are on, answers questions about it, and summarizes it, with no server, no API key, and no data ever leaving your machine, isn’t a fantasy anymore. In 2026 it’s a weekend project. The trick is running a very small language model d…