PulseAugur
EN
LIVE 06:40:21

On-device omni-modal search engine developed for Apple Silicon Macs

Researchers have developed omni-macos, a novel on-device omni-modal search engine designed to run entirely on Apple Silicon Macs. This system integrates text, code, documents, images, audio, and video into a unified representation space, with all processing and indexing occurring locally on the user's machine. To optimize performance within a limited memory budget, omni-macos employs several mechanisms, including incremental re-encoding of changed file chunks, efficient GPU utilization during user input, and the use of a quantized replica for faster query responses with exact rescoring. AI

IMPACT Enables powerful, private, and efficient multi-modal search directly on user devices, potentially reducing reliance on cloud infrastructure for such tasks.

RANK_REASON The cluster describes a research paper detailing a novel system for on-device search. [lever_c_demoted from research: ic=1 ai=1.0]

Read on arXiv cs.IR (Information Retrieval) →

AI-generated summary · Google Gemini · from 1 sources. How we write summaries →

On-device omni-modal search engine developed for Apple Silicon Macs

COVERAGE [1]

  1. arXiv cs.IR (Information Retrieval) TIER_1 Română(RO) · Han Xiao ·

    omni-macos: On-Device Omni-Modal Search on Apple Silicon

    A search engine that embeds text, code, documents, images, audio and video into the same representation space has to run its encoder and keep its index somewhere, and almost every component built for the purpose assumes a server. We present omni-macos, which runs its encoder, ind…