PulseAugur
EN
LIVE 23:00:32

Perplexity AI routes queries to PC or cloud to cut costs

Perplexity has developed an AI system capable of dynamically routing queries between a user's local device and the cloud. This hybrid approach aims to optimize inference costs by leveraging on-device processing when feasible. The company also reported reaching $500 million in annual revenue. AI

IMPACT This hybrid compute approach could set a new standard for efficient AI inference, potentially lowering costs for users and developers.

RANK_REASON The article describes a new product feature or system enhancement from an AI company, rather than a core model release or fundamental research.

Read on Mastodon — fosstodon.org →

AI-generated summary · Google Gemini · from 1 sources. How we write summaries →

COVERAGE [1]

  1. Mastodon — fosstodon.org TIER_1 English(EN) · [email protected] ·

    Perplexity has built an AI system that decides in real time whether to run queries on your PC or in the cloud, cutting inference costs as revenues hit 500M USD.

    Perplexity has built an AI system that decides in real time whether to run queries on your PC or in the cloud, cutting inference costs as revenues hit 500M USD. https:// thenextweb.com/news/perplexity -ai-split-compute-pc-cloud-inference-cost # Tech # Startup # News # AI