Google has enhanced its Gemini for Mac application by allowing users to activate the AI chatbot by simply long-pressing the 'fn' key. This new feature enables users to dictate text, have Gemini transcribe spoken words with "ums" and "ahs" removed, or perform tasks based on on-screen content. If screen-aware reasoning is enabled, Gemini can interact with open applications and local files to execute complex commands, such as summarizing PDFs or drafting emails from notes. The update also includes image generation capabilities through voice commands or by referencing on-screen ideas, building upon the app's earlier integration of the Spark agentic AI. AI
IMPACT Enhances user interaction with AI chatbots on macOS, potentially increasing adoption of voice-based commands and AI-assisted task completion.
RANK_REASON This is a feature update to an existing product, not a new frontier model release or significant industry event.
Read on Mastodon — sigmoid.social →
AI-generated summary · Google Gemini · from 4 sources. How we write summaries →