PulseAugur
EN
LIVE 15:13:24

Google DeepMind launches SL2T AI for ASL-to-text on Android phones

By PulseAugur Editorial · [4 sources] ·

Google DeepMind has developed SL2T, a sign language-to-text model designed to assist Deaf and hard-of-hearing users on Android devices. This new technology enables American Sign Language (ASL) input directly into Gboard and Live Transcribe on Pixel 11 phones, translating hand, body, and facial movements into text. The development involved close collaboration with the Deaf community, including Deaf Googlers and an AI Sign Language Advisory Committee, to overcome previous technical challenges and misconceptions in sign language AI. AI

IMPACT Enhances accessibility on mobile devices by enabling direct sign language input for communication and transcription.

RANK_REASON This is a product launch for a specific application of AI, not a frontier model release or significant industry shift.

Read on X — Google DeepMind →

AI-generated summary · Google Gemini · from 4 sources. How we write summaries →

Google DeepMind launches SL2T AI for ASL-to-text on Android phones

COVERAGE [4]

  1. X — Google DeepMind TIER_1 English(EN) · GoogleDeepMind ·

    We built SL2T with the Deaf community - guided by Deaf Googlers and our AI Sign Language Advisory Committee.

    We built SL2T with the Deaf community - guided by Deaf Googlers and our AI Sign Language Advisory Committee. Bringing ASL input to phones is just the beginning and we’re working to expand this technology to more sign languages and applications. Find out more → https://t.co/jwN…

  2. X — Google DeepMind TIER_1 English(EN) · GoogleDeepMind ·

    SL2T is state-of-the-art on academic benchmarks, plus it's optimized for real-world use like one-handed signing while holding a phone.

    SL2T is state-of-the-art on academic benchmarks, plus it's optimized for real-world use like one-handed signing while holding a phone. To protect privacy, it tracks body poses on-device, while our servers translate them into text. https://t.co/6AkxT6mO3D

  3. X — Google DeepMind TIER_1 English(EN) · GoogleDeepMind ·

    For years, building AI for sign language has been slow due to complex technical challenges and misconceptions about how the languages work.

    For years, building AI for sign language has been slow due to complex technical challenges and misconceptions about how the languages work. We addressed this by training a model to translate simultaneous movements of the hands, body, and face directly into text, using huge

  4. X — Google DeepMind TIER_1 English(EN) · GoogleDeepMind ·

    SL2T is our breakthrough sign language-to-text model powering new features for Deaf and hard of hearing users on @Android.

    SL2T is our breakthrough sign language-to-text model powering new features for Deaf and hard of hearing users on @Android. Starting with American Sign Language-to-English on Pixel 11, people can sign directly into Gboard and Live Transcribe instead of typing. https://t.co/p9Vx7t…

RELATED ENTITIES

RELATED TOPICS