Google DeepMind introduced SL2T, a multilingual sign-language-to-text AI model integrated into Gboard and Live Transcribe on Pixel 11.

Key Details

• SL2T is trained on over 100,000 hours of data across more than 50 sign languages
• Powers sign-to-text dictation in Gboard and Live Transcribe starting with ASL to English on Pixel 11
• Uses on-device MediaPipe Holistic landmark tracking for privacy-preserving pose estimation
• Achieved a zero-shot score of 70 BLEURT on the FLEURS-ASL benchmark

In This Story