Inside Google Deepmind's Sl2T: See How Ai Translates American Sign Language into Text
The physical chassis of the Pixel 11 Pro Fold plays an essential role in how this software functions during daily use. Foldable hardware allows the device to sit propped open on a table in an L-shape orientation, framing the signer through its ultra-wide inner camera. The software then renders the translated text directly onto the outward-facing display.
This hardware arrangement eliminates the clumsy dance of passing a screen back and forth. A Deaf individual can stand naturally, sign comfortably within the camera’s field of view, and let a hearing cashier, coworker, or clinician read the typed transcript without leaning over the phone. Dual microphones capture spoken English replies, transcribing them onto the inner screen using standard Live Caption software to create a functional conversation loop.
Field reports published by Notebookcheck and Tech Edition note that the system operates within a conversational lag window of roughly 140 milliseconds. At that speed, the translation reads like continuous real-time captioning. The pipeline handles common conversational speeds up to 130 signs per minute before dropping tokens, representing a massive operational leap over prior mobile prototypes.
