Google announced Thursday that it will launch new AI and accessibility features for Android and Chrome. Most notably, Talkback, the screen reader for Android, now lets you ask Gemini about what’s in the image and what’s on the screen.
Last year, Google brought Gemini's dialogue ability to make descriptions of images by blind or low-eye people, even without ALT text, using AI-generated descriptions. Now, people can ask questions and get answers about their images.
For example, if a friend texts you a new guitar, you can get a description of it and ask questions about the brand and color. Additionally, you can now get the description and ask questions about the entire phone screen. So if you shop in the app, you can ask Gemini about the materials for the items you are interested in or if there is a discount.
Google also announced today that it is updating expression subtitles, Android's live subtitles feature, which uses AI to capture what someone says and what they say.
Google says people realize that one of the ways people express themselves is to procrastinate their text sounds, which is why it develops new duration features on expression titles. Now you will know if sports announcers are calling for "Amaazing shooting," or when someone is not just saying "no" but "nooooo." You will also start to see new labels of sounds, such as when a person is whistling or clearing his throat.
The update is available in the U.S., UK, Canada and Australia for devices running Android 15 and above.
Google also makes accessing PDFs on Chrome easier. So far, you won't be able to interact with scanned PDFs in your desktop Chrome browser using the screen reader. Chrome now automatically recognizes these types of PDFs, allowing you to highlight, copy and search text like any other page, and read them using a screen reader. This is thanks to the introduction of optical role recognition (OCR), Google says.
Also, page zooming on Chrome on Android now allows you to increase the text size you see without affecting the webpage layout. You can customize the amount you want to zoom in and choose to apply preferences to all pages you visit, or just certain pages. You can access this feature by clicking the three-dot menu in the upper right corner of Chrome.