Google is rolling out Gemini’s real-time AI video features

Google has started rolling out new AI features to Gemini Live that let it “see” your screen or through your smartphone camera and answer questions about either in real-time, Google spokesperson Alex Joseph has confirmed in an email to The Verge. The features come nearly a year after Google first demonstrated the “Project Astra” work that powers them.

A Reddit user said the feature showed up on their Xiaomi phone, as spotted by 9to5Google. Today, the same user posted the video below demonstrating Gemini’s new screen-reading ability.