Google Gemini Live levels up; it’s learning to point, highlight, and talk like you

Google isn’t just making Gemini Live a sharper talker; it’s teaching it to show you exactly what it means. Starting next week, Google’s AI assistant will get an update that will allow it to highlight objects directly on your screen through the camera. All in real-time.

Imagine standing over a cluttered toolbox and asking for help about which tool to use. Gemini can put a neat box around the exact wrench you’re looking for. The new visual guidance feature launches with the Pixel 10 series on August 28, followed by a wider Android release and iOS support ‘in the coming weeks’.

Gemini also dives deeper into your daily apps

What makes this update stand out is how Gemini Live is beginning to work inside the apps you already use. Instead of bouncing between screens, you’ll be able to keep things flowing in one place.

While navigating with Gemini on Google Maps, if you realise you’ll be late, you can simply say, “This route works. Send Manish a text that I’m running 10 minutes late.” Gemini drafts and sends the message, so you don’t have to stop what you’re doing. Phone calls and alarms are also in the mix, turning the assistant into more of a hands-on operator than just a voice that answers questions.

There’s also attention on how Gemini sounds. Google has built a new audio model that pays closer attention to rhythm, pitch, and tone. The assistant can soften its delivery if you’re under pressure, pick up the pace when you’re short on time, or even switch into character if you want something lighthearted, like a Shakespearean version of last night’s cricket highlights.

ALSO READ: Google Pixel 10 series: 8 new AI features that make them Google’s smartest phones yet

The bigger picture is that Google wants Gemini Live to feel like a co-pilot; one that doesn’t just listen, but acts, adapts, and fits naturally into your day. With visual cues, cross-app actions, and a more human voice, Gemini is edging toward a role where it’s less of a chatbot and more of a steady presence in how you use your phone.