Hey Gemini, what’s this?: Google’s AI just got a lot more human

A few nights ago, while fumbling through my overstuffed closet, I mumbled to myself, “I wish someone could just tell me what to wear.” I wasn’t looking for a fashionista, just someone – or something – that could glance at my wardrobe and give me a nudge in the right direction. That “someone” might now be Gemini.

Google is officially rolling out two of Gemini’s most exciting features yet – Live Video and Screen Sharing – bringing the AI assistant closer to the Jetsons-style future we’ve been daydreaming about. First teased at Google I/O 2024 and later previewed at MWC 2025, these features were developed by Google DeepMind under its ambitious Project Astra initiative.

ALSO READ: Project Astra is a new AI-powered virtual assistant that learns about world around you, with you

What’s new with Gemini?

Until now, interacting with Gemini was like chatting with a very smart friend who just happened to be stuck inside your screen. But now, Gemini can use your phone’s camera feed to see what you’re looking at and respond in real time. Wondering what kind of plant is in your neighbour’s garden? Or whether those leftovers in your fridge are still edible? Just point and ask.

On the other side of things, the screen-sharing feature lets Gemini offer help as you navigate your phone – whether you’re setting up a new app, comparing prices while online shopping, or trying to change a setting hidden deep in your phone’s menus. It’s like having a tech-savvy friend looking over your shoulder.

These upgrades are part of Gemini Live, which already supports two-way voice conversations, making the AI feel even more conversational and, dare we say, human.

Who gets access to Live Video and Screen Sharing on Gemini?

Here’s the catch: these features are currently limited to Gemini Advanced subscribers. That means you’ll need to sign up for the Google One AI Premium Plan, which is priced at Rs 1,950 per month in India.

No word yet on when, or if, these tools will become available to non-paying users. But judging by the buzz, especially on Reddit, where early users have posted demos and screenshots, it’s clear that people are eager to try it.

One Reddit user, Kien_PS, shared a screenshot of the new “Share-screen with live” feature, followed by a short demo video showing Gemini navigating live screens and responding in real time. The Verge also confirmed the rollout in a statement from Google spokesperson Alex Joseph.

What can you do with it?

The possibilities are as wide as your imagination. Want outfit suggestions? Just show Gemini your wardrobe. Need to identify a landmark while traveling? Turn on the camera and ask. Trying to troubleshoot a settings issue or find a feature on your phone? Share your screen and let Gemini guide you.

The screen-sharing feature is essentially a smarter version of the old “Talk about the screen” tool – only now, it works across your entire smartphone and in real time.

ALSO READ: Google’s new Gemini AI models could teach robots to think and act like us

Think of it like a personal assistant that not only listens but also sees and interacts – almost like Google’s answer to Jarvis, minus the Iron Man suit.