With the Pixel 10 series and Pixel Watch 4, Google is announcing the latest Gemini app features.
When using camera sharing in Gemini Live, the viewfinder can now highlight real-world objects to provide direct guidance. This white rounded rectangle is helpful if you’re looking for something in a scene and is like the Project Astra demo at I/O 2025 in May. Google says “real-time visual cues create a powerful new way to learn and solve problems together.”
Can’t decide between two pairs of sneakers? Gemini can see them both and highlight the one that best matches the outfit you’re envisioning. Or maybe you’re trying to figure out the correct tool to use. Point your camera at your tool box, and Gemini can point out the right one.
Visual guidance is launching on the Pixel 10, and will come to other Android devices starting next week. It will be available on iOS in the “coming weeks.”
In addition to Google Calendar, Keep, and Tasks, Gemini Live will “soon” be able to access Messages, Phone, and Clock, while the Google Maps integration is getting “additional capabilities.”
Meanwhile, Gemini Live in the “coming weeks” will use a native audio model that can detect if you’re excited or concerned and adjust its response accordingly for a more engaging experience. It’s a step beyond the current text-to-speech approach. Google says this will “dramatically improve how Gemini Live uses the key elements of human speech, like intonation, rhythm and pitch, allowing for a more responsive and expressive conversation.”
- Experience more natural and intuitive interactions. Gemini will respond more appropriately to what you say. If you’re talking about a stressful topic, it might respond with a calmer, more measured voice.
- Control how Gemini speaks. You’ll be able to ask Gemini to speak more slowly if you’re taking notes, faster if you’re in a hurry or even in a fun accent to liven things up.
- Enjoy dramatic storytelling. Ask Gemini to tell you about the Roman empire from the perspective of Julius Caesar himself, and get a rich, engaging narrative complete with character accents.
The Pixel 10 Pro, 10 Pro XL, and 10 Pro Fold comes with one year of Google AI Pro for broader access to the Gemini app like video generation.
Meanwhile, the latest version of Gemini Nano powers on-device AI features like Magic Cue, Voice Translate, Pixel Journal, and much more.
Today, you can launch Gemini on Wear OS with the “Hey Google” hotword, long-press of the side button, and tapping the watch face complication or Tile. The new gesture lets you just raise your wrist and start talking. This even works if you have disabled tilt-to-wake.
The Gemini glow will appear at the bottom of your watch face.
FTC: We use income earning auto affiliate links. More.
Comments