Of all the features that Google’s much-anticipated Gemini AI offers, one of the most exciting has been screen sharing and camera access for brainstorming and object identification. Previously that had been for Pixel devices only, but today Google announced that the feature is coming to all Android users for free via the Gemini app.
Our team tested out the camera abilities of Gemini and found them “shocking” — you can point your camera at an object or scene, enable Gemini to access your camera, then get information about what you’re looking at from your assistant. Point your camera at a painting, and Gemini will tell you about it via text or voice. Show it a page from a book and it’ll recognize the text and tell give you an overview of the book’s key points. Snap a photo of a sketch you’ve created, and it’ll help with guidance and advice.
You can also share with Gemini whatever is currently on your screen, such as an app or website, and ask it for help like summarizing a passage, brainstorming an idea, or providing more research on a topic. When you are in the Gemini app, there’s a “Share screen with Live” button which enables the screen sharing, and then you can interact with Gemini about whatever is on your screen or in front of your camera.
This is one of Gemini’s killer features, and Pixel users have been experimenting with it and reporting impressive results. It was initially rumored that Google might share the feature beyond those on Pixel devices, but that was confirmed officially today.
“We’ve been hearing great feedback on Gemini Live with camera and screen share, so we decided to bring it to more people,” Google wrote on X. “Starting today and over the coming weeks, we’re rolling it out to all @Android users with the Gemini app. Enjoy!”
Previously, if you wanted to use Gemini you needed a Gemini Advanced subscription, which comes as part of the $20/month Google One AI Premium plan. Now, though, Google has confirmed to 9to5Google that a subscription is no long required, so it will be available for free to all Android users.
Georgina has been the space writer at Digital Trends space writer for six years, covering human space exploration, planetary…
Gemini in Google Maps now lets you plan a vacation from screenshots
How often do you take screenshots of exciting destinations from travel blogs and TikTok videos but forget about them entirely when you’re planning your next vacation? Don’t fuss if the answer is “plenty.” The increasing information overload leaves little room for memories of a fascinating spot in another random part of the world. Thankfully, the new Gemini AI features in Google Maps can do just that, so your interesting saves don’t go buried under the myriad screenshots on your phone.
After recently receiving Gemini’s superpowers to assist you in discovering places, Google Maps is gaining the ability to look through your screenshots to help you plan travels. The Maps app is getting a new “screenshot list” feature that will identify text from your screenshots and open up details on Google Maps. Google’s blog post also says you can save useful places in a list, which can be shared with others who might be traveling with you.
Read more
With Google Gemini, Android Auto could make your drive safer, more enjoyable
Google is in the process of rolling out Android Auto 14.0 to the public. While the update doesn’t include any new features, it suggests a significant change is coming.
As 9to5Google explains, the update hints that Gemini is set to replace Google Assistant in Android Auto. Behind the scenes, there are also image assets for Gemini and Gemini Live.
Read more
Google Gemini’s image toolset might add important new feature
Google Gemini is constantly enhancing its features. One area that may see improvements soon is the ability to import images. Currently, Gemini allows users to import only one image or file at a time when providing context for search queries. If users try to add another file, they are prompted to replace the existing one instead of being able to upload multiple files.
According to Android Authority, Google is working on an upgrade to this functionality. Soon, users might be able to upload multiple images to Gemini simultaneously.
Read more