Google just reinvented search with scene exploration — here's how it works

Google Scene Exploration
(Image credit: Google)

About eight years ago, I reviewed the Amazon Fire Phone, a short-lived device that quickly disappeared thanks to a slow processor, low-resolution screen and short battery life. Perhaps the only interesting feature of the Fire Phone was something called Firefly, which could not only identify products, but could then also take you to Amazon so you could then purchase it. 

Google's new Scene Exploration feature seems to have taken this one idea and made it immensely more useful. Announced at Google I/O 2022, Scene Exploration will let you point your phone's camera at an object and then ask a question to help filter your results. And you can pan around while you do it to scan multiple objects in real time. 

Google Search Explore

(Image credit: Google)

For example, the presenter at Google I/O displayed a rack of candy bars, and then asked Scene Exploration to highlight ones that were highly rated, nut-free and made from dark chocolate. Scene Exploration then highlighted a few chocolate bars, along with ratings for each. And, of course, provided you a way to purchase them if you wanted.

Google said that the feature could also be used so that you could filter your selections by products from minority-owned businesses or other metrics. 

Scene Exploration looks similar to apps such as Vivino, which use machine learning to identify wine labels, and then provides ratings, tasting notes. Except with Google, it seems like you'll be able to search for anything. 

Scene Exploration is an outgrowth of Multisearch, which lets you combine both text and images when searching for something in Google. However, Scene Exploration looks like it will make it easier to find just what it is you're looking for. 

Google has not said when this feature will roll out, so look for it in the coming months.

Read next: Google has made it easier to remove personally identifiable information from search — here's how

TOPICS
Mike Prospero
U.S. Editor-in-Chief, Tom's Guide

Michael A. Prospero is the U.S. Editor-in-Chief for Tom’s Guide. He oversees all evergreen content and oversees the Homes, Smart Home, and Fitness/Wearables categories for the site. In his spare time, he also tests out the latest drones, electric scooters, and smart home gadgets, such as video doorbells. Before his tenure at Tom's Guide, he was the Reviews Editor for Laptop Magazine, a reporter at Fast Company, the Times of Trenton, and, many eons back, an intern at George magazine. He received his undergraduate degree from Boston College, where he worked on the campus newspaper The Heights, and then attended the Columbia University school of Journalism. When he’s not testing out the latest running watch, electric scooter, or skiing or training for a marathon, he’s probably using the latest sous vide machine, smoker, or pizza oven, to the delight — or chagrin — of his family.

Read more
Google Lens illustrations
Google Lens just got smarter — new iPhone feature lets you search instantly
Google Chrome app on iPhone
iPhone users just got their own version of Google’s Circle to Search — here’s how it works
Google Pixel 9 Pro in hand
The best AI phone feature I tried in 2024 isn’t from Apple or Samsung
An image showing the Samsung Galaxy S24 with the Circle to Search feature being used on screen
I tested Circle to Search’s new features for the Galaxy S25 — here’s what happened
The new Gemini app home page vs the old
Forget ChatGPT — Google Gemini can now see the world with live video and screen-sharing
A side-by-side of two phones, one with Apple Intelligence and one with Galaxy AI
The best (and worst) AI phone features in 2024
Latest in Search Engines
Google logo on the side of its HQ
Google is refusing to comply with upcoming EU fact-checking laws — what we know
Bing vs Google
Microsoft accused of making Bing look just like Google search — and Google fires back
Google search open on laptop
You can limit your Google searches to a single website — here's how
Chrome browser on phone with Chrome logo in the background
DOJ will reportedly force Google to sell Chrome — what you need to know
Google Shopping feeds on phones
Google gives Google Shopping an AI makeover — here's what's new
Google search on a phone screen
Google Search has a new trick up its sleeve — and it might save you from fake AI images
Latest in News
A first look at Amazon's Fallout TV series coming to Prime Video
‘Fallout’ season 3 plans are reportedly being made — while season 2 is still filming
Surface Laptop 7 from the front
Amazon just gave Surface Laptop 7 a 'frequently returned' label — here's what's going on
New emojis with iOS 18.4 beta release.
iOS 18.4 beta brings 8 new emoji to your iPhone — here's all the new options
23andME box
23andMe has declared bankruptcy — here's how to delete your data now
half-life alyx
Latest Half-Life 3 rumors point to a 2025 release — and maybe pigs will fly
NFL Sunday Ticket logo for YouTube
NFL Sunday Ticket 2025 pricing revealed — and it's bad news