Google has launched AI Mode within its search engine, a significant advancement that allows users to interact with information using both visual and textual inputs. This feature integrates Google Lens with the Gemini 2.5 AI model to interpret entire image scenes, identifying objects, materials, colors, and their arrangements, aiming for a more intuitive search experience beyond traditional keywords.
AI Mode enables a new form of visual search where users can upload images or use their phone's camera to ask questions about what they see. For example, a user can photograph a book and ask for similar recommendations; AI Mode will analyze the image to suggest comparable works with purchase links. This capability extends to real-time object identification and suggestions. The feature utilizes a technique called "visual search fan-out," which runs multiple related queries in the background for a deeper understanding of an image and user intent, allowing for nuanced analysis of subtle details and secondary objects.
The system is designed to handle conversational refinements, allowing users to progressively narrow their search. For instance, a user seeking design inspiration might start with "maximalist bedroom inspiration" and refine it with "more options with dark tones and bold prints," with AI Mode maintaining the context of the original request. Beyond visual queries, AI Mode effectively handles complex textual requests, providing detailed responses and facilitating follow-up questions for deeper exploration.
AI Mode also integrates with Google's Shopping Graph, which contains over 50 billion product listings, enabling conversational shopping experiences. Users can describe desired items without traditional filters, such as asking for "barrel jeans that aren't too baggy" and further refining the search by specifying "I want more ankle length." This feature is currently available in English for users in the United States, with plans for a broader international rollout in the coming weeks.
This development underscores Google's commitment to enhancing search through AI integration and multimodal capabilities. The feature is powered by a custom version of the Gemini 2.5 model, which improves reasoning and multimodal understanding. Google's AI Mode is continuously evolving, with ongoing efforts to refine its capabilities and expand its accessibility worldwide.