Google Lens Now Enables Simultaneous Image and Text Searches

At I/O 2021, Google introduced the Multitask Unified Model (MUM) to enhance its search engine capabilities. In September 2021, the company showcased how MUM allows users to search images and text simultaneously with Google Lens, promising a multisearch feature to roll out soon. Now, users in the US can participate in the beta testing of multisearch through the Google app on Android and iOS.

To try it, simply tap the Lens icon, then swipe up after taking a new photo or selecting one from your camera roll. From there, tap the “Add to your search” icon. This feature lets you ask questions about the image or refine your search further. For example, if you take a photo of your bike’s rear derailleur, you can search for guides on fixing or adjusting it, making the process easier since many casual cyclists may not know technical terms.

Additionally, you can enhance your searches for products. If you see a shirt with a desired pattern but want to find similar designs on socks or other clothing, you can type “white floral Victorian socks.” While this description requires some fashion vocabulary, it may yield better results than a purely text-based search, which can sometimes fall short.

According to Google, the multisearch feature excels especially with shopping-related inquiries. “All of this is supported by our latest advancements in artificial intelligence, making it simpler to understand the world in natural and intuitive ways," Google noted. They are also exploring how MUM could further enhance this feature, aiming to improve the relevance of search results for various user inquiries.