YBX YBX logo

Google Lens Introduces Video Search: Effortlessly Explore Visual Content with New Feature

Home AI News Google Lens Introduces Video Search: Effortlessly Explore Visual Content with New Feature

Updated on November 11 2024

    If you can't find what you're searching for with just an image, Google Lens now allows you to take a video and use your voice to inquire about the visuals. This new feature launches within Search Labs on Android and iOS, offering an AI Overview and search results tailored to the video's content and your spoken question.

    Google first showcased video search at I/O in May. For instance, if you're at an aquarium and want to know why certain fish are swimming together, simply open the Google Lens app, capture a video of the exhibit, and ask, “Why are they swimming together?” Google Lens will then utilize the Gemini AI model to generate a relevant response.

    Rajan Patel, Google’s vice president of engineering, explained that the technology captures video as a series of image frames, applying advanced computer vision techniques for enhanced understanding. The custom Gemini model processes these sequences to provide answers rooted in web information.

    Although sound identification in videos is not yet supported—such as recognizing a bird call—Patel mentioned that Google is exploring this capability. Additionally, Google Lens is enhancing its photo search functionality, allowing users to ask questions via voice. To use this feature, simply point your camera at the subject, hold down the shutter button, and voice your query. Previously, questions could only be typed after taking a picture. Voice questions are rolling out globally on Android and iOS, currently available only in English.

    Google Introduces Ads in AI Search Summaries: What You Need to Know
    Gemini Live Expands AI Voice Chat to Include More Languages for Enhanced User Experience

    Most people like

    Tweetlio
    9.5K
    Discover the ultimate AI tool designed to streamline your Twitter scheduling and enhance engagement. Perfect for individuals and businesses alike, this innovative solution not only organizes your posts but also optimizes them for maximum interaction. Experience a smarter way to connect on Twitter and elevate your online presence.
    Twitter management AI Twitter Assistant
    Vectra AI
    148.6K
    Introducing our AI platform designed for real-time threat detection and response. With advanced algorithms and machine learning capabilities, it swiftly identifies potential security threats and enables rapid responses. Stay ahead of cyber threats and protect your digital assets effectively with our cutting-edge technology.
    Cybersecurity AI Analytics Assistant
    Help.center
    45.5K
    Help.Center is an AI-driven customer support platform that offers interactive chat features and a comprehensive knowledge base, designed to enhance user experience and streamline assistance.
    AI customer support Large Language Models (LLMs)
    WhisperUI
    28.4K
    Discover an affordable text-to-speech and speech-to-text service that transforms written content into lifelike audio and converts spoken words into accurate text. Perfect for businesses, educators, and individuals alike, our innovative solution enhances accessibility and efficiency. Whether you need to create audio for presentations or transcribe meetings, our versatile service caters to all your transcription and voice synthesis needs. Experience seamless communication and improved productivity today!
    text-to-speech AI Speech Recognition

    Find AI tools in YBX

    Related Articles
    Meta Launches AI Characters in US Apps: Enhanced Support for Bing Search and Improved Memory Features
    Meta Launches AI Characters in US Apps: Enhanced Support for Bing Search and Improved Memory Features

    Earlier this year, Meta unveiled a captivating lineup of AI characters inspired by real-life celebrities such as Paris Hilton, MrBeast, Kendall Jenner, Tom Brady, Charli D’Amelio, Snoop Dog, and more. Today, the company announced that all 28 AI characters are now fully deployed across the U.S., enabling users to engage with them via WhatsApp, Messenger, and Instagram. Additionally, Meta revealed that more of its AI characters will soon support Bing-powered search features, while also beginning to experiment with “long-term memory.” This advancement means that the characters will be capable of remembering your conversations, creating a more personalized and engaging experience.

    "Voyage AI Enhances Snowflake’s Cortex AI with Multilingual Embeddings for Superior Enterprise RAG"
    "Voyage AI Enhances Snowflake’s Cortex AI with Multilingual Embeddings for Superior Enterprise RAG"

    Voyage AI has secured $20 million in Series A funding to enhance its embedding and retrieval models for enterprise Retrieval Augmented Generation (RAG). Supported by Snowflake, its multilingual model improves accuracy in various fields and utilizes contrastive learning for better training on unlabelled data.

    Is AI Intelligent Enough to Be Kind? Discover the Surprising Answer!
    Is AI Intelligent Enough to Be Kind? Discover the Surprising Answer!

    The rapid evolution of AI poses challenges in copyright, privacy, and ethics, prompting tech companies and governments to adopt responsible, human-centered solutions. The concept of Human-Centered AI (HCAI) prioritizes enhancing user agency and control, balancing automation with oversight to address societal needs effectively.

    Refresh Articles