Facebook Leverages First-Person Videos to Train Next-Generation AIs

Home AI News Facebook Leverages First-Person Videos to Train Next-Generation AIs

Updated on October 13 2021

One of the primary objectives of computer vision projects is to enable machines to perceive the world like humans do. Facebook is addressing this challenge with its new initiative, Ego4D, which involves a comprehensive dataset designed to train future AI models.

Facebook has partnered with 13 universities across nine countries to gather 2,200 hours of footage from 700 participants. This footage captures experiences from the user’s perspective, making it invaluable for developing AI systems that understand human behavior. According to Kristen Grauman, Facebook’s lead research scientist, this collection represents the largest dataset specifically focused on this goal.

The footage highlights a variety of everyday human experiences, such as social interactions, hand movements, and object manipulation, as well as predicting future events. This marks a significant shift for the social network, which has typically relied on data collected from an observer's perspective.

In November, Facebook plans to release these datasets to researchers who agree to the Ego4D data use agreement. Next year, broader research communities will be invited to further train machines to comprehend human activities and interactions.

While this initiative has the potential to enhance machine learning capabilities, it raises concerns about privacy and surveillance, especially given Facebook's partnership with Ray-Ban on camera glasses. These developments underscore the need for careful consideration of the implications of such technology in our daily lives.

Adobe's Project In-Between: Harnessing AI to Transform Images into 'Living Photos'

Google Deploys AI to Optimize Traffic Lights and Cut Pollution Levels

Most people like

Pump

40.6K

Maximize your cloud savings by up to 60% with Pump—an innovative AI-powered platform designed to optimize your AWS costs.

AI-driven AI Advertising Assistant

Video Analytics powered by AI - Ipsotek Ltd

35.6K

Introducing a leading provider of AI-powered video analytics solutions, dedicated to transforming visual data into actionable insights. Our innovative technology harnesses advanced algorithms to enhance security, optimize operations, and drive informed decision-making. Join us in redefining how businesses leverage video data for improved efficiency and safety in today’s fast-paced environment.

AI-powered Video Analytics Other

Wingfield

19.4K

Are you ready to elevate your tennis game from the comfort of your home? Our innovative virtual tennis experience combines cutting-edge technology with realistic gameplay, allowing you to immerse yourself in the sport you love. Whether you're a beginner looking to learn the basics or an advanced player honing your skills, this interactive platform offers tailored training sessions, competitive matches, and engaging challenges designed for all levels. Join a vibrant community of tennis enthusiasts and transform your game today!

Virtual tennis Sports

Playground AI

399.3K

Unleash your creativity with Playground AI's free online AI image creator! Design stunning art, engaging posts, professional presentations, unique logos, and much more effortlessly. Explore the power of AI and elevate your projects today!

image generator AI Art Generator

Find AI tools in YBX