Sign up for our daily briefing

Make your busy days simpler with Axios AM/PM. Catch up on what's new and why it matters in just 5 minutes.

Please enter a valid email.

Please enter a valid email.

Subscription failed
Thank you for subscribing!

Catch up on the day's biggest business stories

Subscribe to Axios Closer for insights into the day’s business news and trends and why they matter

Please enter a valid email.

Please enter a valid email.

Subscription failed
Thank you for subscribing!

Stay on top of the latest market trends

Subscribe to Axios Markets for the latest market trends and economic insights. Sign up for free.

Please enter a valid email.

Please enter a valid email.

Subscription failed
Thank you for subscribing!

Sports news worthy of your time

Binge on the stats and stories that drive the sports world with Axios Sports. Sign up for free.

Please enter a valid email.

Please enter a valid email.

Subscription failed
Thank you for subscribing!

Tech news worthy of your time

Get our smart take on technology from the Valley and D.C. with Axios Login. Sign up for free.

Please enter a valid email.

Please enter a valid email.

Subscription failed
Thank you for subscribing!

Get the inside stories

Get an insider's guide to the new White House with Axios Sneak Peek. Sign up for free.

Please enter a valid email.

Please enter a valid email.

Subscription failed
Thank you for subscribing!

Catch up on coronavirus stories and special reports, curated by Mike Allen everyday

Catch up on coronavirus stories and special reports, curated by Mike Allen everyday

Please enter a valid email.

Please enter a valid email.

Subscription failed
Thank you for subscribing!

Want a daily digest of the top Denver news?

Get a daily digest of the most important stories affecting your hometown with Axios Denver

Please enter a valid email.

Please enter a valid email.

Subscription failed
Thank you for subscribing!

Want a daily digest of the top Des Moines news?

Get a daily digest of the most important stories affecting your hometown with Axios Des Moines

Please enter a valid email.

Please enter a valid email.

Subscription failed
Thank you for subscribing!

Want a daily digest of the top Twin Cities news?

Get a daily digest of the most important stories affecting your hometown with Axios Twin Cities

Please enter a valid email.

Please enter a valid email.

Subscription failed
Thank you for subscribing!

Want a daily digest of the top Tampa Bay news?

Get a daily digest of the most important stories affecting your hometown with Axios Tampa Bay

Please enter a valid email.

Please enter a valid email.

Subscription failed
Thank you for subscribing!

Want a daily digest of the top Charlotte news?

Get a daily digest of the most important stories affecting your hometown with Axios Charlotte

Please enter a valid email.

Please enter a valid email.

Subscription failed
Thank you for subscribing!

Want a daily digest of the top Nashville news?

Get a daily digest of the most important stories affecting your hometown with the Axios Nashville newsletter.

Please enter a valid email.

Please enter a valid email.

Subscription failed
Thank you for subscribing!

Want a daily digest of the top Columbus news?

Get a daily digest of the most important stories affecting your hometown with the Axios Columbus newsletter.

Please enter a valid email.

Please enter a valid email.

Subscription failed
Thank you for subscribing!

Want a daily digest of the top Dallas news?

Get a daily digest of the most important stories affecting your hometown with the Axios Dallas newsletter.

Please enter a valid email.

Please enter a valid email.

Subscription failed
Thank you for subscribing!

Sign up for Axios NW Arkansas

Stay up-to-date on the most important and interesting stories affecting NW Arkansas, authored by local reporters

Please enter a valid email.

Please enter a valid email.

Subscription failed
Thank you for subscribing!

Please enter a valid email.

Please enter a valid email.

Subscription failed
Thank you for subscribing!

Illustration: Aïda Amer/Axios

Facebook is announcing a new machine learning project that aims to teach AI how to understand and interact with the world through a first-person perspective.

Why it matters: Most computer vision is trained on images and videos taken from a third-person perspective, but to build AI assistants and robots that can work with us in the real world, researchers will need to compile data sets built on what is known as egocentric perception.

What's happening: Facebook AI's Ego4D project involves a consortium of researchers from 13 universities and labs in nine countries who used academic gifts from the company to collect more than 2,200 hours of first-person video recorded in the real world with head-mounted cameras and other wearables.

  • That data was supplemented by an additional 400 hours of first-person video captured by Facebook Reality Labs Research using test subjects wearing augmented reality (AR) smart glasses in staged environments.
  • The resulting data is more than 20 times larger than any other existing egocentric dataset in terms of hours of footage, and will be made publicly available in November to researchers who agree to Ego4D's data use agreement.

What they're saying: "Down the line this will allow AI systems to help you in ways that are really in the moment, contextual with what you're doing and what you've seen before, all in ways you just can't do now," says Kristen Grauman, a research scientist at Facebook AI.

Between the lines: As part of Ego4D, Facebook AI is establishing five benchmarks that researchers will be able to use to build and test egocentric AI models that use the project's data set.

  • These involve episodic memory (the ability to know what happened in the real world and when), forecasting, hand-object interaction, audio-visual diarization, and social interaction.
  • Put it all together, and you could eventually build AI assistants — perhaps tied to smart glasses like the kind Facebook and Ray-Ban recently put out — that could observe your actions and offer reminders or assistance tied to real world tasks.
  • "Maybe you're cooking a dish, and [the AI] can anticipate that you're going to end up needing key ingredients, and remember where they physically are," says Grauman.

The bottom line: It's not hard to see how building first-person, egocentric AI models will dovetail with Facebook's move into the AR and VR spaces.

Go deeper

Oct 15, 2021 - Technology

Sen. Kelly: U.S. must develop new military tech to prevent future conflicts

Developing new military technologies, such as artificial intelligence and machine learning, will be necessary to prevent a war with China or other adversaries, Sen. Mark Kelly (D-Ariz.) said at an Axios event Friday.

Why it matters: With the war on terror ramping down and competition with China increasing, Kelly said it's time for the U.S. to adapt its military technology to address threats in the western Pacific, specifically China.

Biden: "Being a cop today is one hell of a lot harder than it's ever been"

President Biden speaks during the 40th Annual National Peace Officers Memorial Service at the U.S Capitolon Oct. 16. Photo: Brendan Smialowski/AFP via Getty Images

President Biden speaking at the U.S. Capitol on Saturday honored members of law enforcement who died in the line of duty in 2019 and 2021 and saluted those who are currently serving.

Driving the news: "We expect everything of you, and it's beyond the capacity of anyone to meet the total expectations. Being a cop today is one hell of a lot harder than it's ever been," Biden said.

Updated 5 hours ago - World

Islamic State claims responsibility for deadly bombing in southern Afghanistan

The mosque after the explosion in southern Kandahar province on Oct. 15. Photo: Murteza Khaliqi/Anadolu Agency via Getty Images

The Islamic State group claimed responsibility for a massive blast that tore through a crowded Shiite mosque in the southern Afghan city of Kandahar on Friday, killing at least 47 people and injuring dozens more, AP reports.

Why it matters: Friday's attack was the deadliest to strike Afghanistan since the U.S. withdrew its troops from the region and is the second major attack on a Shiite mosque in a week, underscoring the Taliban's growing security threat from other militant groups.