Sign up for our daily briefing

Make your busy days simpler with Axios AM/PM. Catch up on what's new and why it matters in just 5 minutes.

Please enter a valid email.

Please enter a valid email.

Subscription failed
Thank you for subscribing!

Catch up on the day's biggest business stories

Subscribe to Axios Closer for insights into the day’s business news and trends and why they matter

Please enter a valid email.

Please enter a valid email.

Subscription failed
Thank you for subscribing!

Stay on top of the latest market trends

Subscribe to Axios Markets for the latest market trends and economic insights. Sign up for free.

Please enter a valid email.

Please enter a valid email.

Subscription failed
Thank you for subscribing!

Sports news worthy of your time

Binge on the stats and stories that drive the sports world with Axios Sports. Sign up for free.

Please enter a valid email.

Please enter a valid email.

Subscription failed
Thank you for subscribing!

Tech news worthy of your time

Get our smart take on technology from the Valley and D.C. with Axios Login. Sign up for free.

Please enter a valid email.

Please enter a valid email.

Subscription failed
Thank you for subscribing!

Get the inside stories

Get an insider's guide to the new White House with Axios Sneak Peek. Sign up for free.

Please enter a valid email.

Please enter a valid email.

Subscription failed
Thank you for subscribing!

Catch up on coronavirus stories and special reports, curated by Mike Allen everyday

Catch up on coronavirus stories and special reports, curated by Mike Allen everyday

Please enter a valid email.

Please enter a valid email.

Subscription failed
Thank you for subscribing!

Want a daily digest of the top Denver news?

Get a daily digest of the most important stories affecting your hometown with Axios Denver

Please enter a valid email.

Please enter a valid email.

Subscription failed
Thank you for subscribing!

Want a daily digest of the top Des Moines news?

Get a daily digest of the most important stories affecting your hometown with Axios Des Moines

Please enter a valid email.

Please enter a valid email.

Subscription failed
Thank you for subscribing!

Want a daily digest of the top Twin Cities news?

Get a daily digest of the most important stories affecting your hometown with Axios Twin Cities

Please enter a valid email.

Please enter a valid email.

Subscription failed
Thank you for subscribing!

Want a daily digest of the top Tampa Bay news?

Get a daily digest of the most important stories affecting your hometown with Axios Tampa Bay

Please enter a valid email.

Please enter a valid email.

Subscription failed
Thank you for subscribing!

Want a daily digest of the top Charlotte news?

Get a daily digest of the most important stories affecting your hometown with Axios Charlotte

Please enter a valid email.

Please enter a valid email.

Subscription failed
Thank you for subscribing!

Sign up for Axios NW Arkansas

Stay up-to-date on the most important and interesting stories affecting NW Arkansas, authored by local reporters

Please enter a valid email.

Please enter a valid email.

Subscription failed
Thank you for subscribing!

Please enter a valid email.

Please enter a valid email.

Subscription failed
Thank you for subscribing!

Illustration: Sarah Grillo/Axios

Machine vision is a crucial missing link holding back the robotization of industries like manufacturing and shipping. But even as that field advances rapidly, there's a larger hurdle that still blocks widespread automation — machine understanding.

Why it matters: Up against a shortage of workers, those sectors stand to benefit hugely from automation. But the people working in warehouses and factories could find their jobs changed or eliminated if vision technology sees new breakthroughs.

The big picture: Machine vision can help robots navigate spaces previously closed off to them, like a crowded warehouse floor or a cluttered front lawn. And it's critical for tasks that require dexterity, like packing a box with oddly shaped objects.

  • Plus, AI can help make sense of the avalanche of video footage recorded daily, which far outstrips humanity's ability to digest it.
  • Companies are scrambling to make use of that data to understand how people and vehicles move, or to check for tiny imperfections in new products.
  • The rise of AI-monitored cameras is also making surveillance inescapable at work and in public spaces.

Driving the news: In a report first shared with Axios, LDV Capital, a venture firm that invests in visual technologies, predicts an upheaval in manufacturing and logistics, driven primarily by computer vision.

  • "The majority of global factories, ports, and warehouses are understaffed and ill-equipped to meet still-rising requirements," the report reads. Visual technologies will help change that, LDV argues.
  • In China, some "lights-off" factories have been built to operate without a single human present. But the U.S. will largely see robots employed in factories and warehouses not custom-built for robots, says Abby Hunter-Syed, VP of operations at LDV.

Yes, but: It'll take more than just high-fidelity cameras and fast AI perception to make an intelligent robot.

  • A big unsolved challenge is imbuing robots with a deeper understanding of the world around them, so that they can interpret what they see and react to it.
  • "Domestic robots, for example, are just not going to arrive until machines can interpret scenes well," says Gary Marcus, co-founder of robotics company Robust.ai. "You can do Roomba, but not Rosie the Robot."

A broad understanding of the world helps us humans avoid confounding errors when we look around.

  • Even if we see a cloud perfectly shaped like a horse, we never actually think it's a flying horse because we get how clouds work.
  • The same ability helps us handle objects easily — even ones we've never seen before. Humans can generally guess how to place an item on a surface so that it stays upright, for example, rather than tipping over.
  • "We've built physics models in our heads, and we've not quite been able to transfer them to robots," says Avideh Zakhor, a Berkeley professor who studies computer vision.

The big question: How much of the problem is solvable with incremental improvements in machine vision, before robots need better common sense?

  • Evan Nisselson, a partner at LDV, argues that industry can get 85% or 90% of the way toward lucrative automation with better machine vision.
  • But that depends on how much warehouses and factories can remove variability and chaos from the areas where robots are working.

The bottom line: "The Rubicon here, which we haven't crossed yet, is to not just be able to see objects," says Marcus. "It's interpreting scenes that will be the breakthrough."

Go deeper

DHS temporarily suspends use of horse patrol in Del Rio

U.S. Border Patrol agents watch as Haitian immigrant families cross the Rio Grande from Mexico into Del Rio, Texas on Sept. 23, 2021. Photo: John Moore/Getty Images

The Department of Homeland Security on Thursday temporarily suspended the use of horse patrol in Del Rio, Texas a DHS spokesperson confirmed.

Why it matters: The suspension comes after images showing border patrol agents whipping at and charging their horses at migrants surfaced earlier in the week, prompting widespread criticism of the Biden administration's handling of the crisis at the border.

Southwest drought is worst on record, NOAA finds

In a stark new report, a team of NOAA and independent researchers found the 2020-2021 drought across the Southwest is the worst in the instrumental record, which dates to 1895.

Why it matters: They also concluded that global warming is making it far more severe, primarily by increasing average temperatures, which boosts evaporation.

2 hours ago - World

Taliban: Executions and strict punishments will return

Taliban fighters in Kabul. Photo: Oliver Weiken/picture alliance via Getty Images

Strict punishments such as hand amputations and executions will return in Afghanistan, one of the Taliban's founders said in an interview with the Associated Press.

Why it matters: Despite attempting to project a new image, the Taliban remain committed to a hard-line, conservative ideology, including harsh ruling tactics.