Carnegie-Mellon University

Not only do we not always say what we mean, often we don't say anything at all. Which can be a terrific problem if you're thinking of hanging around service robots, or self-driving vehicles.

But at Carnegie-Mellon, a team led by Yaser Sheikh, a professor of robotics, has classified gestures across the human body. Using a dome containing 500 video cameras, they took account of every movement, down to the possibly tell-tale wiggle of your fingers.

The objective: Sheikh's effort gets at a couple of realities going forward:

  • If we are going to be living and working in proximity with robots, they are going to have to start understanding our non-verbal communications.
  • And self-driving cars need a head's up as to our intentions while we are standing or walking down the street.

But Sheikh is not quite there yet: Hanbyul Joo, one of Sheikh's post-docs, tells Axios that while the gestures are all catalogued, other experts need to now step in and define what they mean, which is a big challenge since "even humans can't define their motions."

Go deeper

Updated 2 hours ago - Politics & Policy

Coronavirus dashboard

Illustration: Sarah Grillo/Axios

  1. Global: Total confirmed cases as of 12:45 p.m. ET: 30,838,610 — Total deaths: 958,090— Total recoveries: 21,088,552Map.
  2. U.S.: Total confirmed cases as of 12:45 p.m. ET: 6,777,026 — Total deaths: 199,352 — Total recoveries: 2,577,446 — Total tests: 94,211,463Map.
  3. Politics: Testing czar on Trump's CDC contradictions: "Everybody is right" Trump's health secretary asserts control over all new rules.
  4. Education: What we overlooked in the switch to remote learning
  5. Health: The dwindling chances of eliminating COVID-19.
  6. World: Guatemalan president tests positive for COVID-19 — The countries painting their pandemic recoveries green.
Updated 2 hours ago - Health

7 states set single-day coronavirus case records last week

Data: Compiled by Axios; Map: Danielle Alberti/Axios

Seven states set new highs last week for coronavirus infections recorded in a single day, according to the COVID Tracking Project and state health departments. Wisconsin and Nebraska surpassed records set the previous week.

Why it matters: Problem spots are sticking in the Midwest, although the U.S. is moving in the right direction overall after massive infection spikes this summer.

Murkowski says she opposes voting on Ginsburg replacement before election

Photo: Greg Nash/Pool/Getty Images

Sen. Lisa Murkowski (R-Alaska) said in a statement Sunday that she opposes holding a Senate confirmation vote on President Trump's nomination to replace Supreme Court Justice Ruth Bader Ginsburg before the election.

Why it matters: Murkowski joins Sen. Susan Collins (R-Maine) as one of two Republican senators who have thus far said that they do not support rushing through a confirmation vote before November. Two more defections would likely force Senate Majority Leader Mitch McConnell (R-Ky.) to resort to holding a vote in the lame-duck session, which neither Murkowski nor Collins have addressed.