Sign up for our daily briefing

Make your busy days simpler with Axios AM/PM. Catch up on what's new and why it matters in just 5 minutes.

Please enter a valid email.

Please enter a valid email.

Subscription failed
Thank you for subscribing!

Catch up on coronavirus stories and special reports, curated by Mike Allen everyday

Catch up on coronavirus stories and special reports, curated by Mike Allen everyday

Please enter a valid email.

Please enter a valid email.

Subscription failed
Thank you for subscribing!

Denver news in your inbox

Catch up on the most important stories affecting your hometown with Axios Denver

Please enter a valid email.

Please enter a valid email.

Subscription failed
Thank you for subscribing!

Des Moines news in your inbox

Catch up on the most important stories affecting your hometown with Axios Des Moines

Please enter a valid email.

Please enter a valid email.

Subscription failed
Thank you for subscribing!

Minneapolis-St. Paul news in your inbox

Catch up on the most important stories affecting your hometown with Axios Twin Cities

Please enter a valid email.

Please enter a valid email.

Subscription failed
Thank you for subscribing!

Tampa Bay news in your inbox

Catch up on the most important stories affecting your hometown with Axios Tampa Bay

Please enter a valid email.

Please enter a valid email.

Subscription failed
Thank you for subscribing!

Charlotte news in your inbox

Catch up on the most important stories affecting your hometown with Axios Charlotte

Please enter a valid email.

Please enter a valid email.

Subscription failed
Thank you for subscribing!

Please enter a valid email.

Please enter a valid email.

Subscription failed
Thank you for subscribing!

Creative Commons

Leading artificial intelligence researchers are debating whether machines — once they achieve super-human smarts — should be expected to explain themselves in robust discussion, or if spitting out an exceptional, if mysterious, answer is good enough.

The debate is part of the raging global discussion over a perceived challenge posed by machine intelligence to jobs, the human role in society, geopolitical power — to us.

Battle lines: Peter Norvig, head of research at AI powerhouse Google, has attracted attention with a June 22 speech in Sydney arguing that future intelligent computers shouldn't be expected to explain why they think what they think, since, after all, humans themselves don't do a very good job at explaining the true reasons for their decisions. Others argue that neural networks are simply a different way of thinking, and that even if we should be able to plumb the machine mind, there is no way for us to get at it.

But David Ferrucci, who ran IBM's Watson project for the 2011 Jeopardy challenge and now runs an AI company called Elemental Cognition, asserts that machines have to defend themselves. "I need an explanation. I wanted to be able to critique it," he tells Axios.

Why it matters: Machines that don't explain themselves scare people who worry about godlike computer overlords. But researchers like Ferrucci are posing a more fundamental question: Are we ourselves willing to be held accountable for decisions we base on those of a computer? Unless he knows the computer's rationale, Ferrucci doesn't want to gamble. And others agree: Darpa, the Pentagon's radical research lab, is studying what it calls "Explainable Artificial Intelligence," giving it the acronym XAI.

Let's talk about it: The debate played out on stage at the O'Reilly Artificial Intelligence Conference this week in New York. Ferrucci argued that the best way to get to the kind of AI he is thinking of — the kind you can have a normal exchange of opinions with — is to study and develop a computer that thinks like a human. "[But] there is a level to those dialogues that we are nowhere close to having," he said.

The future: Josh Tennenbaum, a professor at MIT, said the answer is to study young children and develop machine intelligence that learns and thinks like them. He played a video of an 18-month-old child who, confronted with an adult having trouble putting books into a closed cabinet, spontaneously opens its doors and watches to make sure the troubled man succeeds. "That's the heart of intelligence right there. And I think that's the grand challenge for AI," he said. "...If we could reverse engineer what's going on in that kid's mind, just think what we can do with robots and other machines that could really help us out."

The Amazon effect: At this stage commercially, many of us are using Alexa or technology like it at home, but Kris Hammond, chief scientist at Narrative Science, said, "Alexa understands words. It doesn't understand language." Alexa can hold only one idea at a time. If you ask a followup, it does not remember what was just said. "You need to be able to challenge," Hammond said. "Otherwise, we would only be listening."

Go deeper

Dave Lawler, author of World
8 mins ago - World

What has and hasn't changed as Biden takes over U.S. foreign policy

Photo Illustration: Brendan Lynch/Axios. Photo: Chip Somodevilla/Getty Images

President Biden swiftly recommitted the U.S. to the Paris climate pact and the World Health Organization, but America's broader foreign policy is in a state of flux between the Trump and Biden eras.

Driving the news: One of the most striking moves from the Biden administration thus far was a show of continuity — concurring with the Trump administration's last-minute determination that China had committed "genocide" against Uyghur Muslims.

Updated 2 hours ago - Politics & Policy

Coronavirus dashboard

Illustration: Aïda Amer/Axios

  1. Health: New coronavirus cases down, but more bad news ahead — Fighting COVID-19's effects on gender equality.
  2. Politics: Biden unveils "wartime" COVID strategyBiden's COVID-19 bubble.
  3. Vaccine: NYC postpones vaccine appointments following shipment delays — Private companies step in to fill vaccine logistics vacuum.
  4. World: Biden will order U.S. to rejoin World Health OrganizationBiden to bring U.S. into global COVAX initiative for equitable vaccine access.
Updated 2 hours ago - Politics & Policy

Congress grants waiver for retired Gen. Lloyd Austin to lead Pentagon

Defense Secretary nominee Lloyd Austin. Photo: Chip Somodevilla/Getty Images

Both chambers of Congress on Thursday voted to grant retired Gen. Lloyd Austin a waiver to lead the Pentagon, clearing the path to confirmation for President Biden's nominee for defense secretary.

Why it matters: Austin's nomination received pushback from some lawmakers, including Democrats, who cited a law that requires officers be out of the military for at least seven years before taking the job — a statute intended to reinforce the tradition of civilian control of the Pentagon.