May 8, 2019

Avoiding the AI weapons race

Illustration: Sarah Grillo/Axios

Today's great powers are sliding toward a new arms race, this time on the battleground of lethal computer code, but experts say that rushing to develop autonomous weapons — which can be erratic and easily stolen — will make violent conflict more likely and yield no winners.

What's happening: The countries leading in artificial intelligence research (U.S., China, Russia, U.K., France, Israel and South Korea) are all developing weapons that hand-off increasing portions of the killing process to computers.

In a new report coming out tomorrow and reported first by Axios, PAX, a Dutch nonprofit, describes "clear signs of the start of an AI arms race."

  • "Automated turrets" guard South Korea's border, choosing targets autonomously but requiring a human go-ahead before they fire, says PAX, which lobbies companies not to make lethal AI.
  • China sells stealth drones advertised to be capable of autonomous airstrikes.
  • Israel uses autonomous drones to patrol its border with Gaza.

Unlike nuclear weapons, which can be guarded in bunkers and require deep expertise to manufacture, autonomous weapons are not easily locked away. "Once you develop them, these weapons will proliferate widely," Daan Kayser, the PAX report's lead author, tells Axios. "They'll also be used against you."

The reflex to treat AI as an arms race is creating a self-fulfilling prophecy, Paul Scharre, an autonomous weapons expert at the Center for a New American Security, warns in Foreign Affairs. In a security dilemma that resembles the Cold War, as countries build up their defenses, the world becomes more dangerous.

  • "There are strong institutional incentives within national security bureaucracies to stay ahead of others," Scharre tells Axios. But chasing breakneck speed can push aside essential research into AI safety and cybersecurity.
  • That could result in AI weapons that aren't thoroughly tested, make inexplicable decisions in the heat of the moment, or interact in unforeseen ways with other systems. "Some of the most powerful [AI] methods are quite alien to human intelligence," Scharre said.

But, but, but: The phrase "arms race" conjures images of the Cuban Missile Crisis, while a bigger conflict is likely to play out on the economic battlefield, says Amy Webb, an NYU professor and founder of the Future Today Institute.

  • "When we talk about an arms race, we tend to think about the wars that have already been fought," Webb tells Axios. "We're never talking about the wars of the future."
  • Autonomous weapons are one small slice of next-generation conflict, she says. The greater threat: a Chinese economy made hyper-efficient by AI and backed by allied emerging economies that could "cripple" U.S. markets.

What's next: The U.S., unlike most countries, has a clear-cut policy against using weapons that target and kill people without any human input.

  • But it has blocked attempts at the United Nations to establish a global ban on fully automated weapons and continues to develop increasingly autonomous fighting machines that still ask for a soldier's go-ahead before shooting.
  • Later this year, a group of outside advisers called the Defense Innovation Board will recommend a set of ethical "AI principles" to the Pentagon.

Go deeper

Amid racial unrest, a test at the polls

Photo: Stephen Maturen/Getty Images

Eight states plus D.C. are holding primary elections today following a week of intense protests across the country over the brutal police killing of George Floyd.

Why it matters: It's the first major test for voting since the national outcry. Concerns over civil unrest and the police — as well as the coronavirus and expanded absentee voting — could reduce the number of voters showing up in person but heighten tensions for those who do.

Axios-Ipsos poll: America’s big racial divide on police, virus

Data: Ipsos/Axios survey; Note: ±3.2% margin of error; Chart: Andrew Witherspoon/Axios

A new Axios-Ipsos poll finds that America has a massive racial gulf on each of our twin calamities — trust in police, and fear of the coronavirus.

  • 77% of whites say they trust local police, compared with just 36% of African Americans — one of many measures of a throbbing racial divide in Week 11 of the Axios-Ipsos Coronavirus Index, taken the week George Floyd was killed by a white policeman in Minneapolis.
Updated 50 mins ago - Politics & Policy

Updates: George Floyd protests nationwide

Police officers wearing riot gear push back demonstrators outside of the White House on Monday. Photo: Jose Luis Magana/AFP via Getty Images

Protests over the death of George Floyd and other police-related killings of black people continued for a seventh day across the U.S., with President Trump threatening on Monday to deploy the military if the unrest continues.

The latest: Four police officers were struck by gunfire while standing near a line in St Louis on Monday after a peaceful demonstration, Police Chief John Hayden said early Tuesday. They were all taken to hospital with non-life threatening injuries. He said a small group of people had thrown rocks and fireworks at police officers.