May 8, 2019 - Future

Avoiding the AI weapons race

Illustration: Sarah Grillo/Axios

Today's great powers are sliding toward a new arms race, this time on the battleground of lethal computer code, but experts say that rushing to develop autonomous weapons — which can be erratic and easily stolen — will make violent conflict more likely and yield no winners.

What's happening: The countries leading in artificial intelligence research (U.S., China, Russia, U.K., France, Israel and South Korea) are all developing weapons that hand-off increasing portions of the killing process to computers.

In a new report coming out tomorrow and reported first by Axios, PAX, a Dutch nonprofit, describes "clear signs of the start of an AI arms race."

  • "Automated turrets" guard South Korea's border, choosing targets autonomously but requiring a human go-ahead before they fire, says PAX, which lobbies companies not to make lethal AI.
  • China sells stealth drones advertised to be capable of autonomous airstrikes.
  • Israel uses autonomous drones to patrol its border with Gaza.

Unlike nuclear weapons, which can be guarded in bunkers and require deep expertise to manufacture, autonomous weapons are not easily locked away. "Once you develop them, these weapons will proliferate widely," Daan Kayser, the PAX report's lead author, tells Axios. "They'll also be used against you."

The reflex to treat AI as an arms race is creating a self-fulfilling prophecy, Paul Scharre, an autonomous weapons expert at the Center for a New American Security, warns in Foreign Affairs. In a security dilemma that resembles the Cold War, as countries build up their defenses, the world becomes more dangerous.

  • "There are strong institutional incentives within national security bureaucracies to stay ahead of others," Scharre tells Axios. But chasing breakneck speed can push aside essential research into AI safety and cybersecurity.
  • That could result in AI weapons that aren't thoroughly tested, make inexplicable decisions in the heat of the moment, or interact in unforeseen ways with other systems. "Some of the most powerful [AI] methods are quite alien to human intelligence," Scharre said.

But, but, but: The phrase "arms race" conjures images of the Cuban Missile Crisis, while a bigger conflict is likely to play out on the economic battlefield, says Amy Webb, an NYU professor and founder of the Future Today Institute.

  • "When we talk about an arms race, we tend to think about the wars that have already been fought," Webb tells Axios. "We're never talking about the wars of the future."
  • Autonomous weapons are one small slice of next-generation conflict, she says. The greater threat: a Chinese economy made hyper-efficient by AI and backed by allied emerging economies that could "cripple" U.S. markets.

What's next: The U.S., unlike most countries, has a clear-cut policy against using weapons that target and kill people without any human input.

  • But it has blocked attempts at the United Nations to establish a global ban on fully automated weapons and continues to develop increasingly autonomous fighting machines that still ask for a soldier's go-ahead before shooting.
  • Later this year, a group of outside advisers called the Defense Innovation Board will recommend a set of ethical "AI principles" to the Pentagon.

What's next

Bolton alleges in book that Trump tied Ukraine aid to investigations

Photo: Alex Wong/Getty Images

President Trump's former national security adviser John Bolton alleges in his forthcoming book that the president explicitly told him "he wanted to continue freezing $391 million in security assistance to Ukraine until officials there helped with investigations into Democrats including the Bidens," the New York Times first reported.

Why this matters: The revelations present a dramatic 11th hour turn in Trump's Senate impeachment trial. They directly contradict Trump's claim that he never tied the hold-up of Ukrainian aid to his demands for investigations into his political opponent Joe Biden.

Honoring Kobe Bryant: Sports stars, politicians and celebrities mourn NBA great

Kobe Bryant on court for the Los Angeles Lakers during the Sprite Slam Dunk Contest on All-Star Saturday Night, part of 2010 NBA All-Star Weekend at American Airlines Center in Dallas in February 2010. Photo: Jed Jacobsohn/Getty Images

Sports stars, politicians and celebrities paid tribute to NBA legend Kobe Bryant, who was killed in a California helicopter crash alongside his 13-year-old daughter, Gianna, and seven others on Saturday. He was 41.

What they're saying: Lakers great Shaquille O'Neal said in an Instagram post of his former teammate, "There's no words to express the pain I'm going through now with this tragic and sad moment of losing my friend, my brother, my partner in winning championships, my dude and my homie. I love you brother and you will be missed."

Go deeperArrow3 hours ago - Sports

What's next: Trump's broader travel ban

A sign for International Arrivals is shown at the Seattle-Tacoma International Airport. Photo: Ted S. Warren/AP

President Trump is expected to announce an expanded travel ban this week, which would restrict immigration from seven additional countries — Nigeria, Myanmar, Sudan, Belarus, Eritrea, Kyrgyzstan and Tanzania, per multiple reports.

  • The announcement would come on the third anniversary of Trump's original travel ban, which targeted Muslim-majority nations, per Axios' Stef Kight.