SaveSave story

AI can beat humans only one game at a time

Despite all of the potential for artificial intelligence to solve our most vexing problems, it's still in a primitive state, according to a new report by Stanford University. But a separate paper, this one by Alphabet's DeepMind, suggests again that it has made some of its best progress in the narrow realm of games.

Why it matters: Those advances are important, but life isn't a game. AI progress outside of these areas has been harder to define and track. "The most important thing for AI is to go from exceptional promise to use in actual everyday life," Martial Hebert, director of the Robotics Institute at Carnegie Mellon University, tells Axios.

Note: Funding data for 2017 is partial through July. Data: Artificial Intelligence Index; Chart: Chris Canipe / Axios

Here are key takeaways from the Stanford report, called the AI Index:

  • AI investment is through the roof: Between 2000 and 2017, the number of AI startups in the U.S. grew 14X — from 47 to 649. Annual VC investment in AI rose 6X last year, to $3.5 billion.
  • AI skills are in demand: The number of U.S. job postings on listing AI as a required skill was about 11,100 last year. So far this year, the number is 31,000.
  • A race is on between the U.S. and China: Kai-fu Lee, CEO of Sinovation, a Beijing-based VC firm, said in the report that China is making impressive progress in AI, and has far more data—the main building block of robust AI—to work with than anyone else. "In this age of AI, I predict that the United States-China duopoly is not only inevitable. It has already arrived," he said.
  • AI is good—at some things: AI is on par or better than humans at detecting objects in an image. (Machines can do this with half the error rate of humans.).
  • Yes, but: Algorithms struggle to capture the nuanced meaning in the words we use and how we use them. This is an active area of research. At the Allen Institute for Artificial Intelligence, an algorithm now scores about 42% on science questions an 8th grader might encounter, an improvement of 12% since the beginning of 2016. "We continue to move the score higher and higher," says Institute director Oren Etzioni.

The new advances in games: In a paper released yesterday, DeepMind, a top AI lab, introduced AlphaZero, an algorithm that in just 24 hours learned chess and its Japanese version Shogi, and went on to beat world champions in both.

  • AI is beating us at other games, too: It has beat expert humans at Go, Pac-Man and Texas Hold'Em. Work on the latter won the award for best paper at a top AI conference underway this week in Long Beach, CA.

Why it matters: Poker is particularly interesting for AI researchers because information in the game—an opponent's hand, for one—is hidden and deception is a key part of a player's strategy. That makes the game similar to real-world financial markets and political campaigns, where AI could eventually be deployed.

Along the same lines, Facebook and DeepMind are looking to conquer StarCraft, a multiplayer videogame of complexity that dwarfs Go.

  • And experts worry about hype: In an expert comment included in the Stanford report, Michael Wooldridge, head of computer science at Oxford University, said exaggeration has created an AI bubble:
"There are plenty of charlatans and snake oil salesmen out there, who are quite happy to sell whatever they happen to be doing as AI, and it is a source of great personal frustration that the press are happy to give airtime to views on AI that I consider to be ill-informed at best, lunatic fringe at worst."

What's needed: Gregory Allen, an adjunct fellow at the Center for a New American Security, said the field should establish solid long-term milestones for future progress. In the space race, the milestones were breaking the sound barrier, reaching space, reaching orbit, then reaching the Moon.

"If we want to think about future implications of AI in society, it would be helpful to have a longer runway," he said.

Steve LeVine 11 hours ago
SaveSave story

Self-driving lab head urges freeze after "nightmare" fatality

Uber self-driving car in Pittsburgh. Photo: Jeff Swensen / Getty

Carmakers and technology companies should freeze their race to field autonomous vehicles because "clearly the technology is not where it needs to be," said Raj Rajkumar, head of Carnegie Mellon University's leading self-driving laboratory.

What he said: Speaking a few hours after a self-driven vehicle ran over and killed a pedestrian in Arizona, Rajkumar said, "This isn't like a bug with your phone. People can get killed. Companies need to take a deep breath. The technology is not there yet. We need to keep people in the loop."

Zachary Basu 14 hours ago
SaveSave story

Uber pauses self-driving car tests after pedestrian killed

An Uber self-driving Volvo
An Uber self-driving Volvo. Photo: Uber

A pedestrian was struck and killed by a self-driving Uber in Tempe, Arizona, early Monday morning, according to ABC15. Tempe police said that the vehicle was in autonomous mode, though a safety driver was behind the wheel at the time of the crash.

Why it matters: The New York Times notes that this could be the first pedestrian ever killed by a self-driving vehicle. Uber says it's closely following its incident response process, though it declined to share more details about what that entails. The company has also paused its self-driving cars in all locations (Pittsburgh, Tempe, San Francisco and Toronto).