OpenAI's robot hand. Video: OpenAI

Researchers have created a robot hand that can flip a cube into specific positions, using human-like techniques it learned on its own over the course of 100 simulated years of training.

Why it matters: The algorithm behind the feat has a surprising backstory: It previously trained AI agents to play Dota 2, a complex multiplayer video game. Using it again for a very different task is a leap over today’s algorithms, which can generally only do one thing well.

The two challenges — playing a video game and spinning a cube with robot fingers —
are very different, to be sure. But OpenAI found overlapping characteristics, said Jack Clark, OpenAI’s communications and strategy director.

  • They both involve a quickly shifting environment. In Dota 2, AI players collaborate to outsmart a team of humans; with the cube, the robot hand uses 20 motors to control its fingers in a complex show of dexterity.
  • Independent researchers suggest it's a breakthrough. "I think this is a very exciting result," said Blake Richards, a professor at the University of Toronto and fellow at the Canadian Institute for Advanced Research, who was not involved in OpenAI's research. He tells Axios:
"This is big, because it shows that real-world applicable AI should be possible using only a few small tweaks on already developed systems."

How it works: The algorithm controlling the hand learned how to move cubes around in a simulated environment, and then — in a surprisingly successful leap — transferred its experience to the real world.

  • To prepare for the uncertainties of grasping real objects, the researchers introduced random variations to the virtual worlds the hand was trained in, changing parameters like gravity, friction, and the cube's weight and dimensions.
  • This method also helped make OpenAI's artificial Dota 2 players good enough to beat amateur humans.
  • This weekend, the AI team will take on a team of top Dota 2 players.

The sheer scale of the training regimen was the main reason the algorithm was able to solve these two different tasks, said Jonas Schneider, OpenAI’s head of robotics engineering.

  • Huge amounts of compute power allowed the hand to accumulate 100 years of experience in about two days. An even more powerful setup helped the Dota 2 system play 180 years of games daily.
  • "We see this trend continuing in the future," Schneider said. "Lots of new companies are building hardware accelerators for deep learning that have the potential of speeding up training by several orders of magnitude within the next four years."

This new robot hand isn’t ready to be deployed to factories: Many of its movements are still awkward, and it lacks the precision that a touch-sensitive hand might possess. Instead, the hand’s performance is hard proof of the algorithm's flexibility.

"It’s hard to know what kind of progress you’re making if you’re just making progress in simulators," Clark told Axios. "But if I make progress on a real robotics task, I've done a no-bullshit reality thing."

Go deeper: A look at the tasks today’s robot hands are capable of (NYT).

Go deeper

Dion Rabouin, author of Markets
1 hour ago - Economy & Business

Investors are betting the future is priced in euros

Illustration: Aïda Amer/Axios

It's the euro's time now — at least that's how investors have been positioning recently.

What's happening: Speculators have raised their bets to the highest in nine years that the dollar will fall and increased bullish bets that the euro will rise to the highest level on record, Reuters reported citing data from the CFTC.

Updated 2 hours ago - Politics & Policy

Coronavirus dashboard

Illustration: Annelise Capossela/Axios

  1. Global: Total confirmed cases as of 7 a.m. ET: 20,317,087 — Total deaths: 742,035— Total recoveries: 12,602,544Map.
  2. U.S.: Total confirmed cases as of 7 a.m. ET: 5,141,879 — Total deaths: 164,545 — Total recoveries: 1,714,960 — Total tests: 63,252,257Map.
  3. States: Georgia reports 137 coronavirus deaths, setting new daily record Florida reports another daily record for deaths.
  4. Health care: Trump administration buys 100 million doses of Moderna's coronavirus vaccine.
  5. Business: Moderna reveals it may not hold patent rights for vaccine.
  6. Sports: Big Ten and Pac 12 scrap fall footballMLB salaries at 37%
  7. World: Lebanon reported record new cases as UN warned blast may drive spike — Fauci "seriously" doubts Russia's coronavirus vaccine is safe
Mike Allen, author of AM
2 hours ago - Politics & Policy

3 keys to Joe Biden picking Kamala Harris

Photo: Jeff Kowalsky/AFP via Getty Images

Three quick points about Joe Biden's historic selection of Sen. Kamala (pronounced COMMA-luh) Harris of California as his running mate — and clues they give us to how Biden would govern:

  1. She was always at the top of his list. As I look back through my text threads with top Dems over the past five months, she was always assumed to be the most likely pick.