MIT researchers are using a wooden Jenga tower in a new effort to accomplish one of the hardest challenges in robotics — to build a bot that can grab, pack and assemble things with the dexterity of a human hand.

Video: MIT/YouTube

The MIT robot arm brings bots closer to assembling or packing finicky objects in a factory — jobs that, for now, can only be done by people. The robot can gingerly poke out block after block from the tower, relying on feedback from a camera and — in a novel twist — its own sense of touch.

  • In Jenga, players take turns removing individual blocks from a tower, without touching other blocks while doing so. The player who knocks down the tower loses.
  • To most, it's a simple game, but to a roboticist, it's an enormous challenge. "It requires you to not only see the world but also feel the world," Nima Fazeli, the MIT graduate student who led the robot's development, tells Axios.
  • It's nearly impossible to know which blocks are removable and which aren't just by looking at a Jenga tower.

Jenga is "a little like chess or Go but for manipulation," says Ken Goldberg, a Berkeley roboticist who was not involved with the MIT research. "It really requires a pretty sophisticated level of skill."

Details: When the MIT robot played its first game, it attacked blocks at random. But it learned as it played, and 300 fallen towers later, it developed a system to predict how blocks in different parts of the tower would behave.

  • Essentially, the robot constantly asks itself: "How close is this block to the kinds of blocks that I've seen before?" Fazeli says.
  • As the robot prods a block, a cuff on its "wrist" detects the resistance so it can tell if it's free or stuck.

The bot is pretty good at the game, says Fazeli — but not world class. "If you have a little skill, you can definitely beat it."

What's next: A yet-unsolved next step with enormous commercial potential, says Goldberg, is putting things back into narrow gaps.

Go deeper

Virtual school is another setback for struggling retail industry

Illustration: Annelise Capossela/Axios

A virtual school year will likely push retailers even closer to the brink.

Why it matters: Back-to-school season is the second-biggest revenue generating period for the retail sector, after the holidays. But retailers say typical shopping sprees will be smaller with students learning at home — another setback for their industry, which has seen a slew of store closures and bankruptcy filings since the pandemic hit.

54 mins ago - Health

The pandemic hasn't hampered the health care industry

Illustration: Rebecca Zisser/Axios

The economy has been tanking. Coronavirus infections and deaths have been rising. And the health care industry is as rich as ever.

The big picture: Second-quarter results are still pouring in, but so far, a vast majority of health care companies are reporting profits that many people assumed would not have been possible as the pandemic raged on.

Column / Harder Line

How climate and business woes are sinking a natural-gas project

Illustration: Annelise Capossela/Axios

The Trump administration recently touted its approval of America’s first terminal on the West Coast to export liquefied natural gas. There’s just one problem: it probably won’t be built.

Why it matters: The project in southern Oregon faces political and business hurdles serious enough that those who are following it say it will be shelved. Its problems embody the struggles facing a once-promising sector that's now struggling under the weight of the pandemic and more.