The Curiosity Mars rover. Photo: NASA/JPL-CALTECH/MSSS/HANDOUT/Anadolu Agency/Getty

From Earth, you want to pick something up from the surface of the moon. Using a joystick, you control a grabber — but you keep missing. It's the delay: It takes light nearly three seconds to get to the Moon and back, and the control signal even longer.

The big picture: This is a fundamental, insurmountable hurdle to moving stuff around in space if you're not there. The farther you are from Earth, the longer the communications delay — nothing, after all, moves faster than light.

  • One workaround is to just move really slowly. Fine if you're picking up a rock; not that great if you're trying to build a structure or repair something from afar.
  • A more powerful approach is to build as much autonomy as possible into the robot doing the job. That means that instead of telling it to move the grabber forward two inches, down four inches, and grab, you can just tell it to pick up the rock.

What's happening: Several startups, as well as NASA, are trying to find the right combination of human control and autonomy that would allow robots to do complex tasks in space. Full autonomy isn't an option for now — today's artificial intelligence isn't up to the job yet.

  • NASA wants to refuel or fix up orbiting satellites that weren't designed to be serviced. So it's developing robots that autonomously find and clamp onto satellites, at which point technicians on the ground use joysticks to carefully remove a covering and a valve, and start pumping gas.
  • SE4, a startup in Tokyo, has a system that blends human control and autonomy. An operator wears a VR headset and manipulates a digital scene from a robot's-eye-view. Then, the robot does the same thing — but not too precisely.

How it works: The SE4 system, which is being demonstrated today at the SIGGRAPH conference in Los Angeles, abstracts away some of the small details of the operator's actions, focusing instead largely on the intention.

  • Imagine someone demonstrating how to build an IKEA dresser. They won't try to tell you how many degrees to move your elbow before tightening your fingers.
  • Instead, they'll call out bigger-picture actions, like "align these two parts" and "now screw this in." That's what the robot does, too, having pre-learned basic actions like aligning and screwing in.

"We want human minds to ride these robots into remote locations and learn things," says Lochlainn Wilson, CEO of SE4. "We could have them going outside and doing operations without endangering human lives, yet humans will be gaining knowledge and experience."

What's next: By 2022, SE4 wants to remotely build a lunar base — somewhere on Earth. It'll be a proof of concept for its eventual aspirations to do construction on the actual Moon.

Go deeper

Updated 3 hours ago - Politics & Policy

Coronavirus dashboard

Illustration: Aïda Amer/Axios

  1. Global: Total confirmed cases as of 9 p.m. ET: 12,220,166 — Total deaths: 553,438 — Total recoveries — 6,696,632Map.
  2. U.S.: Total confirmed cases as of 9 p.m. ET: 3,111,902 — Total deaths: 133,195 — Total recoveries: 969,111 — Total tested: 38,032,966Map.
  3. Public health: More young people are spreading the virus Cases rise in 33 statesFlorida reports highest single-day death toll since pandemic began.
  4. Science: World Health Organization acknowledges airborne transmission of coronavirus.
  5. 1 🐂 thing: How the world could monitor for potential pandemic animal viruses.
4 hours ago - Podcasts

Inside Joe Biden's economic plan

Joe Biden on Thursday returned to his hometown of Scranton, Pennsylvania, to give his first major speech on economic policy since becoming the Democratic Party’s presumptive presidential nominee.

Axios Re:Cap digs into Biden's plans, how they developed and how they may change, with former U.S. Commerce secretary and campaign surrogate Penny Pritzker.

4 hours ago - World

Countries grapple with whether to lock back down as hotspots emerge

Tokyo in the time of coronavirus. Photo: Charly Triballeau/AFP via Getty

Many politicians and public health officials sounded a similar lockdown refrain in the spring: let’s do this right so we only have to do it once.

Reality check: While some countries have thus far managed to keep cases under control after opening up, dozens of countries that had initially turned a corner are now seeing a worrying rebound. They have to decide if and how to return to lockdown — and whether their populations will stand for it.