Sign up for our daily briefing

Make your busy days simpler with Axios AM/PM. Catch up on what's new and why it matters in just 5 minutes.

Please enter a valid email.

Please enter a valid email.

Subscription failed
Thank you for subscribing!

Catch up on the day's biggest business stories

Subscribe to Axios Closer for insights into the day’s business news and trends and why they matter

Please enter a valid email.

Please enter a valid email.

Subscription failed
Thank you for subscribing!

Stay on top of the latest market trends

Subscribe to Axios Markets for the latest market trends and economic insights. Sign up for free.

Please enter a valid email.

Please enter a valid email.

Subscription failed
Thank you for subscribing!

Sports news worthy of your time

Binge on the stats and stories that drive the sports world with Axios Sports. Sign up for free.

Please enter a valid email.

Please enter a valid email.

Subscription failed
Thank you for subscribing!

Tech news worthy of your time

Get our smart take on technology from the Valley and D.C. with Axios Login. Sign up for free.

Please enter a valid email.

Please enter a valid email.

Subscription failed
Thank you for subscribing!

Get the inside stories

Get an insider's guide to the new White House with Axios Sneak Peek. Sign up for free.

Please enter a valid email.

Please enter a valid email.

Subscription failed
Thank you for subscribing!

Axios on your phone

Get breaking news and scoops on the go with the Axios app.

Download for free.

Catch up on coronavirus stories and special reports, curated by Mike Allen everyday

Catch up on coronavirus stories and special reports, curated by Mike Allen everyday

Please enter a valid email.

Please enter a valid email.

Subscription failed
Thank you for subscribing!

Want a daily digest of the top Denver news?

Get a daily digest of the most important stories affecting your hometown with Axios Denver

Please enter a valid email.

Please enter a valid email.

Subscription failed
Thank you for subscribing!

Want a daily digest of the top Des Moines news?

Get a daily digest of the most important stories affecting your hometown with Axios Des Moines

Please enter a valid email.

Please enter a valid email.

Subscription failed
Thank you for subscribing!

Want a daily digest of the top Twin Cities news?

Get a daily digest of the most important stories affecting your hometown with Axios Twin Cities

Please enter a valid email.

Please enter a valid email.

Subscription failed
Thank you for subscribing!

Want a daily digest of the top Tampa Bay news?

Get a daily digest of the most important stories affecting your hometown with Axios Tampa Bay

Please enter a valid email.

Please enter a valid email.

Subscription failed
Thank you for subscribing!

Want a daily digest of the top Charlotte news?

Get a daily digest of the most important stories affecting your hometown with Axios Charlotte

Please enter a valid email.

Please enter a valid email.

Subscription failed
Thank you for subscribing!

Sign up for Axios NW Arkansas

Stay up-to-date on the most important and interesting stories affecting NW Arkansas, authored by local reporters

Please enter a valid email.

Please enter a valid email.

Subscription failed
Thank you for subscribing!

Please enter a valid email.

Please enter a valid email.

Subscription failed
Thank you for subscribing!

Illustration: Aïda Amer/Axios

In the quest to build AI that goes beyond today's single-purpose machines, scientists are developing new tools to help AI remember the right things — and forget the rest.

Why it matters: Getting that balance right is the difference between a machine that can trade stocks like a pro but can't make head or tail of a crossword puzzle, and one that learns all that plus a variety of other skills, and continually improves them — an important step toward human-like intelligence.

"AI is entirely about memory and forgetting," says Dileep George, founder of the AI company Vicarious.

  • A computer that remembers too little won't be able to do anything that requires connecting past experiences to new ones — like understanding a pronoun in a sentence, even if the person it refers to was named just one sentence before. These memory lapses are known as "catastrophic forgetting."
  • But one that remembers too much loses the ability to see the big picture. This is called overfitting: focusing entirely on the particulars of past experiences at the cost of the ability to extract general concepts from them.
  • "A big part of learning is knowing what to learn," says David Cox, director of the MIT–IBM Watson AI Lab. "You want to be able to forget things that are irrelevant." This holds for humans and machines both.

Another effect of catastrophic forgetting is that a machine learning a new task can lose the ability to do an old one — like a language learner forgetting their native tongue.

  • To solve this, some researchers are adding in memory modules that can set aside learned patterns, so that they don't get overwritten by new information.
  • Others, like George, are experimenting with turning specific tasks into computer programs that are walled off from others and can be combined to perform more complex jobs.

These help with AI's forgetting problem — but they're not how human brains work, says Blake Richards, a neuroscientist and AI researcher at the University of Toronto.

  • What our brains actually do isn't completely clear, Richards says. It's likely that memories are stored all together — but that patterns are kept separate from each other within the tangle, warding off the overwriting problem.
  • Being able to connect memories with one another may be at the root of our ability to imagine and plan — two essential qualities that AI still lacks.

A trick humans do during sleep may be key to moving AI closer to the way we learn, says Cox. At rest, we relive recent memories, and in doing so reinforce neural pathways that help us remember them.

  • Machines can mimic this with a process called "experience replay," which weaves in memories of previously learned tasks alongside new lessons.
  • This helps them remember the old and the new — and because the memories are not kept separate, a computer could use parts of one to help learn the other, like a typist learning to play piano.

What's next: Perfecting memory could unlock AI "that can actually make insightful predictions and imagine what's going to happen in the future," Richards says. That's a crucial building block toward common sense, long a holy grail for AI researchers.

Go deeper:

Go deeper

Updated 5 hours ago - Sports

Olympics dashboard

Katie Ledecky in Tokyo. Photo: Ding Xu/Xinhua via Getty Images

🚨: Simone Biles won't compete in individual vault or uneven bars

🏊‍♀️: Katie Ledecky wins gold in women's 800m freestyle

🏊: Caeleb Dressel breaks world record in men's 100m butterfly, 3rd gold

🇬🇧: Britain wins gold in first-ever Olympic mixed 4x100m medley relay

🎾: Novak Djokovic defeated in Olympic semi-finals

💻: Japan tests teleporting games and "remote cheering"

Go deeper: Full Axios coverage

Updated 6 hours ago - Sports

Simone Biles won't compete in individual vault or uneven bars Olympic finals

Photo: Loic Venance/AFP via Getty Images

Simone Biles will not compete in the individual vault or uneven bars finals at the Tokyo Olympics, USA Gymnastics announced Friday.

Why it matters: USA Gymnastics said Biles, who previously withdrew from the individual all-around and team finals to prioritize her mental health, will continue to be evaluated to determine if she'll compete in the balance beam or floor exercise events.

6 hours ago - Sports

American Katie Ledecky wins Olympic gold in women's 800m freestyle

USA's Katie Ledecky reacts after taking gold in the final of the women's 800m freestyle race. Photo: Odd Anderson/AFP via Getty Images

American superstar swimmer Katie Ledecky grabbed her second gold medal of this year's Olympic Games, winning the women's 800-meter freestyle race Saturday in Tokyo.

Driving the news: Ledecky, who holds the world record in the 800m freestyle, is considered one of the best women swimmers of all time. Saturday's final marks her third straight Olympic gold in the event.

You’ve caught up. Now what?

Sign up for Mike Allen’s daily Axios AM and PM newsletters to get smarter, faster on the news that matters.

Please enter a valid email.

Please enter a valid email.

Subscription failed
Thank you for subscribing!