Data: Language Models are Few-Shot Learners; Table: Axios Visuals

While GPT-3 has earned ecstatic reviews from many experts for its capabilities, some critics have pointed out clear issues around bias.

Why it matters: As AI becomes more powerful and more integrated into daily life, it becomes even more important to root out the persistent problem of bias and fairness.

What's happening: Researchers at OpenAI noted in the paper introducing GPT-3 that "internet-trained models have internet-scale biases." A model trained on the internet like GPT-3 will share the biases of the internet, including stereotypes around gender, race and religion.

  • As the table above from the paper shows, females were more often described with appearance-associated adjectives, while males were more often described with adjectives that spanned a wider spectrum of descriptions.
  • The paper also found that GPT-3 associated different races with different degrees of sentiment, with Black ranking consistently low.

In a Twitter thread, Facebook AI head Jerome Pesenti raised concerns that GPT-3 can "easily output toxic language that propagates harmful biases."

  • OpenAI CEO Sam Altman responded that he shared those concerns, and he argued that part of the reason the nonprofit was starting off GPT-3 in a closed beta was to do safety reviews before it went fully live.
  • He noted that OpenAI had introduced a new toxicity filter that was on by default.
  • The original paper also found that GPT-3 seemed less prone to bias than earlier, smaller models, offering some preliminary hope that size could help minimize the problem.

What to watch: A system that can generate near-human quality writing could be used for misinformation, phishing and other hacking efforts. And while malicious humans already do all of those things, GPT-3 and future AI systems could effectively scale those efforts up.

The bottom line: If AI produces racist or sexist content, it's because the system learned it by watching us. That puts the onus on programmers to curb their creations.

Go deeper: Rooting out AI bias

Go deeper

Bryan Walsh, author of Future
Aug 5, 2020 - World

How new tech raises the risk of nuclear war

Illustration: Annelise Capossela/Axios

75 years after Hiroshima and Nagasaki, some experts believe the risk of the use of a nuclear weapon is as high now as it has been since the Cuban missile crisis.

The big picture: Nuclear war remains the single greatest present threat to humanity — and one that is poised to grow as emerging technologies, like much faster missiles, cyber warfare and artificial intelligence, upset an already precarious nuclear balance.

Updated 36 mins ago - Politics & Policy

Coronavirus dashboard

Illustration: Aïda Amer/Axios

  1. Politics: Fauci: Trump hasn't been to a COVID task force meeting in months — Trump claims COVID "will go away" during debate.
  2. Sports: The youth sports exodus continues — Big Ten football is back.
  3. Health: How to help save 130,000 livesFDA approves Gilead's remdesivir as treatment How the pandemic might endMany U.S. deaths were avoidable.
  4. Retail: Santa won't greet kids at Macy's this year.
  5. World: Spain and France exceed 1 million cases.
52 mins ago - Health

Fauci: Trump hasn't been to a COVID task force meeting in months

Photo: Drew Angerer/Getty Images

President Trump has not attended a White House coronavirus task force meeting in “several months,” NIAID director Anthony Fauci told MSNBC on Friday.

Why it matters: At the beginning of the pandemic, the task force, led by Vice President Mike Pence, met every day, but in the "last several weeks," members have held virtual meetings once a week, Fauci said, even as the number of new cases continues to surge in the country.