Sign up for our daily briefing

Make your busy days simpler with Axios AM/PM. Catch up on what's new and why it matters in just 5 minutes.

Please enter a valid email.

Please enter a valid email.

Subscription failed
Thank you for subscribing!

Catch up on coronavirus stories and special reports, curated by Mike Allen everyday

Catch up on coronavirus stories and special reports, curated by Mike Allen everyday

Please enter a valid email.

Please enter a valid email.

Subscription failed
Thank you for subscribing!

Denver news in your inbox

Catch up on the most important stories affecting your hometown with Axios Denver

Please enter a valid email.

Please enter a valid email.

Subscription failed
Thank you for subscribing!

Des Moines news in your inbox

Catch up on the most important stories affecting your hometown with Axios Des Moines

Please enter a valid email.

Please enter a valid email.

Subscription failed
Thank you for subscribing!

Minneapolis-St. Paul news in your inbox

Catch up on the most important stories affecting your hometown with Axios Twin Cities

Please enter a valid email.

Please enter a valid email.

Subscription failed
Thank you for subscribing!

Tampa Bay news in your inbox

Catch up on the most important stories affecting your hometown with Axios Tampa Bay

Please enter a valid email.

Please enter a valid email.

Subscription failed
Thank you for subscribing!

Charlotte news in your inbox

Catch up on the most important stories affecting your hometown with Axios Charlotte

Please enter a valid email.

Please enter a valid email.

Subscription failed
Thank you for subscribing!

Please enter a valid email.

Please enter a valid email.

Subscription failed
Thank you for subscribing!
Data: Language Models are Few-Shot Learners; Table: Axios Visuals

While GPT-3 has earned ecstatic reviews from many experts for its capabilities, some critics have pointed out clear issues around bias.

Why it matters: As AI becomes more powerful and more integrated into daily life, it becomes even more important to root out the persistent problem of bias and fairness.

What's happening: Researchers at OpenAI noted in the paper introducing GPT-3 that "internet-trained models have internet-scale biases." A model trained on the internet like GPT-3 will share the biases of the internet, including stereotypes around gender, race and religion.

  • As the table above from the paper shows, females were more often described with appearance-associated adjectives, while males were more often described with adjectives that spanned a wider spectrum of descriptions.
  • The paper also found that GPT-3 associated different races with different degrees of sentiment, with Black ranking consistently low.

In a Twitter thread, Facebook AI head Jerome Pesenti raised concerns that GPT-3 can "easily output toxic language that propagates harmful biases."

  • OpenAI CEO Sam Altman responded that he shared those concerns, and he argued that part of the reason the nonprofit was starting off GPT-3 in a closed beta was to do safety reviews before it went fully live.
  • He noted that OpenAI had introduced a new toxicity filter that was on by default.
  • The original paper also found that GPT-3 seemed less prone to bias than earlier, smaller models, offering some preliminary hope that size could help minimize the problem.

What to watch: A system that can generate near-human quality writing could be used for misinformation, phishing and other hacking efforts. And while malicious humans already do all of those things, GPT-3 and future AI systems could effectively scale those efforts up.

The bottom line: If AI produces racist or sexist content, it's because the system learned it by watching us. That puts the onus on programmers to curb their creations.

Go deeper: Rooting out AI bias

Go deeper

Bryan Walsh, author of Future
Oct 27, 2020 - Technology

A new AI aims to be a ghostwriter in the machine

Illustration: Eniola Odetunde/Axios

A new machine-learning-based writing companion called Wordtune aims to help users edit and improve written text as it's being composed.

Why it matters: Natural language processing is one of the most active areas in AI today. If tools like Wordtune work well, it would demonstrate AI is getting closer to really understanding what we're saying.

Updated 1 hour ago - World

Over 3,000 detained in protests across Russia demanding Navalny's release

Russian police officers beat protestesters at a rally against of jailing of oppositon leader Alexei Navalny in Moscow on Saturday. Photo: Mikhail Svetlov/Getty Images

Police in Russia on Saturday arrested more than 3,300 people as protesters nationwide demanded that opposition leader Alexey Navalny be released from jail.

Details: Demonstrations began in the eastern regions of Russia and spread west to more than 60 cities.

Updated 3 hours ago - Politics & Policy

Arizona Republicans censure Cindy McCain and GOP governor

Combination images of Cindy McCain and Gov. Doug Ducey. Photo: FilmMagic/FilmMagic for U.S.VETS/Michael Brochstein/SOPA Images/LightRocket via Getty Images

Arizona Republican Party members voted on Saturday to censure prominent GOP figures Cindy McCain, Gov. Doug Ducey and former Sen. Jeff Flake (R-Ariz.), who've all faced clashes with former President Trump.

Why it matters: Although the resolution is symbolic, this move plus the re-election of the Trump-endorsed Kelli Ward as state GOP chair shows the strong hold the former president has on the party in Arizona, despite President Biden winning the state in the 2020 election.