Jul 26, 2018 - Technology

Why it matters: Facial recognition's racial bias problem

Illustration: Sarah Grillo/Axios

Amazon’s facial recognition system, Rekognition, falsely matched 28 U.S. congressmen with criminal mugshots, the American Civil Liberties Union wrote in a blog post Thursday.

Why it matters: The result of the test, which compared all 535 members of Congress against 25,000 public mugshots, fuels the debate over whether algorithmic bias singles out more minorities by law enforcement.

An Amazon Web Services spokesperson told us the service should be used "to review and consider options using their judgement and not to make fully autonomous decisions."

  • Still, there's nothing to prevent how law enforcement agencies use Amazon's facial recognition system.

The details:

  • About 40% of Rekognition’s false matches in ACLU’s test were people of color. Only 20% of the current members of Congress are people of color, showing false matches affected that group at a higher rate.
  • Six incorrect matches were members of the Congressional Black Caucus, including civil rights leader Rep. John Lewis.
  • The technology could further bias an officer, as individuals start “being questioned or having their home searched, based on a false identification,” ACLU said.
  • There is no data from Rokognition on bias testing, per The Verge.
  • The New York Times tested out Rekognition's API in June showing how facial recognition could help identify politicians while reporting on Capitol Hill. Though in one instance, Rekognition incorrectly identified  Florida Sen. Bill Nelson with actor Bill Paxton.

What they're saying:

  • The Congressional Black Congress sent a letter to Amazon CEO Jeff Bezos in May about the risks of Rekognition’s usage by law enforcement.
  • In June, a group of Amazon employees sent a letter to Bezos concerned about the ethics of the technology when used by Immigration and Customs Enforcement, per The Hill.
  • Officers from Hillsboro, Ore., expressed concern through email exchanges about how “Big Brother” a partnership with Amazon may appear, per Gizmodo.

The other side: In ACLU's particular situation, Amazon Rekognition is not meant to be the sole decider, an Amazon Web Services spokesperson tells Axios.

“While 80% confidence is an acceptable threshold for photos of hot dogs, chairs, animals, or other social media use cases, it wouldn’t be appropriate for identifying individuals with a reasonable level of certainty. When using facial recognition for law enforcement activities, we guide customers to set a threshold of at least 95% or higher.”
— AWS spokesperson

The bottom line: Facial recognition systems have long struggled with high error rates for women and people of color, raising questions about their broader use, especially in a public safety context.

Go deeper:

What's next

Bolton alleges in book that Trump tied Ukraine aid to investigations

Photo: Alex Wong/Getty Images

President Trump's former national security adviser John Bolton alleges in his forthcoming book that the president explicitly told him "he wanted to continue freezing $391 million in security assistance to Ukraine until officials there helped with investigations into Democrats including the Bidens," the New York Times first reported.

Why this matters: The revelations present a dramatic 11th hour turn in Trump's Senate impeachment trial. They directly contradict Trump's claim that he never tied the hold-up of Ukrainian aid to his demands for investigations into his political opponent Joe Biden.

Honoring Kobe Bryant: Sports stars, politicians and celebrities mourn NBA great

Kobe Bryant on court for the Los Angeles Lakers during the Sprite Slam Dunk Contest on All-Star Saturday Night, part of 2010 NBA All-Star Weekend at American Airlines Center in Dallas in February 2010. Photo: Jed Jacobsohn/Getty Images

Sports stars, politicians and celebrities paid tribute to NBA legend Kobe Bryant, who was killed in a California helicopter crash alongside his 13-year-old daughter, Gianna, and seven others on Saturday. He was 41.

What they're saying: Lakers great Shaquille O'Neal said in an Instagram post of his former teammate, "There's no words to express the pain I'm going through now with this tragic and sad moment of losing my friend, my brother, my partner in winning championships, my dude and my homie. I love you brother and you will be missed."

Go deeperArrow3 hours ago - Sports

What's next: Trump's broader travel ban

A sign for International Arrivals is shown at the Seattle-Tacoma International Airport. Photo: Ted S. Warren/AP

President Trump is expected to announce an expanded travel ban this week, which would restrict immigration from seven additional countries — Nigeria, Myanmar, Sudan, Belarus, Eritrea, Kyrgyzstan and Tanzania, per multiple reports.

  • The announcement would come on the third anniversary of Trump's original travel ban, which targeted Muslim-majority nations, per Axios' Stef Kight.