Sign up for our daily briefing

Make your busy days simpler with Axios AM/PM. Catch up on what's new and why it matters in just 5 minutes.

Please enter a valid email.

Please enter a valid email.

Subscription failed
Thank you for subscribing!

Stay on top of the latest market trends

Subscribe to Axios Markets for the latest market trends and economic insights. Sign up for free.

Please enter a valid email.

Please enter a valid email.

Subscription failed
Thank you for subscribing!

Sports news worthy of your time

Binge on the stats and stories that drive the sports world with Axios Sports. Sign up for free.

Please enter a valid email.

Please enter a valid email.

Subscription failed
Thank you for subscribing!

Tech news worthy of your time

Get our smart take on technology from the Valley and D.C. with Axios Login. Sign up for free.

Please enter a valid email.

Please enter a valid email.

Subscription failed
Thank you for subscribing!

Get the inside stories

Get an insider's guide to the new White House with Axios Sneak Peek. Sign up for free.

Please enter a valid email.

Please enter a valid email.

Subscription failed
Thank you for subscribing!

Catch up on coronavirus stories and special reports, curated by Mike Allen everyday

Catch up on coronavirus stories and special reports, curated by Mike Allen everyday

Please enter a valid email.

Please enter a valid email.

Subscription failed
Thank you for subscribing!

Want a daily digest of the top Denver news?

Get a daily digest of the most important stories affecting your hometown with Axios Denver

Please enter a valid email.

Please enter a valid email.

Subscription failed
Thank you for subscribing!

Want a daily digest of the top Des Moines news?

Get a daily digest of the most important stories affecting your hometown with Axios Des Moines

Please enter a valid email.

Please enter a valid email.

Subscription failed
Thank you for subscribing!

Want a daily digest of the top Twin Cities news?

Get a daily digest of the most important stories affecting your hometown with Axios Twin Cities

Please enter a valid email.

Please enter a valid email.

Subscription failed
Thank you for subscribing!

Want a daily digest of the top Tampa Bay news?

Get a daily digest of the most important stories affecting your hometown with Axios Tampa Bay

Please enter a valid email.

Please enter a valid email.

Subscription failed
Thank you for subscribing!

Want a daily digest of the top Charlotte news?

Get a daily digest of the most important stories affecting your hometown with Axios Charlotte

Please enter a valid email.

Please enter a valid email.

Subscription failed
Thank you for subscribing!

Please enter a valid email.

Please enter a valid email.

Subscription failed
Thank you for subscribing!

Ilustration: Sarah Grillo/Axios

The criminal justice system has eagerly taken up AI tools for surveillance, policing and sentencing — software that can track people's faces, deploy patrols where crime appears most likely, and recommend whether to grant bail.

What's happening: But these tools are often cloaked in secrecy, so it can be impossible to judge their accuracy, or even know where and how they are being used. Critics say this opens the door to misuse and discrimination.

Driving the news: San Francisco yesterday approved the most restrictive government surveillance regulations in the U.S.

  • The new measure, if it is passed a second time next week, entirely bans official facial recognition in the city — though it does not apply to federal agencies — and requires every department that wants to use surveillance technology to apply for permission.
  • At the other extreme, across the Pacific, is China. It is implementing the most Orwellian surveillance system on the planet, leaning especially hard on facial recognition to identify and track its Uighur minority.

Why it matters: When poorly coded or deployed, AI systems can make huge mistakes or harm some groups more than others. But where faulty facial recognition in Snapchat might mean some people can't use a fun filter, flawed police software can land the wrong people in jail.

  • Because these systems are tightly guarded, outside experts can't check them for bias and accuracy, and the public doesn't know how well they perform.
  • Read this: London police, responding to a freedom of information request, said this month that its facial recognition system misidentified people as criminals a whopping 96% of the time.
  • What's more, experts and watchdogs say they don't actually know where such systems have been deployed around the United States, and defendants are often in the dark about whether advanced surveillance tech was used against them.

"You can't meaningfully build up a criminal defense, or change policies, if you don't know how these tools are being used," says Alice Xiang, a researcher at the Partnership on AI.

San Francisco will soon have its first-ever complete public list of surveillance technology currently in use, says Lee Hepner, legislative aide to San Francisco Supervisor Aaron Peskin, who introduced the measure.

  • "Communities have a right to know whether their governments use dangerous surveillance technology to track their daily lives," says Matt Cagle, an attorney at the ACLU of Northern California who advocated for the measure.
  • Several other cities — including Oakland and Somerville, a city in the Boston area — are considering similar legislation.

The big picture: The uptake of AI in criminal justice mirrors a broad push to automate difficult or sensitive decisions, like hiring and diagnosing diseases from medical scans. But they are often implemented without proper safeguards, says Peter Eckersley, research director at the Partnership on AI.

  • The predictive systems used by nine police departments may have relied on biased data focused disproportionately on minority populations, according to a March report from AI now and New York University. If the report is accurate, this data may be enshrined in new predictive policing systems.
  • Last month, the Partnership on AI studied risk-assessment tools used to inform bail decisions and found that every system currently in use is flawed and should not be used.

What's next: Facial recognition is the most publicly controversial of the various AI tools governments use, and it's the one most likely to be regulated. Companies have asked the federal government to put rules in place for law enforcement use of the technology.

Go deeper

Harry and Meghan accuse British royal family of racism

Photo: Joe Pugliese/Harpo Productions via Reuters

Prince Harry and Meghan Markle delivered a devastating indictment of the U.K. royal family in their conservation with Oprah Winfrey: Both said unnamed relatives had expressed concern about what the skin tone of their baby would be. And they accused "the firm" of character assassination and "perpetuating falsehoods."

Why it matters: An institution that thrives on myth now faces harsh reality. The explosive two-hour interview gave an unprecedented, unsparing window into the monarchy: Harry said his father and brother "are trapped," and Markle revealed that the the misery of being a working royal drove her to thoughts of suicide.

Updated 3 hours ago - Axios Twin Cities

In photos: Thousands rally for George Floyd ahead of Derek Chauvin's trial

Demonstrators on March 7 outside the Hennepin County Government Center, where the trial of former Minneapolis police officer Derek Chauvin, charged with murdering George Floyd, will begin in Minneapolis, Minnesota. Photo: Chandan Khanna/AFP via Getty Images

Thousands of protesters marched through Minneapolis' streets Sunday, urging justice for George Floyd on the eve of the start of former police officer Derek Chauvin's trial over the 46-year-old's death, per AFP.

The big picture: Chauvin faces charges for second-degree murder and manslaughter over Floyd's death last May, which ignited massive nationwide and global protests against racism and for police reform. His trial is due to start Monday, with jury selection procedures.

Caitlin Owens, author of Vitals
7 hours ago - Health

Pfizer CEO feels "liberated" after taking COVID vaccine

Pfizer CEO Albert Bourla. Photo: "Axios on HBO"

Pfizer CEO Albert Bourla tells "Axios on HBO" that he recently received his first of two doses of the company's coronavirus vaccine.

Why it matters: Bourla told CNBC in December that company polling found that one of the most effective ways to increase confidence in the vaccine was to have the CEO take it.