Illustration: Sarah Grillo/Axios

Businesses facing unprecedented demands during the coronavirus pandemic have boosted their use of artificial intelligence in some of society's most sensitive areas.

Why it matters: Algorithms and the data they rely on are prone to automating preexisting biases — and are more likely to do so when they're rushed into the field without careful testing and review.

Driving the news:

  • Twitter and Facebook have been relying far more on AI to moderate content. Many of the contractors who normally handle such tasks are not able to go into the office, and the companies don't want the work done remotely so they can keep close tabs on sensitive user data.
  • Walmart associates have voiced concern that the AI being used at self-checkout is flagging appropriate behavior as potential wrongdoing and missing actual theft.
  • A need for fast results in the earliest days of the pandemic pushed adoption of novel uses of AI in tracking the virus' spread and speeding its diagnosis. But health care data leaves out big parts of the population and has historically been rife with bias.

The big picture: Beyond these examples, experts worry that the economy's sudden halt has driven resource-strapped companies and institutions to increasingly rely on algorithms to make decisions in housing, credit, employment and other areas.

Key areas of accelerating AI adoption:

  • Employment: It's concerning enough that algorithms are used to screen applicants, but a new concern is how companies might use AI to also decide who gets cut when companies are reducing staff. Amazon came under fire for using an algorithm in the past to decide which warehouse workers should be terminated for low productivity.
  • Policing: As nationwide protests shine a spotlight on abuses in policing, AI algorithms for predictive policing are being increasingly deployed in the field, even though critics say they worsen and codify racial profiling and other problems.
  • Housing: AI-driven algorithms are playing a greater role in housing decision like landlords' choice of tenants and banks' approval of loans. As in many areas, AI holds potential to aid people of color and others who have historically faced discrimination on this front — but only if enough care is taken with both algorithms and training data.
  • COVID-19 itself: AI is playing a role in the response to the disease in everything from vaccine trials to the selection of populations for public outreach to decisions over who can be safely treated at home via telehealth services. AI can help speed care, but providers need to pay attention to which groups are likely to be underrepresented in the data used to train algorithms, along with other patterns of inequality embedded in existing systems of care.

Between the lines: If you are going to use AI in making meaningful decisions, experts recommend making sure a diverse group of people is involved in reviewing everything from the algorithm design to the training data to the way the system will be deployed and evaluated.

  • Experts also caution that using pre-COVID data to make decisions today could produce flawed results, given how much the world has changed.
  • "Some data is still relevant, other data isn’t," says McGill University professor Matissa Hollister.

Yes, but: Hollister notes that adding humans to the mix isn't a cure-all, either, given that humans have plenty of bias as well.

Meanwhile: A number of companies have hit the pause button on police use of AI-driven face recognition systems, including Amazon, Microsoft and IBM, which is getting out of the commercial face recognition business entirely.

What's next: Expect a wave of lawsuits from consumers contending that they were discriminated against by AI systems, especially in key areas such as hiring.

  • "The law is very clear you cannot discriminate in employment decisions," Vogel said.
  • While that principle hasn’t been widely applied to AI programs yet, Vogel said, that's largely because the technology is so new. "People can fully expect the lawyers are going to get up to speed," Vogel said.

Go deeper

Updated 3 mins ago - Politics & Policy

Coronavirus dashboard

Illustration: Aïda Amer/Axios

  1. Global: Total confirmed cases as of 7 a.m. ET: 11,288,094 — Total deaths: 531,244 — Total recoveries — 6,075,489Map.
  2. U.S.: Total confirmed cases as of 7 a.m. ET: 2,839,917 — Total deaths: 129,676 — Total recoveries: 894,325 — Total tested: 34,858,427Map.
  3. States: Photos of America's pandemic July 4 ICU beds in Arizona hot spot near capacity.
  4. Public health: U.S. coronavirus infections hit record highs for 3 straight days.
  5. Politics: Trump extends PPP application deadlineKimberly Guilfoyle tests positive.
  6. World: Mexican leaders call for tighter border control as infections rise in U.S.
  7. Sports: 31 MLB players test positive as workouts resume.
  8. 1 📽 thing: Drive-in movie theaters are making a comeback.

Protester dies after car drives through closed highway in Seattle

Protesters gather on Interstate 5 on June 23, 2020 in Seattle, Washington. Photo: David Ryder/Getty Images

One person is dead and another is in serious condition after a car drove onto a closed freeway in Seattle early Saturday and into protesters against police brutality, AP reports.

  • "Summer Taylor, 24, of Seattle died in the evening at Harborview Medical Center, spokesperson Susan Gregg said."

Where it stands: The suspect, Dawit Kelete of Seattle, fled the scene after hitting the protesters, and was later put in custody after another protester chased him for about a mile. He was charged with two counts of vehicular assault. Officials told the AP they did not know whether it was a targeted attack, but the driver was not impaired.

Trump's failing culture wars

Data: Google; Chart: Naema Ahmed/Axios

President Trump built his political brand by stoking the nation's culture wars, but search data is showing us how much harder it's been for him to replicate that success while running against another white man in his 70s — and while there's a coronavirus pandemic.

The big picture: Google Trends data shows Trump's "Sleepy Joe" name-calling isn't generating nearly the buzz "Crooked Hillary" (or "Little Marco") did in 2016. Base voters who relished doubting President Obama's birth certificate aren't questioning Biden's.