May 1, 2019

How bias creeps into health care AI

Illustration: Sarah Grillo/Axios

Many health-related AI technologies today are biased because they're built on datasets largely comprised of men and individuals of European descent.

Why it matters: An AI system trained to identify diseases, conditions and symptoms in people in these datasets could fail when presented with data from people with different characteristics.

Background: AI-powered disease detection technology is part of the health care AI market expected to exceed $34 billion by 2025.

  • Researchers recently demonstrated that AI used in breast cancer screenings correctly identified more cancers, reduced false positives and improved reading times.

What's happening: Most medical research tends to focus on men, and most genetic data publicly available is from individuals of European descent. As AI is increasingly used in medicine, it could result in misdiagnoses of patients based on their gender, race and/or ethnicity.

  • While heart attacks generally strike men and women equally, they are more likely to be fatal in women, which can be caused by a delay in care due to gender-based differences in symptoms.
  • Similarly, if a person is not of European descent, AI medical technologies may incorrectly diagnose that person, as their symptoms and disease manifestations could differ
  • Recent studies and mishaps have shown that our current data and programs that rely on AI, like search engines and image recognition software, are biased in ways that can cause harm.

What we're watching: Some steps are being taken to ensure that AI is evaluated for bias, including proposed legislation.

  • The National Institutes of Health launched a new program last year to expand diversity in medical research and data by soliciting volunteers from populations that are currently underrepresented.

Go deeper: Scientists call for rules on evaluating predictive AI in medicine

Miriam Vogel is the executive director of Equal AI, a professor at Georgetown Law and a former associate deputy attorney general at the Department of Justice.

Go deeper

Coronavirus dashboard

Illustration: Aïda Amer/Axios

  1. Global: Total confirmed cases as of 8 p.m. ET: 1,595,350 — Total deaths: 95,455 — Total recoveries: 353,975Map.
  2. U.S.: Total confirmed cases as of 8 p.m. ET: 461,437 — Total deaths: 16,478 — Total recoveries: 25,410Map.
  3. Public health latest: U.S. has expelled thousands of migrants under a CDC public health orderDr. Anthony Fauci said social distancing could reduce the U.S. death toll to 60,000.
  4. Business latest: The Fed will lend up to $2.3 trillion for businesses, state and city governments — After another 6.6 million jobless claims, here's how to understand the scale of American job decimation.
  5. States latest: FEMA has asked governors to decide if they want testing sites to be under state or federal control.
  6. World latest: Lockdowns have led to a decline in murders in some of the world's most violent countries — Boris Johnson is moved out of the ICU but remains in hospital with coronavirus.
  7. In Congress: Senate in stalemate over additional funding for small business relief program.
  8. 1 SNL thing: "Saturday Night Live" will return to the air this weekend with a remotely produced episode.
  9. What should I do? Hydroxychloroquine questions answeredPets, moving and personal healthAnswers about the virus from Axios expertsWhat to know about social distancingQ&A: Minimizing your coronavirus risk.
  10. Other resources: CDC on how to avoid the virus, what to do if you get it.

Subscribe to Mike Allen's Axios AM to follow our coronavirus coverage each morning from your inbox.

Federal court temporarily blocks coronavirus order against some abortions

Gov. Greg Abbott. Photo: Tom Fox-Pool/Getty Images

A federal judge ruled Thursday that clinics in Texas can immediately offer medication abortions — a pregnancy termination method administered by pill — and can also provide the procedure to patients nearing the state's time limits for abortions.

Driving the news: The decision comes after federal appeals court ruled 2-1 on Tuesday in favor of an executive order by Republican Gov. Greg Abbott that prohibits abortions during the coronavirus outbreak.

Go deeperArrowUpdated 1 hour ago - Politics & Policy

The view from the other side of the coronavirus peak

We'll soon be crowding into cafes it's 1954 in Rapallo, Italy. Photo: LIFE Picture Collection via Getty

Europeans and Americans are desperate to move beyond the worst of the crisis and return to something approximating normality, but the World Health Organization is cautioning that moving too fast will undermine the sacrifices made so far.

Where things stand: Nearly every country on Earth is still seeing their caseload increase, and a recent uptick in Singapore shows that apparent victory over the virus can be fleeting. But several countries are providing reason for optimism.

Go deeperArrow2 hours ago - World