Data: Primer AI; Chart: Axios Visuals

New and old machine-learning tools are helping scientists sift through the flood of research produced on COVID-19.

Why it matters: The coronavirus pandemic has led to an unprecedented wave of scientific publications on every aspect of the virus and potential treatments.

  • But without better tools to pick out meaningful research, it's too easy to miss the science that matters — or be misled by headline-grabbing papers that turn out to be wrong.

By the numbers: According to the COVID-19 Primer, a public dashboard created by the machine-learning company Primer AI, researchers had published 27,569 papers about COVID-19 as of June 17.

  • Of those, 21,000 went through the scientific peer review process, meaning that experts in the field have examined the publications and researchers have more confidence in the results. 6,569 are what are known as preprint papers, meaning they were put out to the public before the peer review process.
  • "The volume is so great that what's being published on COVID is equal to all the other research that is usually being put on infectious disease as a whole," says Uri Blackman, CEO of GIDEON Informatics, which has put out medical databases since 1992.
  • It is impossible for a human being to keep up with all that science. Even if it only took an average of 15 minutes to read each paper, getting through all of them would require 287 days of nonstop reading, or more than 100 days longer than the outbreak itself.

How it works: That's where machine-learning tools come in.

  • While current AI can't understand a scientific paper in the way that a trained human being can, it is capable of categorizing and ordering it in a way that reveals useful patterns. And it can do so much quicker than any human being can.
  • The COVID-19 Primer takes in news articles and social media interactions that reference papers and their authors, which allows a user to quickly see which papers are getting the most attention from experts and average people alike.
  • Papers can also be sorted through research categories like "patient and medical care" or "forecasts and modeling," and the algorithms behind the tool can also identify topics of interest that emerge from the entire corpus of research.

The catch: There are still major limits to AI's ability to actually comprehend written text of any kind, including scientific publications. That means the COVID-19 Primer and similar tools can't tell you the real value of any individual paper, just how it's being received in the news and on social media.

  • In fact, says Amy Heineike of Prime AI, "the most shared papers are the most controversial ones." She notes that the second-most-shared paper since the start of the outbreak was a preprint publication from the end of January arguing the novel coronavirus appeared to contain genes from the HIV virus, with the implication that the virus was deliberately engineered.
  • The paper — which like all preprints wasn't peer reviewed — was quickly torn apart by experts online, and was withdrawn by its authors just a few days after it was posted. But 20% of the tweets about the paper were posted in the days and weeks after its withdrawal, which was seen by many online as evidence of a conspiracy to suppress its conclusions.

The bottom line: Science is moving faster than ever on COVID-19, and AI can be a valuable tool to making sense of it all. But machines can't yet be a replacement for human judgment.

Go deeper: Fresh concerns about AI bias in the age of COVID-19

Go deeper

Sep 22, 2020 - Health

U.S. reaches 200,000 coronavirus deaths

Expand chart
Data: The Center for Systems Science and Engineering at Johns Hopkins; Chart: Axios Visuals

The coronavirus has now killed 200,000 Americans, according to Johns Hopkins data.

The big picture: Whatever context you try to put this in, it is a catastrophe of historic proportions — and is yet another reminder of America's horrific failure to contain the virus.

Sep 22, 2020 - Health

CDC releases holiday season guidance to curb COVID-19 spread

Illustration: Annelise Capossela/Axios

The Centers for Disease Control and Prevention issued holiday-specific guidelines this week to limit COVID-19 risks posed by gatherings and celebrations prior to the fall and winter holidays.

Why it matters: With the flu season just around the corner, medical experts are worried about the likelihood of battling COVID-19 and influenza at the same time. The coronavirus has now killed 200,000 Americans, and the U.S. is averaging roughly 830 per day. Cases and deaths could worsen again as the weather gets colder and people move indoors.

Sep 22, 2020 - Health

Axios-Ipsos poll: Vaccine resistance grows

Data: Axios/Ipsos surveys. 1,100 U.S adults surveyed Aug. 28-31, 2020, and 1,008 U.S. adults surveyed Sept. 18-21,2020; Chart: Axios Visuals

The share of Americans eager to try a first-generation coronavirus vaccine dropped significantly in the latest installment of the Axios-Ipsos Coronavirus Index, as President Trump hyped suggestions that one could be ready before the election.

Why it matters: As the U.S. reaches a milestone of 200,000 deaths, this underscores the risks of politicizing the virus and its treatments.

Get Axios AM in your inbox

Catch up on coronavirus stories and special reports, curated by Mike Allen everyday

Please enter a valid email.

Subscription failed
Thank you for subscribing!