Sign up for our daily briefing

Make your busy days simpler with Axios AM/PM. Catch up on what's new and why it matters in just 5 minutes.

Please enter a valid email.

Please enter a valid email.

Subscription failed
Thank you for subscribing!

Catch up on the day's biggest business stories

Subscribe to Axios Closer for insights into the day’s business news and trends and why they matter

Please enter a valid email.

Please enter a valid email.

Subscription failed
Thank you for subscribing!

Stay on top of the latest market trends

Subscribe to Axios Markets for the latest market trends and economic insights. Sign up for free.

Please enter a valid email.

Please enter a valid email.

Subscription failed
Thank you for subscribing!

Sports news worthy of your time

Binge on the stats and stories that drive the sports world with Axios Sports. Sign up for free.

Please enter a valid email.

Please enter a valid email.

Subscription failed
Thank you for subscribing!

Tech news worthy of your time

Get our smart take on technology from the Valley and D.C. with Axios Login. Sign up for free.

Please enter a valid email.

Please enter a valid email.

Subscription failed
Thank you for subscribing!

Get the inside stories

Get an insider's guide to the new White House with Axios Sneak Peek. Sign up for free.

Please enter a valid email.

Please enter a valid email.

Subscription failed
Thank you for subscribing!

Axios on your phone

Get breaking news and scoops on the go with the Axios app.

Download for free.

Catch up on coronavirus stories and special reports, curated by Mike Allen everyday

Catch up on coronavirus stories and special reports, curated by Mike Allen everyday

Please enter a valid email.

Please enter a valid email.

Subscription failed
Thank you for subscribing!

Want a daily digest of the top Denver news?

Get a daily digest of the most important stories affecting your hometown with Axios Denver

Please enter a valid email.

Please enter a valid email.

Subscription failed
Thank you for subscribing!

Want a daily digest of the top Des Moines news?

Get a daily digest of the most important stories affecting your hometown with Axios Des Moines

Please enter a valid email.

Please enter a valid email.

Subscription failed
Thank you for subscribing!

Want a daily digest of the top Twin Cities news?

Get a daily digest of the most important stories affecting your hometown with Axios Twin Cities

Please enter a valid email.

Please enter a valid email.

Subscription failed
Thank you for subscribing!

Want a daily digest of the top Tampa Bay news?

Get a daily digest of the most important stories affecting your hometown with Axios Tampa Bay

Please enter a valid email.

Please enter a valid email.

Subscription failed
Thank you for subscribing!

Want a daily digest of the top Charlotte news?

Get a daily digest of the most important stories affecting your hometown with Axios Charlotte

Please enter a valid email.

Please enter a valid email.

Subscription failed
Thank you for subscribing!

Sign up for Axios NW Arkansas

Stay up-to-date on the most important and interesting stories affecting NW Arkansas, authored by local reporters

Please enter a valid email.

Please enter a valid email.

Subscription failed
Thank you for subscribing!

Please enter a valid email.

Please enter a valid email.

Subscription failed
Thank you for subscribing!

Illustration: Rebecca Zisser/Axios

Some scientists are calling on the Food and Drug Administration to establish standards for advanced algorithms that are developing at a "staggering" pace before they are put in medical devices to help predict patients' outcomes.

What's new: Advanced algorithms are starting to be deployed in some devices to help provide automated real-time predictions, but these offer a whole new level of possibilities and challenges from older predictive tools. Standards are needed to check for safety and effectiveness before they are implemented in a clinical setting, the scientists say in a policy forum in Science Thursday.

The FDA tells Axios it is working on developing a framework to handle advances in AI and medicine, as pointed out by Commissioner Scott Gottlieb last year. While unable to comment on this paper, a spokesperson says the FDA has used its current process for novel medical devices to authorize these AI algorithms:

  • Viz.ai for helping providers detect stroke in CT scans.
  • IDx-DR for detecting diabetic retinopathy.
  • OsteoDetect for detecting bone fractures.

Meanwhile, Ravi B. Parikh, co-author of the paper and a fellow at University of Pennsylvania's School of Medicine, tells Axios that the FDA needs to set standards to evaluate the "staggering" pace of AI development. He adds:

"Five years ago, AI and predictive analytics had yet to make a meaningful impact in clinical practice. In just the past 2-3 years, premarket clearances have been granted for AI applications ranging from sepsis prediction to radiology interpretation."
"But if these tools are going to be used to determine patient care ... they should meet standards of clinical benefit just as the majority of our drugs and diagnostic tests do. We think being proactive in creating and formalizing these standards is essential to protecting patients and safely translating algorithms to clinical interventions."

Why it matters: Advanced algorithms present both opportunities and challenges, says Amol S. Navathe, co-author and assistant professor at Penn's School of Medicine. He tells Axios:

"The real opportunity is that these algorithms outperform clinicians in medical decisions, not a small feat. The challenge is that the data generated for algorithms is not randomly generated, rather, most of [what] the data algorithms 'see' is a result of a human decision. We have a ways to go in our scientific approaches to overcome this challenge and uniformly develop algorithms that can help improve upon human clinician decisions."

Details: The authors list the following as recommended standards...

  1. Meaningful endpoints for clinical benefit from the algorithms should be rigorously validated by the FDA, such as downstream outcomes like overall survival or clinically relevant metrics like the number of misdiagnoses.
  2. Appropriate benchmarks should be determined, similar to the recent example of the FDA approving Viz.AI, the deep-learning algorithm for diagnosing strokes, after it was able to diagnose strokes on computed tomography imaging more rapidly than neuroradiologists.
  3. Variable input specifications should be clarified for all institutions, such as defining inputs for electronic health records so results are reliable across institutions. Plus, algorithms should be trained on data sources from as broadly representative populations as possible so they are generalizable across all populations.
  4. Guidance on possible interventions that would be connected to an algorithm's findings to improve patient care should be considered.
  5. Run rigorous audits after FDA clearance or approval, particularly to check on how the new variables included by deep-learning may have altered its performance over time. For instance, regular audits could find the algorithm had a systematic bias against certain groups after being deployed across large populations. This could be tracked in a manner similar to the current FDA Sentinel Initiative program for approved drugs and devices.

Outside comment: Eric Topol, founder and director of Scripps Research Translational Institute, who was not part of this paper, says the timing of these proposed standards is "very smart" before advanced algorithms are placed into too many devices.

  • "[The algorithm] doesn't translate necessarily into helping people," Topol tells Axios. "It can actually have no benefit."
  • Even worse, he adds, if the variables are off, the predictive analyses can have negative ramifications.

What's next: The scientists hope the FDA considers integrating the proposed standards alongside its current pre-certification program under the Digital Health Innovation Act to study clinical outcomes of AI-based tools, Ravi says.

Go deeper

Laurel Hubbard to become 1st openly trans athlete to compete at Olympics

New Zealand's Laurel Hubbard at the Gold Coast 2018 Commonwealth Games in Australia, when she became the first openly transgender athlete to represent NZ. Photo: Scott Barbour/Getty Images

The New Zealand Olympic Committee has announced that Laurel Hubbard has been selected for the women's weightlifting team for the Tokyo Games — making her the first openly transgender athlete to compete at the event.

The big picture: Hubbard, 43, is part of a five-member Kiwi weightlifting team and will compete in the women's super heavyweight category. Meanwhile, BMX rider Chelsea Wolfe will become the first openly trans athlete to travel to the Olympics with Team USA, when she arrives in Tokyo as a reserve rider.

American Airlines cuts hundreds of flights amid demand surge

Photo: Joe Raedle/Getty Images

American Airlines announced Sunday that it's cutting some 950 flights from its schedule, including 296 this weekend, to reduce potential pressure on its operations, the Wall Street Journal first reported.

Driving the news: The U.S. vaccine rollout has led to a massive increase in travel bookings. The airline noted in an emailed statement that it's facing an "incredibly quick ramp up of customer demand."

Updated 4 hours ago - Politics & Policy

Florida Pride parade fatal crash a "tragic accident," police say

Participants walk away as police investigate the scene where a pickup truck drove into a crowd of people at a Pride parade in Wilton Manors, Florida, on Saturday. Photo: Jason Koerner/Getty Images

Police said Sunday they believe a driver unintentionally hit spectators at a weekend Pride parade in Wilton Manors, Florida, resulting in the death of one man and leaving another person hospitalized.

The latest: Addressing speculation that the crash may have been a hate crime against the LGBTQ community, Wilton Manors police chief Gary Blocker said in a statement: "Today we know yesterday's incident was a tragic accident, and not a criminal act directed at anyone, or any group of individuals."