Sign up for our daily briefing

Make your busy days simpler with Axios AM/PM. Catch up on what's new and why it matters in just 5 minutes.

Please enter a valid email.

Please enter a valid email.

Subscription failed
Thank you for subscribing!

Catch up on coronavirus stories and special reports, curated by Mike Allen everyday

Catch up on coronavirus stories and special reports, curated by Mike Allen everyday

Please enter a valid email.

Please enter a valid email.

Subscription failed
Thank you for subscribing!

Denver news in your inbox

Catch up on the most important stories affecting your hometown with Axios Denver

Please enter a valid email.

Please enter a valid email.

Subscription failed
Thank you for subscribing!

Des Moines news in your inbox

Catch up on the most important stories affecting your hometown with Axios Des Moines

Please enter a valid email.

Please enter a valid email.

Subscription failed
Thank you for subscribing!

Minneapolis-St. Paul news in your inbox

Catch up on the most important stories affecting your hometown with Axios Twin Cities

Please enter a valid email.

Please enter a valid email.

Subscription failed
Thank you for subscribing!

Tampa Bay news in your inbox

Catch up on the most important stories affecting your hometown with Axios Tampa Bay

Please enter a valid email.

Please enter a valid email.

Subscription failed
Thank you for subscribing!

Charlotte news in your inbox

Catch up on the most important stories affecting your hometown with Axios Charlotte

Please enter a valid email.

Please enter a valid email.

Subscription failed
Thank you for subscribing!

Please enter a valid email.

Please enter a valid email.

Subscription failed
Thank you for subscribing!

Current machine learning models aren't yet up to the task of distinguishing false news reports, two new papers by MIT researchers show.

The big picture: After different researchers showed that computers can convincingly generate made-up news stories without much human oversight, some experts hoped that the same machine-learning-based systems could be trained to detect such stories. But MIT doctoral student Tal Schuster's studies show that, while machines are great at detecting machine-generated text, they can't identify whether stories are true or false.

Details: Many automated fact-checking systems are trained using a database of true statements called Fact Extraction and Verification (FEVER).

  • In one study, Schuster and team showed that machine learning-taught fact-checking systems struggled to handle negative statements ("Greg never said his car wasn't blue") even when they would know the positive statement was true ("Greg says his car is blue").
  • The problem, say the researchers, is that the database is filled with human bias. The people who created FEVER tended to write their false entries as negative statements and their true statements as positive statements — so the computers learned to rate sentences with negative statements as false.
  • That means the systems were solving a much easier problem than detecting fake news. "If you create for yourself an easy target, you can win at that target," said MIT professor Regina Barzilay. "But it still doesn't bring you any closer to separating fake news from real news."
  • Both studies were headed by Schuster with teams of MIT collaborators.

The bottom line: The second study showed that machine-learning systems do a good job detecting stories that were machine-written, but not at separating the true ones from the false ones.

Yes, but: While you can generate bogus news stories more efficiently using automated text, not all stories created by automated processes are untrue.

Go deeper

Netflix tops 200 million global subscribers

Illustration: Rebecca Zisser/Axios

Netflix said that it added another 8.5 million global subscribers last quarter, bringing its total number of paid subscribers globally to more than 200 million.

The big picture: Positive fourth-quarter results show Netflix's resiliency, despite increased competition and pandemic-related production headwinds.

Janet Yellen plays down debt, tax hike concerns in confirmation hearing

Treasury Secretary nominee Janet Yellen at an event in December. Photo: Alex Wong via Getty Images

Janet Yellen, Biden's pick to lead the Treasury Department, pushed back against two key concerns from Republican senators at her confirmation hearing on Tuesday: the country's debt and the incoming administration's plans to eventually raise taxes.

Driving the news: Yellen — who's expected to win confirmation — said spending big now will prevent the U.S. from having to dig out of a deeper hole later. She also said the Biden administration's priority right now is coronavirus relief, not raising taxes.

Trump gives farewell address: "We did what we came here to do"

Photo: Mandel Ngan/AFP via Getty Images

President Trump gave a farewell video address on Tuesday, saying that his administration "did what we came here to do — and so much more."

Why it matters, via Axios' Alayna Treene: The address is very different from the Trump we've seen in his final weeks as president — one who has refused to accept his loss, who peddled conspiracy theories that fueled the attack on the Capitol, and who is boycotting his successor's inauguration.