Illustration: Sarah Grillo/Axios

Tech giants, startups and academic labs are pumping out datasets and detectors in hopes of jump-starting the effort to create an automated system that can separate real videos, images and voice recordings from AI forgeries.

Why it matters: Algorithms that try to detect deepfakes lag behind the technology that creates them — a worrying imbalance given the technology's potential to stir chaos in an election or an IPO.

Driving the news: Dessa, the AI company behind the hyper-convincing fake Joe Rogan voice from earlier this summer, published a tool today for detecting deepfake audio — the kind that recently scammed a CEO out of $240,000.

  • The new detector, which Axios is reporting first, is open source, so anybody can go through the code for free to understand and potentially improve it.
  • But the company gets something out of it: The detector is built on a Dessa platform, which you have to download (without paying) to set it up.

The big picture: There's an all-hands scramble for better detectors, which generally require a lot of really good examples of deepfakes. Researchers use them to train algorithms that can tell if media was created by AI.

  • Yesterday, SUNY Albany deepfake expert Siwei Lyu released a dataset filed with celebrity deepfakes.
  • Earlier in the week, Google and Jigsaw — both owned by parent company Alphabet — released a large set of video deepfakes.
  • And earlier this month, Facebook, Microsoft and the Partnership on AI teamed up with academic researchers to release more deepfake videos — and offer a prize to the team that uses them to make the best detector.

Unlike these datasets, which allow researchers to cook up their own detectors, Dessa is releasing a pre-baked system — which has advantages and risks.

  • The company felt a responsibility to release an antidote after it made the realistic Rogan voice, says Ragavan Thurairatnam, Dessa's co-founder.
  • "I think it's inevitable that malicious actors are going to move much faster than those who want to stop it," he tells Axios. The free detector is a "starting point" for people to push detection forward.

But, but, but: Thurairatnam acknowledged that an open-source detector could help a particularly determined troll create new audio fakes that fool it. That's because generative AI systems can be trained to trick a specific detector.

  • He argues that the potential for creating better detectors outweighs the probability that someone will misuse Dessa's code.
  • But Lyu of SUNY Albany says there's some reason to worry. "In principle, such code will help both but probably more for making better generators."

Go deeper: Researchers struggle with containing potentially harmful AI

Go deeper

Updated 18 mins ago - Technology

Facebook, Twitter take down Trump post saying kids are immune to coronavirus

Photo: NurPhoto/Getty Images

Facebook removed a video post from President Trump Wednesday in which he claimed in an interview with Fox News that children are "almost immune" to COVID-19.

Why it matters: It’s the first time that Facebook has removed content from Trump's account for violating policies on coronavirus-related misinformation.

Updated 50 mins ago - Politics & Policy

Trump campaign out-raises Biden's by $20 million in July

Combination images of President Trump and former Vice President Joe Biden. Photo: Alex Wong/Getty Images/Mark Makela/Getty Images

President Trump's re-election campaign and the Republican National Committee announced on Wednesday they collectively raised $165 million in July.

Why it matters: With 90 days until the election, Trump and the RNC outpaced the Biden campaign, the Democratic National Committee and their joint fundraising committees, who announced earlier Wednesday that they raised $140 million last month.

Updated 2 hours ago - Politics & Policy

Coronavirus dashboard

Illustration: Eniola Odetunde/Axios

  1. Global: Total confirmed cases as of 6:30 p.m. ET: 18,643,633 — Total deaths: 703,127 — Total recoveries — 11,206,409Map.
  2. U.S.: Total confirmed cases as of 6:30 p.m. ET: 4,811,128 — Total deaths: 157,690 — Total recoveries: 1,528,979 — Total tests: 58,239,438Map.
  3. Public health: Florida surpasses 500,000 confirmed casesFauci calls U.S. coronavirus testing delays "totally unacceptable."
  4. Business: America's next housing crisis.
  5. States: Virginia launches contact tracing app using specs from Apple and Google.
  6. Politics: White House, Democrats remain "trillions of dollars apart" on stimulus talks.