Illustration: Sarah Grillo/Axios

Deepfakes — realistic AI-generated audio, video, and images — are denounced as a threat to democracy and society by experts and lawmakers. So why are academics producing research that advances them?

Why it matters: Increasingly accessible tools for creating convincing fake videos are a "deadly virus," said Hany Farid, a digital-forensics expert at Dartmouth. "Worldwide, a lot of governments are worried about this phenomenon. I don't think this has been overblown."

Academic researchers are rapidly creating new methods for faking videos, photos, and audio. But they say their goal is not to destroy democracy, but to make new tools for creativity, and help improve other emerging technologies.

  • They call the technology "synthetic content generation."
  • In its benign form, researchers say, the techniques can be used in filmmaking, dubbing, or virtual reality, and also as training data to improve self-driving cars.
  • But they acknowledge that there is serious potential for harm when the technology is misapplied. In a paper published this summer, a pair of law scholars wrote:
"The volume and sophistication of publicly available academic research and commercial services will ensure the steady diffusion of deepfake capacity no matter efforts to safeguard it."
— University of Texas professor Bobby Chesney and University of Maryland professor Danielle Citron

Axios reached out to several academics who have published recent research that could be used to create deepfakes. Two responded.

  • Caroline Chan, an MIT graduate student who as a UC Berkeley undergrad created a system to simulate body movements in videos, said her research group has also worked on methods of detecting digital forgeries.
  • "As a community it is important to us to both advance the state of the art in content creation and be able to separate fake from real content with high confidence," she told Axios.

Aayush Bansal, a PhD candidate at Carnegie Mellon University, developed a technique to replace one person’s face with another's in a video.

  • But he said that it had positive as well as negative potential uses: One way of improving systems that aim to detect faked videos is by pursuing new ways of generating them, he said.
  • "Since these new approaches essentially work by learning a model of what real data looks like, they are also very good at detecting fake content that was manipulated in any way or created from thin air," said Chan.

Go deeper:

Go deeper

Axios-Ipsos poll: Federal response has only gotten worse

Data: Axios/Ipsos poll; Note ±3.3% margin of error for the total sample size; Chart: Andrew Witherspoon/Axios

Americans believe the federal government's handling of the pandemic has gotten significantly worse over time, according to the latest installment of the Axios/Ipsos Coronavirus Index.

Why it matters: Every other institution measured in Week 29 of our national poll — from state and local governments to people's own employers and area businesses — won positive marks for improving their responses since those panicked early days in March and April.

Updated 2 hours ago - Politics & Policy

Coronavirus dashboard

Illustration: Sarah Grillo/Axios

  1. Politics: The swing states where the pandemic is raging — Pence no longer expected to attend Barrett confirmation vote after COVID exposure.
  2. Health: 13 states set single-day case records last week
  3. Business: Where stimulus is needed most.
  4. Education: The dangerous instability of school re-openings.
  5. States: Nearly two dozen Minnesota COVID cases traced to 3 Trump campaign events
  6. World: Unrest in Italy as restrictions grow across Europe.
  7. Media: Fox News president and several hosts advised to quarantine.
Updated 2 hours ago - Politics & Policy

Republicans and Dems react to Coney Barrett's Supreme Court confirmation

President Trump stands with Judge Amy Coney Barrett after she took the constitutional oath to serve as a Supreme Court justice during a White House ceremony Monday night .Photo: Tasos Katopodis/Getty Images)

President Trump said Judge Amy Coney Barrett's Senate confirmation to the Supreme Court and her subsequent taking of the constitutional oath Monday was a "momentous day," as she she vowed to serve "without any fear or favour."

Of note: As Republicans applauded the action, Democratic leaders warned of consequences to the rush to replace the late liberal Justice Ruth Bader Ginsburg with a conservative so close to the election, as progressives led calls to expand the court.