Jul 19, 2019

The coming deepfakes threat to businesses

Illustration: Rebecca Zisser/Axios

In the first signs of a mounting threat, criminals are starting to use deepfakes — starting with AI-generated audio — to impersonate CEOs and steal millions from companies, which are largely unprepared to combat them.

Why it matters: Nightmare scenarios abound. As deepfakes grow more sophisticated, a convincing forgery could send a company's stock plummeting (or soaring), to extract money or to ruin its reputation in a viral instant.

  • Imagine a convincing fake video or audio clip of Elon Musk, say, disclosing a massive defect the day before a big Tesla launch — the company's share price would crumple.

What's happening: For all the talk about fake videos, it's deepfake audio that has emerged as the first real threat to the private sector.

  • Symantec, a major cybersecurity company, says it has seen three successful audio attacks on private companies. In each, a company's "CEO" called a senior financial officer to request an urgent money transfer.
  • Scammers were mimicking the CEOs' voices with an AI program that had been trained on hours of their speech — culled from earnings calls, YouTube videos, TED talks and the like.
  • Millions of dollars were stolen from each company, whose names were not revealed. The attacks were first reported in the BBC.

And in March, a Twitter account falsely claiming to belong to a Bloomberg journalist reportedly tried to coax personal information from Tesla short-sellers. Amateur sleuths said the account's profile photo had the hallmarks of an AI-generated image.

Big picture: This threat is just beginning to emerge. Video and audio deepfakes are improving at a frightening pace and are increasingly easy to make.

  • There's been an uptick in sophisticated audio attacks over the past year, says Vijay Balasubramaniyan, CEO of Pindrop, a company that protects call centers from scammers.
  • But businesses aren't ready, experts tell Axios. "I don’t think corporate infrastructure is prepared for a world where you can’t trust the voice or video of your colleague anymore," says Henry Ajder of Deeptrace, a deepfakes-detection startup.

Even if companies were clamoring for defenses, few tools exist to keep harmful deepfakes at bay, says Symantec's Saurabh Shintre. The challenge of automatically spotting a deepfake is almost insurmountable, and there are hurdles still ahead for a promising alternative: creating a digital breadcrumb trail for unaltered media.

  • Pindrop monitors for audio attacks like altered voices on customer service lines.
  • Symantec and ZeroFOX, another cybersecurity company, say they are developing technology to detect audio fakes.

What's out there already isn't cheap.

  • New Knowledge, a firm that defends companies from disinformation, says its services can run from $50,000 to "a couple million" a year.
  • Just monitoring the internet for potential fakes comes at "a substantial cost," says Matt Price of ZeroFOX. "And that's not even talking about the detection piece, which will probably be fairly expensive."

As a result, businesses are largely defenseless for now, leaving an opening for a well-timed deepfake to drop like a bomb.

  • "If you're waiting for it to happen, you're already too late," New Knowledge COO Ryan Fox tells Axios.

Go deeper: Companies take the battle to online mobs

Go deeper

Deaths without consequences

Community organizations and activists demand police accountability at a rally in Grand Central Terminal to commemorate the 5-year anniversary of Mike Brown's death by Ferguson Police Officer Darren Wilson. Photo: Erik McGregor/Getty Images

Seven years after the launch of the Black Lives Matter movement, it's still rare for police officers to be charged in the deaths of African Americans — and even more rare for an officer to go to jail.

The big picture: The Minneapolis police officer who was captured on video kneeling on George Floyd's neck has been charged with third-degree murder and manslaughter — which is already a step beyond the consequences other police officers have faced. But it's no guarantee that he will face jail time.

Teenager killed after shots fired at protesters in Detroit

Detroit police during protests on Friday night. Photo: Matthew Hatcher/Getty Images

A 19-year-old man was killed on Friday night after shots were fired into a crowd of demonstrators in downtown Detroit who were protesting the death of George Floyd in Minneapolis police custody, per AP.

Details: The teenager was injured when shots were fired from an SUV about 11:30 p.m. and later died in hospital, reports MDN reports, which noted police were still looking for a suspect. Police said officers were not involved in the shooting, according to AP.

Go deeper: In photos: Protesters clash with police nationwide over George Floyd

Updated 7 hours ago - Politics & Policy

In photos: Protesters clash with police nationwide over George Floyd

Police officers grapple with protesters in Atlanta. Photo: Elijah Nouvelage/Getty Images

Police used tear gas, rubber bullets and pepper spray as the protests sparked by the killing of George Floyd spread nationwide on Friday evening.

The big picture: Police responded in force in cities ranging from Atlanta to Des Moines, Houston to Detroit, Milwaukee to D.C. and Denver to Louisville. In Los Angeles, police declared a stretch of downtown off limits, with Oakland issuing a similar warning.