A job interview in 1935. Photo: Ullstein Bild via Getty Images

Once, a misguided tweet or racist Facebook post from years ago might have avoided a hiring manager’s notice. But now, artificial intelligence is leaving no tweet unread in the search for job candidates' bad online behavior.

Why it matters: Companies are placing applicants under a high-powered microscope as they seek to avoid hiring employees who might create a toxic environment or harm the firm's image. But it's also limiting employee opportunities.

In February, the NYT fired writer Quinn Norton within hours of announcing her hiring. In that time, several old tweets surfaced in which she had used or amplified racist and homophobic slurs.

  • The Times said it had not previously seen the tweets — several needles in a haystack of Norton’s nearly 90,000 messages.
  • This is the sort of public fiasco companies would rather avoid. But while HR can’t sift through a candidate’s entire Twitter timeline, a machine can.

Enter the algorithms. Several companies offer to set the pattern-matching power of AI on the social feeds of job hopefuls to uncover posts that are racist, sexist, violent, or otherwise objectionable.

  • Fama contracts with about 100 companies, each with more than 1,000 employees. For each online check, it returns a report with links to offending posts.
  • Last month, Predictim began offering a similar service to parents seeking babysitters. The company goes further than Fama, asking candidates for permission to access their private posts and comments in addition to public ones. The resulting report — a sample is available here — assigns risk scores ranging from 1 to 5, overall and for categories that include drug use, bullying, and "bad attitude."

Privacy advocates worry that such systems can make basic mistakes with lasting effects.

"The automated processing of human speech, including social media, is extremely unreliable even with the most advanced AI. Computers just don’t get context. I hate to think of people being unfairly rejected from jobs because some computer decides they have a 'bad attitude,' or some other red flag."
— Jay Stanley, senior policy analyst at the American Civil Liberties Union

AI-powered hiring systems can be extremely susceptible to bias.

  • If a system is fed hiring data and learns that male candidates are hired more often than female ones, it can start to favor men, like an AI program Amazon tested.
  • To avoid this trap, Fama and Predictim withheld sensitive information like gender and race from the training data, so their AI systems evaluate only the contents of social media posts.
  • Both companies’ CEOs told Axios they work to minimize bias by carefully choosing training data, using a diverse group of people to label it, and regularly testing outputs for fairness.

Users of Predictim, the month-old babysitter-checking service, have already run about 300 scans, said CEO Sal Parsa. Of those, 10% were flagged as moderately risky or higher, and 2.7% as very risky.

Go deeper

Updated 10 mins ago - Politics & Policy

Coronavirus dashboard

Illustration: Aïda Amer/Axios

  1. Politics: Fauci: Trump hasn't been to a COVID task force meeting in months — Trump claims COVID "will go away" during debate.
  2. Sports: The youth sports exodus continues — Big Ten football is back.
  3. Health: How to help save 130,000 livesFDA approves Gilead's remdesivir as treatment How the pandemic might endMany U.S. deaths were avoidable.
  4. Retail: Santa won't greet kids at Macy's this year.
  5. World: Spain and France exceed 1 million cases.
27 mins ago - Health

Fauci: Trump hasn't been to a COVID task force meeting in months

Photo: Drew Angerer/Getty Images

President Trump has not attended a White House coronavirus task force meeting in “several months,” NIAID director Anthony Fauci told MSNBC on Friday.

Why it matters: At the beginning of the pandemic, the task force, led by Vice President Mike Pence, met every day, but in the "last several weeks," members have held virtual meetings once a week, Fauci said, even as the number of new cases continues to surge in the country.

1 hour ago - Health

How to help save 130,000 lives

People wear face masks outside Grand Central Terminal in New York City. Photo: Noam Galai/Getty Images

Nearly 130,000 fewer people will die of COVID-19 this winter if 95% of Americans wear face masks in public, according to research published Friday.

Why it matters: “Increasing mask use is one of the best strategies that we have right now to delay the imposition of social distancing mandates," Dr. Christopher Murray of the University of Washington told the N.Y. Times.

Get Axios AM in your inbox

Catch up on coronavirus stories and special reports, curated by Mike Allen everyday

Please enter a valid email.

Subscription failed
Thank you for subscribing!