Illustration: Sarah Grillo/Axios

In a shift that is roiling typically cocooned computer scientists, some researchers — uneasy in part about the role of technology in the 2016 election — are urging colleagues to determine and mitigate the societal impact of their peer-reviewed work before it's published.

The big picture: The push — meant to shake computer scientists out of their labs and into the public sphere — comes as academics and scientists are suffering the same loss of popular faith as other major institutions.

What's going on: By sensibility, computer science researchers prefer to leave it to philosophers and policymakers to interpret the societal repercussions of their work. At most, their papers cite a few potential positive impacts of the findings — and avoid mentioning the negatives altogether.

But now, they should be more active to renew public faith, said Jack Clark, strategy and communications director at OpenAI. "We need to regain that trust by showing we're conscious of the impact of what we do," he tells Axios.

  • The highest-profile push has come from a group of scientists in the Association for Computing Machinery, a major professional organization that publishes dozens of academic journals. The group has proposed that peer reviewers assess whether papers adequately consider their negative implications.
  • The proposal has provoked a lengthy, combative discussion thread on Hacker News.
  • Wrote one commenter: "Engineers are not philosophers and should not be placed in this role. We do not have the tools to do it."

Researchers whose oppose greater oversight say it's not possible to guess whether their work will be repurposed for ill, or to prevent it from being misused.

  • "Bad guys always can do bad things by using new technologies," said Zhedong Zheng, a PhD candidate at the University of Technology Sydney. "We cannot control them."
  • Technology that's benign on its face can be adapted for surveillance, propaganda, misinformation, cyberattacks, or any number of other uses.
  • Zheng's own research focuses on re-identification, a surveillance tech that follows people from one camera feed to another. Among its ramifications, it could allow paranoid government to create a digital panopticon — or help a mother find a lost child at an amusement park.

But the proposal's 12 co-authors say the need to try harder is palpable. There is "a serious and embarrassing intellectual lapse" between researchers' positive outlook of their own work and reality, they wrote.

"Probably like those in the oil and tobacco industries, we can tell our kids and grandkids that throughout our careers, we were just doing our jobs. … Or we can tell our kids and grandkids that ours was the generation in computing to take responsibility for the effects of our innovations."
— Brent Hecht, lead author of the proposal, in a July speech

Why now? Several researchers said the tipping point was a combination of concern over advances in artificial intelligence and the 2016 election.

  • Part of the growing concern is that half-baked or biased AI algorithms could harm society.
  • And computer scientists watching tech take center stage — via email servers and leaks, Twitter and Facebook — underwent a "sea change" regarding their own ethical responsibility, according to Hecht, a professor at Northwestern.

Clark says the reluctance to engage with the ethical repercussions of research is an "abdicating of responsibility that is frankly shocking." And Joseph Redmon, a PhD candidate at the University of Washington, called it a sign of moral laziness.

  • In a recent paper describing updates to a computer-vision algorithm, Redmon wrote, "As researchers, we have a responsibility to at least consider the harm our work might be doing and think of ways to mitigate it. We owe the world that much."
  • Redmon said he decided to include the note after a member of the military approached him at a conference to express excitement about using the algorithm to analyze drone footage.

Go deeper: Computer science's public safety question.

Go deeper

Updated 13 mins ago - Politics & Policy

Coronavirus dashboard

Illustration: Sarah Grillo/Axios

  1. Global: Total confirmed cases as of 4 p.m. ET: 31,175,205 — Total deaths: 962,076— Total recoveries: 21,294,229Map.
  2. U.S.: Total confirmed cases as of 4 p.m. ET: 6,829,956 — Total deaths: 199,690 — Total recoveries: 2,590,695 — Total tests: 95,121,596Map.
  3. Health: CDC says it mistakenly published guidance about COVID-19 spreading through air.
  4. Media: Conservative blogger who spread COVID-19 misinformation worked for Fauci's agency.
  5. Politics: House Democrats file legislation to fund government through Dec. 11.
  6. World: "The Wake-Up Call" warns the West about the consequences of mishandling a pandemic.

McConnell: Senate has "more than sufficient time" to process Supreme Court nomination

Senate Majority Leader Mitch McConnell (R-Ky.) said in a floor speech Monday that the chamber has "more than sufficient time" to confirm a replacement for Supreme Court Justice Ruth Bader Ginsburg before the election, and accused Democrats of preparing "an even more appalling sequel" to the fight over Brett Kavanaugh's confirmation.

Why it matters: Senate Minority Leader Chuck Schumer (D-N.Y.) has said "nothing is off the table next year" if Republicans push ahead with the confirmation vote before November, vowing alongside Rep. Alexandria Ocasio-Cortez (D-N.Y.) to use "every procedural tool available to us to ensure that we buy ourselves the time necessary."

House Democrats file legislation to fund government through Dec. 11

House Speaker Nancy Pelosi (D-Calif.). Photo: Chip Somodevilla/Getty Images

House Democrats on Monday released their proposal for short-term legislation to fund the government through December 11.

Why it matters: This is Congress' chief legislative focus before the election. They must pass a continuing resolution (CR) before midnight on Oct. 1 to avoid a government shutdown — something both Hill leaders and the White House have claimed is off the table.