Nov 28, 2018

Breaking with tradition, AI research group goes radio silent

Illustration: Sarah Grillo/Axios

Amid rising worries regarding the development of human-level machine intelligence, a prominent Berkeley research organization has become the first to stop openly publishing all of its findings.

Why it matters: The move by the Machine Intelligence Research Institute is a break from a traditional standard of openness in computer-science research.

We’ve reported before on researchers’ questions about the right amount of openness and transparency when discussing potentially dangerous work. This is the most extreme reaction we’ve seen yet.

  • It comes as AI researchers are quietly deliberating how to react to the potential malicious use of AI.
  • MIRI worries that open publishing could aid progress toward an unchecked super-intelligent machine.
  • Today, AI researchers routinely first post their papers at Arxiv, an entirely free and open, non-peer-reviewed repository for scientific papers.

Details: MIRI — which has received funding from AI dystopians like Peter Thiel and Elon Musk’s Future of Life Institute — posted a strategy document on Thanksgiving outlining its new policy of "nondisclosed-by-default research."

  • "Most results discovered within MIRI will remain internal-only unless there is an explicit decision to release those results, based usually on a specific anticipated safety upside from their release," wrote MIRI executive director Nate Soares.
"It does seem to me to be useful that an AI research organization has taken this step, if only so that it generates data for the community about what the consequences are of taking such a step."
— Jack Clark, OpenAI policy director

OpenAI, another prominent AI research nonprofit, wrote in its charter that it expects that "safety and security concerns will reduce our traditional publishing in the future."

  • Jack Clark, OpenAI’s policy director, said the organization is still in the early stages of fulfilling the goal, but that the questions MIRI is grappling with — when it's best to keep research private — are worth debating.

Go deeper

Coronavirus dashboard

Illustration: Aïda Amer/Axios

  1. Global: Total confirmed cases as of 4 p.m. ET: 1,407,123— Total deaths: 81,103 — Total recoveries: 297,934Map.
  2. U.S.: Total confirmed cases as of 4 p.m. ET: 386,800 — Total deaths: 12,285 — Total recoveries: 20,191Map.
  3. Federal government latest: Trump removes watchdog overseeing rollout of $2 trillion coronavirus bill — Senate looks to increase coronavirus relief for small businesses this week
  4. Public health latest: Testing capacity is still lagging far behind demand.
  5. World latest: China reopens Wuhan after 10-week coronavirus lockdown.
  6. Wisconsin primary in photos: Thousands gathered to cast ballots in-person during the height of the coronavirus crisis in the U.S.
  7. What should I do? Pets, moving and personal health. Answers about the virus from Axios expertsWhat to know about social distancingQ&A: Minimizing your coronavirus risk.
  8. Other resources: CDC on how to avoid the virus, what to do if you get it.

Subscribe to Mike Allen's Axios AM to follow our coronavirus coverage each morning from your inbox.

America's food heroes

Photos: Charlie Riedel/AP (L); Brent Stirton/Getty Images

The people who grow, process and keep food stocked on shelves are doing heroic work in these conditions, often for bottom-barrel pay.

Why it matters: Millions of Americans don't have the luxury of working from home, and it's essential that food workers keep working so we can keep eating.

Go deeperArrow15 mins ago - Health

Acting Navy secretary resigns over handling of virus-infected ship

Photo: Chip Somodevilla/Getty Images

Acting Navy Secretary Thomas Modly resigned Tuesday after apologizing for comments he made about Capt. Brett Crozier, who was removed after a letter he wrote pleading with the Navy to address the coronavirus outbreak aboard the USS Theodore Roosevelt was leaked to the press. The resignation was first reported by Politico.

Why it matters: The controversy over Crozier's removal was exacerbated after audio leaked of Modly's address to the crew, in which he said Crozier was either "too naive or too stupid to be a commanding officer of a ship like this." After initially backing Modly's decision, President Trump said at a briefing Monday that he would "get involved."