OpenAI's Altman: Ascribing religion to models a "safety issue"
Add Axios as your preferred source to
see more of our stories on Google.
OpenAI CEO Sam Altman. Photo: Heather Diehl/Getty Images
OpenAI CEO Sam Altman on Saturday took a veiled shot at Anthropic and its work on the soul of AI, saying he was "very uncomfortable" with the idea of attributing some kind of religious power to models.
Why it matters: It's yet another point of division between Altman and his former colleague Dario Amodei, whose company has reportedly pursued scholars across faiths to make the case for moral, conscious models.
- But some of the top voices in AI are starting to publicly line up against Anthropic's efforts to infuse consciousness into models.
What they're saying: "I am very uncomfortable about people trying to ascribe religious force or a surrender of human judgment to AI models, and think it is a real safety issue," Altman said in a post to X.
Context: Earlier this week, the New York Times reported that Anthropic co-founder Christopher Olah has been meeting with religious leaders to consider questions of model consciousness — but also to figure out how to infuse morals and moral behavior into AI.
- At one point, the Times reported, Olah considered the possibility of models engaging in Catholic-style confession, not just to admit their mistakes but to shape their future behavior.
The big picture: Spirituality is suddenly becoming something of a flashpoint around AI's future.
- On Friday Pope Leo, an outspoken AI critic, called on the church to ally with artists to preserve human creativity, saying: "Algorithms lack the spark of humanity."
Between the lines: The pope's stance put renewed focus on a fundamental question: Do models have souls and feelings?
- The Times reported that Olah, before a Vatican event in May, tried to persuade the pope's advisers that they should take the prospect of conscious models more seriously.
- So far, other top scientists seem to be lining up against the idea.
- "I am disturbed by how some of my fellow AI researchers keep trying to elevate the moral standing of checkpoints and harnesses," Google DeepMind principal research scientist Jon Barron posted to X. "I hope the rest of us on Team Meatbag reject this movement and stay focused on solving real problems and helping actual humans."
For the record: Neither OpenAI nor Anthropic immediately responded to requests for comment on Altman's post.
The bottom line: The AI safety debate largely focuses on things like cybersecurity and bioweapons.
- The real problem may be more spiritual than that.
