Welcome to our new synthetic realities

Why it matters: The distinction between fact and fiction is up for grabs as the boundary separating them gets increasingly fuzzy. And arguments over whose reality is most real are already derailing politics and society.

• Entire synthetic universes are home to millions: Viral video games like Fortnite are now gathering places, replicating some of the rules of the real world and inventing new ones. Last month Andreessen Horowitz invested $16.5 million in Singularity 6, a "virtual society" game.
• On Snapchat and Instagram, incredible AI-powered face filters have become banal — an early hint of a near future where a layer of digital information, viewed through glasses or contacts, coats the world we see around us.
• On social media, filter bubbles calcify ideologies, recommendation algorithms quietly radicalize users, and trolls peddle outright disinformation.
• Deepfakes — videos, images and audio that are either manipulated or generated from scratch with AI are a powerful and potentially dangerous new tool for inventing totally convincing realities from whole cloth.

These technologies can enrich the physical world around us, supercharging art and our relationships with other humans. But just as the dominance of social media brought unforeseen harms, so might these developments.

• "People are already living in synthetic realities," says Justin Hendrix, director of the NYC Media Lab. "They feel like they're in a perpetual state of conflict."
• Social media rose on a wave of enthusiasm for its capacity to connect people and champion freedom. "We were blindsided" when the algorithms' underbelly began to show, Hendrix says. He leads a group of engineers, lawyers, VCs and others that meets quarterly to discuss the impacts of synthetic media on society.

In New York City last month, I saw the glimmers of newly emerging layers of reality.

• I visited Betaworks, a VC firm that recently ran an incubator for startups creating synthetic, AI-generated media — music, stock photography, even pop stars. "People are not limiting what they seem like in a virtual world to the rules of the physical world," says Matt Hartman, a Betaworks partner.

• At a Verizon 5G Lab, I saw a slime-green motion-capture room that can quickly make an animatable 3D model out of a person who stands inside. The model could be inserted into a film or a video game — or into a fake sex tape or some other compromising virtual situation.
• And at NYU, I met Paul Barrett at the Center for Business and Human Rights, who follows the destructive path of disinformation online. In a new report he outlines threats to the 2020 election, including the prospect that people will be tricked on social media into gathering — and clashing — in the real world.
• Bonus: Biking over the Williamsburg Bridge on a Saturday, I pedaled under a slogan painted on the steel trestlework: "Don't let reality ruin your life."

What's next: You can expect that these synthetic realities will become more engaging as the technologies that power them develop, and that you will spend more time in them — whether you know it or not.