Aug 28, 2019

Lego tests out AI to create spoken instructions for blind builders

Ina Fried, author of Login

Photo: Lego

Aiming to make its signature bricks more accessible, Lego is testing the use of AI to translate its building instructions into spoken commands and braille so that blind users can get in on the fun.

The intrigue: The idea came from Matthew Shifrin, an expert Lego builder who was born blind. Matthew had a friend, Lilya, who would translate all of the Lego instructions from graphical steps into braille text.

What they're saying: Shifrin told Axios working with Legos helps blind kids in multiple ways. Building Lego sets not only provides a sense of mastery and accomplishment, but also helps people better understand the world around them.

"As a blind person, cultural landmarks are an abstract concept. I know that the Statue of Liberty is an iconic symbol of America, but have no idea how it's shaped. It's a woman holding a torch and a scroll, that's all I know. If I climbed it, to try and understand its shaping better, I'd get arrested. But if I build the Statue out of Lego, then I become intimately familiar with its shaping and am better able to understand the world around me."
— Matthew Shifrin

For Shifrin, it's also a tribute to his friend Lilya, who died two years ago. "I promised myself that I would not let this project rest, until Lego took action," he said. "I'm so glad that they've taken it upon themselves to make their sets accessible to blind children."

To ensure the directions were accurate, Lego tested them with Shifrin and children from the U.K. and Denmark. Lego is starting out with four sets, with an eye toward expanding the program next year. The effort builds on Lego's introduction earlier this year of braille bricks.

Go deeper:

Go deeper

Trump says he will campaign against Lisa Murkowski after her support for Mattis

Trump with Barr and Meadows outside St. John's Episcopal church in Washington, D.C. on June 1. Photo: Brendan Smialowski/AFP via Getty Images

President Trump tweeted on Thursday that he would endorse "any candidate" with a pulse who runs against Sen. Lisa Murkowski (R-Alaska).

Driving the news: Murkowski said on Thursday that she supported former defense secretary James Mattis' condemnation of Trump over his response to protests in the wake of George Floyd's killing. She described Mattis' statement as "true, honest, necessary and overdue," Politico's Andrew Desiderio reports.

5 hours ago - World

The president vs. the Pentagon

Trump visits Mattis and the Pentagon in 2018. Photo: Brendan Smialowski/AFP via Getty

Over the course of just a few hours, President Trump was rebuffed by the Secretary of Defense over his call for troops in the streets and accused by James Mattis, his former Pentagon chief, of trampling the Constitution for political gain.

Why it matters: Current and former leaders of the U.S. military are drawing a line over Trump's demand for a militarized response to the protests and unrest that have swept the country over the killing of George Floyd by police.

New York Times says Tom Cotton op-ed did not meet standards

Photo: Avalon/Universal Images Group via Getty Images)

A New York Times spokesperson said in a statement Thursday that the paper will be changing its editorial board processes after a Wednesday op-ed by Sen. Tom Cotton (R-Ark.), which called for President Trump to "send in the troops" in order to quell violent protests, failed to meet its standards.

Why it matters: The shift comes after Times employees began a coordinated movement on social media on Wednesday and Thursday that argued that publishing the op-ed put black staff in danger. Cotton wrote that Trump should invoke the Insurrection Act in order to deploy the U.S. military against rioters that have overwhelmed police forces in cities across the country.