Oct 5, 2019

Word games show AI's limitations

A game of Codenames. Photo: Kaveh Waddell/Axios

It's one thing to play chess against a computer — you'll lose — but it's another entirely to play a collaborative word game. That stretches the limits of today's AI.

What's happening: Game geeks are trying to create bots that can play Codenames, the super-popular word guessing game.

  • It's played with two teams and a board with 25 words, like in the photo above.
  • Each turn, one person tries to come up with a single-word clue linking as many of the 25 words as possible; then, that person's teammates try to guess as many words as they can.

Giving a good clue is pretty easy for computers, using basic open-source machine learning tools for language understanding.

  • "I was surprised at how well it worked," said David Kirkby, an astrophysicist at UC Irvine who programmed a Codenames bot for fun. "It came up with clues which weren't obvious to me — but they made sense."
  • Kirkby's bot once gave the clue "Wrestlemania" to connect the words "undertaker" and "match."
  • Another bot coded by Jeremy Neiman, an engineer at Alphabet's Sidewalk Labs, used "telemedicine" to connect "ambulance," "hospital," "link" and "web."

What's really hard is guessing whether your teammates will understand your clue. This is something humans are great at — if you're playing with a sibling or friend, you can draw on shared experiences to come up with the perfect word.

  • The next big step is to create bots that develop an understanding of their teammates over the course of several games, says Adam Summerville, a professor at CalPoly Pomona who hosts Codenames AI competitions.
  • Achieving this goal is key to making robots that communicate better with people to accomplish a shared task.

Go deeper

Fighting hate with AI-powered retorts

Illustration: Aïda Amer & Eniola Odetunde/Axios

Scientists have long tried to use AI to automatically detect hate speech, which is a huge problem for social network users. And they're getting better at it, despite the difficulty of the task.

What's new: A project from UC Santa Barbara and Intel takes a big step further — it proposes a way to automate responses to online vitriol.

Go deeperArrowOct 19, 2019

Teaching robots to see — and understand

Illustration: Sarah Grillo/Axios

Machine vision is a crucial missing link holding back the robotization of industries like manufacturing and shipping. But even as that field advances rapidly, there's a larger hurdle that still blocks widespread automation — machine understanding.

Why it matters: Up against a shortage of workers, those sectors stand to benefit hugely from automation. But the people working in warehouses and factories could find their jobs changed or eliminated if vision technology sees new breakthroughs.

Go deeperArrowOct 26, 2019

The hidden costs of AI

Illustration: Eniola Odetunde/Axios

In the most exclusive AI conferences and journals, AI systems are judged largely on their accuracy: How well do they stack up against human-level translation or vision or speech?

Yes, but: In the messy real world, even the most accurate programs can stumble and break. Considerations that matter little in the lab, like reliability or computing and environmental costs, are huge hurdles for businesses.

Go deeperArrowOct 26, 2019