Skip
Current Issue
This Month's Print Issue

Follow Fast Company

We’ll come to you.

1 minute read

World Changing Ideas

Artificial Intelligence Is Helping The Blind To Recognize Objects

The apps can even be trained by users to distinguish between different sets of keys.

  • <p>EyeSense has the ability to "learn" objects in its environment, having been trained by its users.</p>
  • <p>A visually-impaired person can then point their device in the direction of an unknown object, and a voice will say that the app recognizes it.</p>
  • <p>"The key strength of the app is that it also recognizes basic facial expressions, like winks or smiles. This enhances human interaction."</p>
  • <p>The second app, called Aipoly does something similar.</p>
  • <p>It's sophisticated enough to recognize clothing and colors, even in abstract works of art.</p>
  • 01 /06

    EyeSense has the ability to "learn" objects in its environment, having been trained by its users.

  • 02 /06

    A visually-impaired person can then point their device in the direction of an unknown object, and a voice will say that the app recognizes it.

  • 03 /06

    "The key strength of the app is that it also recognizes basic facial expressions, like winks or smiles. This enhances human interaction."

  • 04 /06

    The second app, called Aipoly does something similar.

  • 05 /06

    It's sophisticated enough to recognize clothing and colors, even in abstract works of art.

  • 06 /06

Can artificial intelligence help visually impaired people recognize objects around them and improve their quality of life? That's the promise of two new apps.

EyeSense, an iPad app developed in Egypt, has the ability to "learn" objects in its environment, having been trained by its users. A visually impaired person can point their device in the direction of where they think something might be—say, a coffee cup—and a voice will say that the app recognizes that object.

"The key strength of the app is that it also recognizes basic facial expressions, like winks or smiles. This enhances human interaction," says Joanna Marczak, a spokesperson for its developer, ID Labs.

To train the app, you place things in front of the device's camera at several angles, telling it about the items. Then you repeat the process, taking the objects away, so the app recognizes the difference. On subsequent occasions, it will be able to distinguish, say, your set of keys from another set of keys. "It's like a new born baby—it's learning all the time as you show it objects," Marczak says. Probably the training would be done by a family member or friend.

The second app, called Aipoly (see video), does something similar. It's sophisticated enough to recognize clothing and colors, even in abstract works of art.

Marczak says ID Labs is working with visually impaired support groups to improve the EyeSense app, which is free to download (versions for Android and other phones are due soon). It also works offline if necessary. Find it here.

Have something to say about this article? You can email us and let us know. If it's interesting and thoughtful, we may publish your response.

loading