Microsoft Launches App That Describes the World to the Blind Using AI

The app in action
The app in action | Courtesy Culture Trip

Microsoft has launched an app called Seeing AI, which narrates the world for the visually impaired.

Loved by over 40s

App users are able to point their phone camera at a person or thing and the app will identify them and provide information for the user. For example, if a user points the camera at a person, the app will say who they are and how they’re feeling. People the user hangs out with a lot can be saved to the app, meaning they are easily recognizable when the camera is pointed at them. The app can also identify a product and tell the user what it is.
Seeing AI uses neural networks to identify exactly what it’s looking at. Most of the functions are carried out on the device itself, which makes results much faster. But some more complex features like recognizing hand writing require a connection to the internet to get results via the cloud.

The app can also identify U.S. currency, read text, and reads product bar codes. The app also directs the user how to get the camera in the correct position to identify what is in front of it.

“One of the things we wanted to do was face recognition on device, and we’ve done that so within a few milliseconds you’ll hear the result. It’s all about the speed, and we try to do as much as we can on the device,” Saqib Shaikh, the tech lead on Seeing AI told The Verge.

Shaikh, who lost his sight when he was 7, announced the project in a video in March 2016, saying he had dreamed of building something that at any moment could tell you what is going on around you since he was at university.

The app was launched today, but is only available on iOS at this time.

culture trip left arrow
 culture trip brand logo

Volcanic Iceland Epic Trip

meet our Local Insider


women sitting on iceberg


2 years.


It's the personal contact, the personal experiences. I love meeting people from all over the world... I really like getting to know everyone and feeling like I'm traveling with a group of friends.


I have so many places on my list, but I would really lobe to go to Africa. I consider myself an “adventure girl” and Africa feels like the ULTIMATE adventure!

culture trip logo letter c
group posing for picture on iceberg
group posing for picture on iceberg

Every CULTURE TRIP Small-group adventure is led by a Local Insider just like Hanna.

map of volcanic iceland trip destination points
culture trip brand logo
culture trip right arrow
landscape with balloons floating in the air


Connect with like-minded people on our premium trips curated by local insiders and with care for the world

Since you are here, we would like to share our vision for the future of travel - and the direction Culture Trip is moving in.

Culture Trip launched in 2011 with a simple yet passionate mission: to inspire people to go beyond their boundaries and experience what makes a place, its people and its culture special and meaningful — and this is still in our DNA today. We are proud that, for more than a decade, millions like you have trusted our award-winning recommendations by people who deeply understand what makes certain places and communities so special.

Increasingly we believe the world needs more meaningful, real-life connections between curious travellers keen to explore the world in a more responsible way. That is why we have intensively curated a collection of premium small-group trips as an invitation to meet and connect with new, like-minded people for once-in-a-lifetime experiences in three categories: Culture Trips, Rail Trips and Private Trips. Our Trips are suitable for both solo travelers, couples and friends who want to explore the world together.

Culture Trips are deeply immersive 5 to 16 days itineraries, that combine authentic local experiences, exciting activities and 4-5* accommodation to look forward to at the end of each day. Our Rail Trips are our most planet-friendly itineraries that invite you to take the scenic route, relax whilst getting under the skin of a destination. Our Private Trips are fully tailored itineraries, curated by our Travel Experts specifically for you, your friends or your family.

We know that many of you worry about the environmental impact of travel and are looking for ways of expanding horizons in ways that do minimal harm - and may even bring benefits. We are committed to go as far as possible in curating our trips with care for the planet. That is why all of our trips are flightless in destination, fully carbon offset - and we have ambitious plans to be net zero in the very near future.