Microsoft Launches App That Describes The World To The Blind Using AI

Microsoft has launched an app called Seeing AI, which narrates the world for the visually impaired.

App users are able to point their phone camera at a person or thing and the app will identify them and provide information for the user. For example, if a user points the camera at a person, the app will say who they are and how they’re feeling. People the user hangs out with a lot can be saved to the app, meaning they are easily recognizable when the camera is pointed at them. The app can also identify a product and tell the user what it is.
Seeing AI uses neural networks to identify exactly what it’s looking at. Most of the functions are carried out on the device itself, which makes results much faster. But some more complex features like recognizing hand writing require a connection to the internet to get results via the cloud.

The app can also identify U.S. currency, read text, and reads product bar codes. The app also directs the user how to get the camera in the correct position to identify what is in front of it.

“One of the things we wanted to do was face recognition on device, and we’ve done that so within a few milliseconds you’ll hear the result. It’s all about the speed, and we try to do as much as we can on the device,” Saqib Shaikh, the tech lead on Seeing AI told The Verge.

The app was launched today, but is only available on iOS at this time.

Since you are here, we would like to share our vision for the future of travel - and the direction Culture Trip is moving in.

Culture Trip launched in 2011 with a simple yet passionate mission: to inspire people to go beyond their boundaries and experience what makes a place, its people and its culture special and meaningful — and this is still in our DNA today. We are proud that, for more than a decade, millions like you have trusted our award-winning recommendations by people who deeply understand what makes certain places and communities so special.

Increasingly we believe the world needs more meaningful, real-life connections between curious travellers keen to explore the world in a more responsible way. That is why we have intensively curated a collection of premium small-group trips as an invitation to meet and connect with new, like-minded people for once-in-a-lifetime experiences in three categories: Culture Trips, Rail Trips and Private Trips. Our Trips are suitable for both solo travelers, couples and friends who want to explore the world together.

Culture Trips are deeply immersive 5 to 16 days itineraries, that combine authentic local experiences, exciting activities and 4-5* accommodation to look forward to at the end of each day. Our Rail Trips are our most planet-friendly itineraries that invite you to take the scenic route, relax whilst getting under the skin of a destination. Our Private Trips are fully tailored itineraries, curated by our Travel Experts specifically for you, your friends or your family.

We know that many of you worry about the environmental impact of travel and are looking for ways of expanding horizons in ways that do minimal harm - and may even bring benefits. We are committed to go as far as possible in curating our trips with care for the planet. That is why all of our trips are flightless in destination, fully carbon offset - and we have ambitious plans to be net zero in the very near future.