Developers, Mohammad Ghassemi and Tuka Al Hanai, combined a Samsung Simband — a health wearable that uses multiple sensors to track activity level, heart rate, skin temperature, and blood pressure — with an AI system that studies conversational cues.
By analyzing the intricacies of speech, including pitch, tone, energy and vocabulary, and labeling it either ‘happy’, ‘sad,’ or ‘neutral’, it provides a play-by-play overview of the interaction. The wearer could then use that data to gain insight into which segments of the conversation were positive in tone, adjusting their behavior accordingly.
Ghassemi, who thinks his invention could also help people with Asperger’s, told Newsweek: “Technology has done a lot to connect people but even though it helps us communicate, it hasn’t done much to improve those communications.”
If the technology is integrated with smart watches in the future, as the creators hope, it could help everybody become more socially adept. Imagine having data that indicates how much you and your date enjoyed each other’s company, or how well you responded to tricky questions at a job interview.
On the flip side, it has the potential to encourage relentless self-critiquing. Perhaps having the option to relive and pick apart every personal interaction — like the episode of Black Mirror, The Entire History of You — might be more complex, and not entirely positive, for some of us.