Neuroscience

Articles and news from the latest research reports.

Posts tagged speech vocalization

56 notes

Giving a voice to the voiceless has been a cause that many have championed throughout history, but it’s safe to say that none of those efforts involved packing a bunch of sensors into a glove. A team of Ukrainian students has done just that in order to translate sign language into vocalized speech via a smartphone.
The inspiration for the gloves came from observing fellow college students who were deaf have difficulty communicating with other students, which results in them being excluded from activities. Initially, the team looked at commercially available gloves that could be modified to interpret a range of signs, but in the end, they opted to develop their own.
In their glove, a total of 15 flex sensors in the fingers measure the degree of bending while a compass, accelerometer, and gyroscope determine the motion of the glove through space. The sensor data are processed by a microcontroller on the glove then sent via Bluetooth to a mobile device, which translates the positions of the hand and fingers into text when the pattern is recognized. Using Microsoft APIs for Speech and Bing, the text is spoken by the phone running Windows Phone 7. The glove can also plug into a PC for data syncing and charging of its battery.

Giving a voice to the voiceless has been a cause that many have championed throughout history, but it’s safe to say that none of those efforts involved packing a bunch of sensors into a glove. A team of Ukrainian students has done just that in order to translate sign language into vocalized speech via a smartphone.

The inspiration for the gloves came from observing fellow college students who were deaf have difficulty communicating with other students, which results in them being excluded from activities. Initially, the team looked at commercially available gloves that could be modified to interpret a range of signs, but in the end, they opted to develop their own.

In their glove, a total of 15 flex sensors in the fingers measure the degree of bending while a compass, accelerometer, and gyroscope determine the motion of the glove through space. The sensor data are processed by a microcontroller on the glove then sent via Bluetooth to a mobile device, which translates the positions of the hand and fingers into text when the pattern is recognized. Using Microsoft APIs for Speech and Bing, the text is spoken by the phone running Windows Phone 7. The glove can also plug into a PC for data syncing and charging of its battery.

Filed under hearing loss sign language technology speech vocalization neuroscience psychology science

free counters