Speech recognition tech set to transcribe mouthed words using facial movements
Updated On: 15 November, 2022 03:46 PM IST | IANS
Silent speech interfaces use strain sensors to detect a person`s movements as they mouth words. The new device can track and translate these facial motions into words using a deep learning algorithm, according to the report
Representation pic
A team of South Korean researchers have developed a silent speech recognition system that is said to identify words by tracking facial movements. According to a report published in euronews.next, the device intends to assist deaf people, who may find it difficult to interact with others using sign language. It is also expected to aid the military or the police in situations where radio transmission is challenging due to background noise.
Silent speech interfaces use strain sensors to detect a person's movements as they mouth words. The new device can track and translate these facial motions into words using a deep learning algorithm, according to the report. "The strain sensor attached to the face stretches and shrinks according to the skin's stretchiness when a person speaks. And the electric properties of the strain sensors change accordingly," Taemin Kim, of Yonsei University School of Electrical and Electronic Engineering, was quoted as saying.
The ultra-thin sensors are resistant to sweat and sebum, and the system recognised a set of 100 words with nearly 88 per cent accuracy - an unprecedented high performance, according to the team's findings, published in Nature Communications. While silent speech recognition sensors aren't new, the team says the ones they've designed are hundreds of times smaller than existing ones - under 8 micro metres thick - making their system highly scalable.
In other words, for better tracking of movements and word recognition, they would just need to add more of them, like pixels in an image, said the report. "To classify and recognise more words, a higher resolution of information is needed. And that is why researchers today are trying to develop a high-resolution silent speech system that combines our wearable strain sensor with a highly integrated circuit that's normally used in display or semiconductor production," Kim added.
ADVERTISEMENT
Poll
Who will win the Punjab Elections?
Also Read: ‘Winter worsens bone problems’: Experts share ways to maintain bone health
This story has been sourced from a third party syndicated feed, agencies. Mid-day accepts no responsibility or liability for its dependability, trustworthiness, reliability and data of the text. Mid-day management/mid-day.com reserves the sole right to alter, delete or remove (without notice) the content in its absolute discretion for any reason whatsoever
Trending Stories
Latest Web Stories
Latest Photos
17 December, 2025 11:56 AM IST | IN PHOTOS: MLAs at Vidhan Bhavan during Maharashtra Legislative Council polls
Asif Ali Sayed
09 September, 2024 09:32 PM IST | IN PHOTOS: People in Mumbai celebrate Gauri Puja during Ganeshotsav
Asif Ali Sayed
09 September, 2024 09:13 PM IST | IN PHOTOS: Mumbai witnesses sunny weather as rains take a break
Asif Ali Sayed
09 September, 2024 01:53 PM IST | In Photos: Amit Shah attends Ganeshotsav 2024 festivities in Mumbai
Divya Nair
Latest Videos
ADVERTISEMENT
Mid-day Fast
Latest Headlines
05 August, 2026 12:52 PM IST | Poonam Ahuja
31 July, 2026 11:57 AM IST | AP
24 July, 2026 08:04 PM IST | mid-day online correspondent