Kinect's Sign-Language Recognition & Translation Project - Microsoft Research
Kinect, the motion sensing input device from Microsoft recently had some bad press due to privacy issues associated with it being “Always On†on the new Xbox One, but even so one cannot deny the fact that Kinect is an incredible invention that is always giving researchers and developers worldwide a platform to create some very interesting innovations. Taking this trend forward, Microsoft Research team in Asia in collaboration with Institute of Computing Technology at the Chinese Academy of Sciences (CAS) have used body-tracking capability of Kinect for Windows to develop software that can both recognise and translate sign-language.
The software tracks hand movements and then uses a process of 3-D motion-trajectory alignment to identify the word being signed. The software has two modes, Translation Mode and Communication Mode. The Translation Mode, as the name suggests translates the sign language into text or speech and the Communication Mode has a 3D avatar that generates sign-language gestures from typed words. This mode will help two-way communication between a person who knows sign language and someone who doesn’t. The software for the meantime can only process American sign-language and researchers are confident that it has the potential to work with other languages as well. The team has put up the following video on YouTube that shows a demonstration of American and Chinese sign language translation using Kinect and Bing translator. Have a look.
Source: #-Link-Snipped-#
The software tracks hand movements and then uses a process of 3-D motion-trajectory alignment to identify the word being signed. The software has two modes, Translation Mode and Communication Mode. The Translation Mode, as the name suggests translates the sign language into text or speech and the Communication Mode has a 3D avatar that generates sign-language gestures from typed words. This mode will help two-way communication between a person who knows sign language and someone who doesn’t. The software for the meantime can only process American sign-language and researchers are confident that it has the potential to work with other languages as well. The team has put up the following video on YouTube that shows a demonstration of American and Chinese sign language translation using Kinect and Bing translator. Have a look.
The project was put up on display at the DemoFest arena of Faculty Summit 2013 held in Redmond, Washington, United States a few days ago. If you are interested you may also read the research paper titled #-Link-Snipped-# [PDF File].Source: #-Link-Snipped-#
Replies
-
Mehak RajkhokarKinect is really great..!! I played fruit ninja and some car racing games using kinect... It's motion sensors are really very effective..! 👍 -
Jeffrey ArulrajThe software and the interface in it is beyond comprehension
But some times lags occur that can be quoted to higher speed of motion of your body especially in Fruit Ninga game -
Mehak RajkhokarYeah.. but that can be managed.. right ?? 😉
-
Jeffrey Arulraj
Yeah as they are really tolerable to a great extentMehak RajkhokarYeah.. but that can be managed.. right ?? 😉
Mimicing can't get better than that -
Mehak RajkhokarYeah..!! 👍
You are reading an archived discussion.
Related Posts
Use of Microsoft Windows Phone 8 is increasing day by day. Nokia is at top notch in selling the Windows Based phones & sales of Nokia is increasing.
There is...
how can we use a 30GHz cro to measure microwave frequencies...share ur ideas friends
Micron Technology, the only Titan of the 'Storage Technology' has announced the next generation of Flash process technology which will be used in SSDs. The latest die fabricated using 16nm...
i am te instrumentation engineering student
i want topics for miniproject of sccd suject sem 5
plz help😀
https://www.crazyengineers.com/threads/this-robot-takes-care-of-30-000-mice-like-a-gentleman.69257/
Well this link depicits an engineering marvel in itself What is your take on it guys?
Any idea how this works ?
Controllers used and possible operation of it...