MOBILE SOCIAL WORK

ideas, innovations and apps for social work in the age of smartphones and social media 

Microsoft’s working on sign language recognittion and translation using Kinect & Bing [VIDEO]

Kinect2

Researchers from Microsoft Research Asia have collaborated with colleagues from the Institute of Computing Technology at the Chinese Academy of Sciences (CAS) to explore how Kinect’s body-tracking abilities can be applied to the problem of sign-language recognition.

The work, facilitated and supported by Microsoft Research Connections, is summarized in the paper Sign Language Recognition and Translation with Kinect, co-authored by CAS researchers Xiujuan Chai, Guang Li, Yushun Lin, Zhihao Xu, Yili Tang, and Chen, along with Ming Zhou, principal researcher at Microsoft Research Asia.

The algorithm for this 3-D trajectory matching, in turn, has enabled the construction of a system for sign-language recognition and translation, consisting of two modes. The first, Translation Mode, translates sign language into text or speech. The technology currently supports American sign language but has potential for all varieties of sign language.

The second, Communications Mode, enables communications between a hearing person and a deaf or hard-of-hearing person by use of an avatar. Guided by text input from a keyboard, the avatar can display the corresponding sign-language sentence. The deaf or hard-of-hearing person responds using sign language, and the system converts that answer into text.

Does it work? Surprisingly well.

via Digital Assistance for Sign-Language Users – Inside Microsoft Research – Site Home – TechNet Blogs.

Advertisements

Leave a Reply

Fill in your details below or click an icon to log in:

WordPress.com Logo

You are commenting using your WordPress.com account. Log Out / Change )

Twitter picture

You are commenting using your Twitter account. Log Out / Change )

Facebook photo

You are commenting using your Facebook account. Log Out / Change )

Google+ photo

You are commenting using your Google+ account. Log Out / Change )

Connecting to %s

Lutz Siemer

Lutz Siemer

Education, Research & Development in Social Work & IT After working as an alternative practitioner and psychotherapist in private practice for nearly ten years I stepped over to higher education in 2005. At Saxion University of Applied Sciences I lecture and do research and development in the area of Social Work, Psychology and IT. Currently I'm focussing on merging mobile technology and social work.

Personal Links

View Full Profile →

Enter your email address to follow this blog and receive notifications of new posts by email.

Twitter

Mobile Social Work on Twitter

Facebook

Mobile Social Work on Facebook

Google+

Mobile Social Work on Google+

Tumblr

Social Mobile Work on Tumblr

RSS

Subscribe to Posts

The Fair(er) Phone:

FairPhone | A seriously cool smartphone. Putting social values first
%d bloggers like this: