Journal of Deaf Studies and Deaf Education Advance Access originally published online on September 28, 2005
The Journal of Deaf Studies and Deaf Education 2006 11(1):94-101; doi:10.1093/deafed/enj003
| ||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
Empirical Articles |
Sign Language Recognition and Translation: A Multidisciplined Approach From the Field of Artificial Intelligence
University of North Texas
In recent years, research has progressed steadily in regard to the use of computers to recognize and render sign language. This paper reviews significant projects in the field beginning with finger-spelling hands such as "Ralph" (robotics), CyberGloves (virtual reality sensors to capture isolated and continuous signs), camera-based projects such as the CopyCat interactive American Sign Language game (computer vision), and sign recognition software (Hidden Markov Modeling and neural network systems). Avatars such as "Tessa" (Text and Sign Support Assistant; three-dimensional imaging) and spoken language to sign language translation systems such as Poland's project entitled "THETOS" (Text into Sign Language Automatic Translator, which operates in Polish; natural language processing) are addressed. The application of this research to education is also explored. The "ICICLE" (Interactive Computer Identification and Correction of Language Errors) project, for example, uses intelligent computer-aided instruction to build a tutorial system for deaf or hard-of-hearing children that analyzes their English writing and makes tailored lessons and recommendations. Finally, the article considers synthesized sign, which is being added to educational material and has the potential to be developed by students themselves.
Correspondence should be sent to Becky Sue Parton, University of North Texas, College of Education, Department of Technology and Cognition, 12825 Metz Road, Sanger, TX 76266 (e-mail: parton{at}cc.admin.unt.edu).
Received February 22, 2005; revised August 22, 2005; accepted August 23, 2005