Sign synthesis is still an evolving technology and the process of improving it requires the elicitation of qualitative feedback from users. Current options for acquiring qualitative feedback are limited. Face-to-face tests conducted in sign language are expensive. On the other hand, remote tests do not use the preferred language of the test participants. A new tool, SignQUOTE, (Signed Qualitative Usability Online Testing Environment) is a configurable, cross-platform remote testing system based entirely on sign language. It includes an innovative method for capturing qualitative feedback in sign language via webcam. In a comparison study, participants viewed animations of American Sign Language and gave suggestions for improvement. Suggestions elicited by SignQUOTE were comparable to those elicited in a face-to-face setting. SignQUOTE comes with a TestDesigner that allows researchers to customize tests. The software is available as open source.
Main Topic: USABILITY
Realism and acceptability of signing avatars
Evaluation methodologies for signing translation systems
[Paper (PDF)]
Supported by START Conference Manager