American Sign Language Motion Capture

In collaboration with Nicoletta Adamo and Ronnie Wilbur Ph.D, we assisted capturing the translation of a math lesson into ASL on our motion capture stage. This capture involved full-body tracking with our Optitrack system, finger capture via Stretchsense gloves, and face capture via Faceware Live. The digital mapping was calibrated to the translator’s hand positions for a predetermined set of ASL characters to ensure high quality realtime results.