Projection-Based AR for Hearing Parent-Deaf Child Communication

Authors

Victor N. Antony, University of RochesterFollow
Adira Blumenthal, University of RochesterFollow
Ziyue Qiu, University of RochesterFollow
Ashely Tenesaca, University of RochesterFollow
Wanyin Hu, University of RochesterFollow
Zhen Bai, University of RochesterFollow

Document Type

Research Abstract

Abstract

Deaf infants born to hearing parents are at risk of language deprivation due to lack of sign language fluency and subpar parent-child communication. We present a projection-based Augmented Reality (AR) prototype designed to improve parent-child communication and American Sign Language (ASL) acquisition. Our system aims to non-intrusively augment play episodes by projecting just-in-time and context-aware ASL equivalents extracted from nursery rhymes being sung by parents. This paper presents the initial implementation of the prototype .

Recommended Citation

Antony, Victor N.; Blumenthal, Adira; Qiu, Ziyue; Tenesaca, Ashely; Hu, Wanyin; and Bai, Zhen (2020) "Projection-Based AR for Hearing Parent-Deaf Child Communication," Frameless: Vol. 3: Iss. 1, Article 19.
Available at: https://repository.rit.edu/frameless/vol3/iss1/19