Point and Listen: Bringing a 3D Map to Life with Audio-Based AR

Authors

James M. Coughlan, Smith-Kettlewell Eye Research Institute
Brandon Biggs, Smith-Kettlewell Eye Research Institute
Huiying Shen, Smith-Kettlewell Eye Research Institute

Document Type

Research Abstract

Abstract

We describe an inexpensive and versatile approach that uses audio-based AR to turn a standard 3D map, such as a relief map or 3D printed map, into an interactive one. Audio-based AR enables the creation of audio labels: when the user points at a specific location on the map, information about it is read aloud. In our application, which is a 3D map of a playground, such information might include the name and description of a play structure on the map.

Recommended Citation

Coughlan, James M.; Biggs, Brandon; and Shen, Huiying (2021) "Point and Listen: Bringing a 3D Map to Life with Audio-Based AR," Frameless: Vol. 4: Iss. 1, Article 9.
Available at: https://repository.rit.edu/frameless/vol4/iss1/9