We present our efforts to develop methods for rendering 3D objects on mobile devices using real-world dynamic illumination from the user’s environment. To achieve this, we use the front and back cameras on the mobile device to estimate the light distribution in the environment in real time. We then create a dynamic illumination map and render the object at interactive rates in a browser on the device using a web-based graphics API. This project achieves one of the goals of our related work on realistic visualization of virtual objects: to make virtual objects appear to be situated within the scene they are observed in.
Padhye, Snehal and Ferwerda, James A.
"Real-Time Illumination Capture and Rendering on Mobile Devices,"
Frameless: Vol. 4:
1, Article 6.
Available at: https://scholarworks.rit.edu/frameless/vol4/iss1/6