Overview

We participated in the planning and production of the “Block Universe #001,” an XR installation applying free-viewpoint VR and sound VR (developed by KDDI Research) to digital art, for the MUTEK.JP 2018. The Mona Lisa was reproduced using special makeup and 3-D projection with “Free-viewpoint VR (*1).” This was combined with a 3-D soundscape that changed with every step using “Sound VR (*2).” Visitors were able to experience cutting-edge extended reality that combined video and music with smart glasses.


*1) A technology that enables video viewing from various angles even without actual camera images of those angles. This is achieved by automatically extracting people and background images from multiple camera images and expressing them using a 3-D computer graphics (3DCG) model.
*2) A technology that synthesizes interactive sound based on viewer actions and behavior. This technology can provide sounds in real-time that match viewer movements such as walking or turning.