Incorporation of Audio in Virtualized Reality - Robotics Institute Carnegie Mellon University

Incorporation of Audio in Virtualized Reality

Saurabh Gupta, Sundar Vedula, and Takeo Kanade
Tech. Report, CMU-RI-TR-00-22, Robotics Institute, Carnegie Mellon University, September, 2000

Abstract

Virtualized Reality is a visual medium that allows the user to view a scene from any viewpoint independent of the physical limitations imposed on the cameras capturing the scene. However the 3D models of video do not provide the complete simulation of the real world. We present an approach for the addition of audio to the existing video capture and recreation mechanisms. Using a technique analogous to video, multiple audio streams are captured to provide the spatial distribution of sound. A 3D model of audio is then generated to find the approximate sound as a function of the world coordinates. Synchronized with the video, this enables the user to both see and hear from any dynamically defined view-coordinates.

BibTeX

@techreport{Gupta-2000-8107,
author = {Saurabh Gupta and Sundar Vedula and Takeo Kanade},
title = {Incorporation of Audio in Virtualized Reality},
year = {2000},
month = {September},
institute = {Carnegie Mellon University},
address = {Pittsburgh, PA},
number = {CMU-RI-TR-00-22},
keywords = {virtualized reality, 3-d modeling, audio reconstruction},
}