Multisensory Augmented Reality - Robotics Institute Carnegie Mellon University

Multisensory Augmented Reality

M. Mahler, J. Mars, J. McCann, A. Israr, S. Lawson, K. McIntosh, and J. Bedford
Miscellaneous, U. S. Patent US20180315243A1, April, 2017

Abstract

According to one aspect of the present disclosure, a method for providing a multisensory augmented reality environment is disclosed. The method includes receiving a real-time video stream of a physical environment, receiving depth information of one or more objects within the physical environment, generating real-time content depicting the physical environment based on the real-time video stream and the depth information, rendering augmented content, wherein the augmented content integrates original content and the real-time content, generating sensory feedback instructions to provide sensory feedback based on the augmented content, wherein the sensory feedback instructions are dynamically adjusted to changes in the augmented content, transmitting the augmented content for display and instructions to provide sensory feedback correlated to the augmented content.

BibTeX

@misc{Mahler-2017-113416,
author = {M. Mahler and J. Mars and J. McCann and A. Israr and S. Lawson and K. McIntosh and J. Bedford},
title = {Multisensory Augmented Reality},
booktitle = {U. S. Patent US20180315243A1},
month = {April},
year = {2017},
}