Guide to the Carnegie Mellon University Multimodal Activity (CMU-MMAC) Database
Abstract
This document summarizes the technology, procedures, and database organization of the CMU Multi-Modal Activity Database (CMU-MMAC). The CMU-MMAC database contains multimodal measures of the human activity of subjects performing the tasks involved in cooking and food preparation. The CMU-MMAC database was collected in Carnegie Mellon University? Motion Capture Lab. A kitchen was built and to date five subjects have been recorded cooking five different recipes: brownies,pizza, sandwich, salad and scrambled eggs. The following modalities were recorded: ?Video: (1) Three high spatial resolution (1024 ?768) color video cameras at low temporal resolution (30 Hertz). (2) Two low spatial resolution (640 ?480) color video cameras at high temporal resolution (60 Hertz). (3) One wearable low spatial resolution (640?80) camera at low temporal resolution (12 Hertz). ?Audio: (1) Five balanced microphones. (2) Wearable watch. ?Motion capture: A Vicon motion capture system with 12 infrared MX-40 cameras. Each camera records images of 4 megapixel resolution at 120 Hertz. ?Five 3-axis accelerometers and gyroscopes. Several computers were used for recording the various modalities. The computers were synchronized using the Network Time Protocol (NTP).
BibTeX
@techreport{Frade-2008-9926,author = {Fernando De la Torre Frade and Jessica K. Hodgins and Adam W. Bargteil and Xavier Martin Artal and Justin C. Macey and Alexandre Collado I Castells and Josep Beltran},
title = {Guide to the Carnegie Mellon University Multimodal Activity (CMU-MMAC) Database},
year = {2008},
month = {April},
institute = {Carnegie Mellon University},
address = {Pittsburgh, PA},
number = {CMU-RI-TR-08-22},
keywords = {multimodal activity, quality of life,},
}