Controlling a marionette with human motion capture data

Abstract

In this paper, we present a method for controlling a motorized, string-driven marionette using motion capture data from human actors. The motion data must be adapted for the marionette because its kinematic and dynamic properties differ from those of the human actor in degrees of freedom, limb length, workspace, mass distribution, sensors, and actuators. This adaptation is accomplished via an inverse kinematics algorithm that takes into account marker positions, joint motion ranges, string constraints, and potential energy. We also apply a feedforward controller to prevent extraneous swings of the hands. Experimental results show that our approach enables the marionette to perform motions that are qualitatively similar to the original human motion capture data.