Interactive Recovery from Speech Recognition Errors in Speech User Interfaces

Abstract

We present a multimodal approach to interactive recovery from speech recognition errors for the design of speech user interfaces. We propose a framework to compare various error recovery methods, arguing that a rational user will prefer interaction methods which provide an optimal trade off between accuracy, speed and naturalness. We describe a prototypical implementation of multimodal interactive error recovery and present result from a preliminary evaluation in form filling and speech translation tasks.