Maintaining Awareness of the Focus of Attention of a Conversation: A Robot-Centric Reinforcement Learning Approach - Robotics Institute Carnegie Mellon University

Maintaining Awareness of the Focus of Attention of a Conversation: A Robot-Centric Reinforcement Learning Approach

Marynel Vazquez, Aaron Steinfeld, and Scott E. Hudson
Conference Paper, Proceedings of 25th IEEE International Symposium on Robot and Human Interactive Communication (RO-MAN '16), pp. 36 - 43, August, 2016

Abstract

We explore online reinforcement learning techniques to find good policies to control the orientation of a mobile robot during social group conversations. In this scenario, we assume that the correct behavior for the robot should convey attentiveness to the focus of attention of the conversation. Thus, the robot should turn towards the speaker. Our results from tests in a simulated environment show that a new state representation that we designed for this problem can be used to find good policies for the robot. These policies can generalize across interactions with different numbers of people and can handle various levels of sensing noise.

BibTeX

@conference{Vazquez-2016-5582,
author = {Marynel Vazquez and Aaron Steinfeld and Scott E. Hudson},
title = {Maintaining Awareness of the Focus of Attention of a Conversation: A Robot-Centric Reinforcement Learning Approach},
booktitle = {Proceedings of 25th IEEE International Symposium on Robot and Human Interactive Communication (RO-MAN '16)},
year = {2016},
month = {August},
pages = {36 - 43},
}