Cognitive Evaluation of Human-Robot Systems: A Method for Analyzing Cognitive Change in Human-Robot Systems - Robotics Institute Carnegie Mellon University

Cognitive Evaluation of Human-Robot Systems: A Method for Analyzing Cognitive Change in Human-Robot Systems

Kristen Stubbs, Debra Bernstein, Kevin Crowley, and Illah Nourbakhsh
Conference Paper, Proceedings of 15th IEEE International Symposium on Robot and Human Interactive Communication (RO-MAN '06), pp. 59 - 65, September, 2006

Abstract

To help answer questions about the behavior of participants in human-robot systems, we propose the Cognitive Evaluationof Human-Robot Systems (CHERS) method based on our work with the Personal Exploration Rover (PER). The CEHRS method consists of six steps: (1) identify all system participants, (2) collect data from all participant groups, including the system's creators, (3) analyze participant data in light of system-wide goals, (4) answer targeted questions about each participant group to determine the flow of knowledge, information, and influence throughout the system, (5) look for inconsistencies in the knowledge and beliefs of different participant groups, and (5) make recommendations for improvement. We offer this comprehensive, human-centered evaluation method as a starting point for future work in understanding cognitive change in human-robot interactions.

BibTeX

@conference{Stubbs-2006-9585,
author = {Kristen Stubbs and Debra Bernstein and Kevin Crowley and Illah Nourbakhsh},
title = {Cognitive Evaluation of Human-Robot Systems: A Method for Analyzing Cognitive Change in Human-Robot Systems},
booktitle = {Proceedings of 15th IEEE International Symposium on Robot and Human Interactive Communication (RO-MAN '06)},
year = {2006},
month = {September},
pages = {59 - 65},
publisher = {IEEE},
keywords = {human-robot interaction, cognitive change},
}