Natural Language Instructions for Human-robot Collaborative Manipulation
Journal Article, International Journal of Robotics Research, Vol. 37, No. 6, pp. 558 - 565, May, 2018
Abstract
This paper presents a dataset of natural language instructions for object reference in manipulation scenarios. It comprises 1582 individual written instructions, which were collected via online crowdsourcing. This dataset is particularly useful for researchers who work in natural language processing, human–robot interaction, and robotic manipulation. In addition to serving as a rich corpus of domain-specific language, it provides a benchmark of image–instruction pairs to be used in system evaluations and uncovers inherent challenges in tabletop object specification. Example code is provided for easy access via Python.
BibTeX
@article{Scalise-2018-113229,author = {Rosario Scalise and Shen Li and Henny Admoni and Stephanie Rosenthal and Siddhartha S. Srinivasa},
title = {Natural Language Instructions for Human-robot Collaborative Manipulation},
journal = {International Journal of Robotics Research},
year = {2018},
month = {May},
volume = {37},
number = {6},
pages = {558 - 565},
}
Copyright notice: This material is presented to ensure timely dissemination of scholarly and technical work. Copyright and all rights therein are retained by authors or by other copyright holders. All persons copying this information are expected to adhere to the terms and constraints invoked by each author's copyright. These works may not be reposted without the explicit permission of the copyright holder.