Recog: Supporting blind people in recognizing personal objects - Robotics Institute Carnegie Mellon University

Recog: Supporting blind people in recognizing personal objects

Dragan Ahmetovic, Daisuke Sato, Uran Oh, Tatsuya Ishihara, Kris Kitani, and Chieko Asakawa
Conference Paper, Proceedings of CHI Conference on Human Factors in Computing Systems (CHI '20), April, 2020

Abstract

We present ReCog, a mobile app that enables blind users to recognize objects by training a deep network with their own photos of such objects. This functionality is useful to differentiate personal objects, which cannot be recognized with pre-trained recognizers and may lack distinguishing tactile features. To ensure that the objects are well-framed in the captured photos, ReCog integrates a camera-aiming guidance that tracks target objects and instructs the user through verbal and sonification feedback to appropriately frame them.

BibTeX

@conference{Ahmetovic-2020-126509,
author = {Dragan Ahmetovic and Daisuke Sato and Uran Oh and Tatsuya Ishihara and Kris Kitani and Chieko Asakawa},
title = {Recog: Supporting blind people in recognizing personal objects},
booktitle = {Proceedings of CHI Conference on Human Factors in Computing Systems (CHI '20)},
year = {2020},
month = {April},
}