A Long-Term Evaluation of Adaptive Interface Design for Mobile Transit Information - Robotics Institute Carnegie Mellon University

A Long-Term Evaluation of Adaptive Interface Design for Mobile Transit Information

Oscar J. Romero, Alexander Haig, Lynn Kirabo, Qian Yang, John Zimmerman, Anthony Tomasic, and Aaron Steinfeld
Conference Paper, Proceedings of 22nd International Conference on Human-Computer Interaction with Mobile Devices and Services (MobileHCI '20), October, 2020

Abstract

Personalization of user experience has a long history of success in the HCI community. More recently the community has focused on adaptive user interfaces, supported by machine learning, that reduce interaction efforts and improves user experience by collapsing transactions and pre-filtering results. However, generally, these more recent results have only been demonstrated in the laboratory environment. In this paper, we share the case of a deployed mobile transit app that adapts based on users’ previous usage. We examine the impact of adaptation, both good and bad, and user abandonment rates. We conducted an 18-month assessment where 2,616 participants (with and without vision impairments) were recruited and participated in an A/B study. Finally, we draw some insights on some unusual effects that appear over the long term.

BibTeX

@conference{Romero-2020-126464,
author = {Oscar J. Romero and Alexander Haig and Lynn Kirabo and Qian Yang and John Zimmerman and Anthony Tomasic and Aaron Steinfeld},
title = {A Long-Term Evaluation of Adaptive Interface Design for Mobile Transit Information},
booktitle = {Proceedings of 22nd International Conference on Human-Computer Interaction with Mobile Devices and Services (MobileHCI '20)},
year = {2020},
month = {October},
}