Portrait of Jean Hyaejin Oh
Associate Research Professor
Home Department: RI
Office: 1723 Murray Ave
Administrative Assistant: Janice Phillips
Mailing Address

My research interests lie in the area of AI in robotics including autonomy, language understanding, multimodal perception, path planning, and machine learning. I am interested in creating persistent robots that can co-exist with humans in shared environments, learning to improve themselves over time through continuous training, exploration, and interactions. Toward this general goal, I am currently focusing on the translation of information among vision, language, and planning so that robots can 1) perceive better by fusing with verbal information provided by humans, 2) describe what they have observed in natural language, 3) generate semantic navigation plans by following complex directions, 4) learn to navigate in a socially compliant way, and 5) explain their past, current, and future actions and plans. As for the communication modalities for robots, I am primarily interested in verbal (text or speech) communication in natural language, but I am also interested in alternative ways for robots to express what goes on in their internal states, e.g., communication modalities studied in the arts and design community such as media arts.

Currently, I am leading the perception and the learning tasks for the DARPA Aircrew-Labor In-Cockpit Automation System (ALIAS) program (co-PI) that aims to bring intelligence to cockpits through semantic perception and learning new skills from observing experienced pilots. I am also a PI on the intelligence architecture subtask of the ARL RCTA program where my team’s work on language understanding on robot navigation won the Best Cognitive Robotics Paper Award at the IEEE International Conference on Robotics and Automation (ICRA) in 2015. My newest project is the US DoD – Korea MOTIE (co-PI) collaboration on robotics technologies for disaster response, where I will be leading the semantic map construction by leveraging text data from social media and crowdsourcing.

Displaying 72 Publications

2023
Conference Paper, Proceedings of IEEE-RAS International Conference on Humanoid Robots, December, 2023
Aloor JJ, Patrikar J, Kapoor P, Oh J, and Scherer S
Conference Paper, Proceedings of 2023 IEEE International Conference on Robotics and Automation (ICRA), pp. 1320-1326, 2023
2022
Jonathan Francis, Nariaki Kitamura, Felix Labelle, Xiaopeng Lu, Ingrid Navarro, and Jean Oh
Journal Article, Journal of Artificial Intelligence Research, Vol. 74, pp. 459-515, May, 2022
Conference Paper, Proceedings of (ICRA) International Conference on Robotics and Automation, May, 2022
Patrikar J, Dantas JP, Ghosh S, Kapoor P, Higgins I, Aloor JJ, Navarro I, Sun J, Stoler B, Hamidi M, Baijal R, Moon B, Oh J, and Scherer S
Journal Article, arXiv preprint arXiv:2211. 06932, 2022
2021
Maggie Wigness, John G. Rogers III, Chieh-En Tsai, Christoph Mertz, Luis Navarro-Serment, and Jean Oh
Journal Article, Field Robotics, Vol. 1, No. 1, pp. 1 - 33, October, 2021
Hyeonwoo Yu and Jean Oh
Journal Article, IEEE Robotics and Automation Letters, Vol. 6, No. 2, pp. 3405 - 3412, April, 2021
Journal Article, IEEE Robotics and Automation Letters, Vol. 6, No. 2, pp. 628 - 634, April, 2021
2020
Ardavan Bidgoli, Manuel Ladron De Guevara, Cinnie Hsiung, Jean Oh, and Eunsu Kang
Conference Paper, Proceedings of 29th IEEE International Conference on Robot and Human Interactive Communication (RO-MAN '20), pp. 412 - 418, August, 2020
Byeong-Uk Lee, Kyunghyun Lee, Jean Oh, and In So Kweon
Conference Paper, Proceedings of (ICRA) International Conference on Robotics and Automation, pp. 9722 - 9728, May, 2020