PhD Thesis Proposal
Robotics Institute,
Carnegie Mellon University

Sparse and Dense Methods for Underwater Localization and Mapping with Imaging Sonar

GHC 4405

Abstract: Imaging sonars have been used for a variety of tasks geared towards increasing autonomy of underwater vehicles: image registration and mosaicing, vehicle localization, object recognition, mapping, and path planning, to name a few. However, the complexity of the image formation has led many algorithms to make the restrictive assumption that the scene geometry is [...]

PhD Thesis Proposal
Robotics Institute,
Carnegie Mellon University

Deep Interpretable Non-rigid Structure from Motion

GHC 4405

Abstract: Current non-rigid structure from motion (NRSfM) algorithms are limited with respect to: (i) the number of images, and (ii) the type of shape variability they can handle. This has hampered the practical utility of NRSfM for many applications within vision. Deep Neural Networks (DNNs) are an obvious candidate to help with such issue. However, [...]

PhD Speaking Qualifier
Robotics Institute,
Carnegie Mellon University

Robot Task Execution by Policy Adaptation and Switching Among Multiple Tasks

GHC 8102

Abstract: While mobile robots reliably perform service tasks by accurately localizing and safely navigating while avoiding obstacles, they do not respond in any other way to their surroundings. In this work, we introduce two methods that enable the robots to be more responsive to their environment, including humans and other robots. The first algorithm enables [...]

PhD Thesis Proposal
Robotics Institute,
Carnegie Mellon University

Vision with Small Baselines

NSH 4305

Abstract: Portable camera sensor systems are becoming more and more popular in computer vision applications such as autonomous driving, virtual reality, robotics manipulation and surveillance, due to the decreasing expense and size of RGB camera. Despite the compactness and portability of the small baseline vision systems, it is well-known that the uncertainty in range finding [...]

PhD Thesis Proposal
Robotics Institute,
Carnegie Mellon University

Machine Imagination: Data-driven User Controllable Visual Content Creation

NSH 3305

Abstract: Humans have the remarkable ability to create visual worlds far beyond what could be seen by human eye, including inferring the state of unobserved, imagining the unknown, and thinking about diverse possibilities about what lies in the future. Machines lack this inquisitive ability despite the current revolution in machine learning and computer vision. We [...]

PhD Speaking Qualifier
Robotics Institute,
Carnegie Mellon University

Persistent Multi-Robot Mapping in an Uncertain Environment

GHC 8102

Abstract: We present a system that addresses the challenge of concurrently mapping, scheduling, and deploying a team of energy-constrained robots to persistently cover an unknown and potentially dynamic environment. This system can passively maintain an accurate representation of occupied space, allowing robots reliable access for monitoring, study, or search and rescue. Current state-of-the-art algorithms only [...]

PhD Thesis Defense
Robotics Institute,
Carnegie Mellon University

Learning with Clusters

GHC 8102

Abstract: Clustering, the problem of grouping similar data, has been extensively studied since at least the 1950's. As machine learning becomes more prominent, clustering has evolved from primarily a data analysis tool into an integrated component of complex robotic and machine learning systems, including those involving dimensionality reduction, anomaly detection, network analysis, image segmentation and [...]

PhD Thesis Proposal
Robotics Institute,
Carnegie Mellon University

Spatiotemporal Understanding of People Using Scenes, Objects, and Poses

NSH 1305

Abstract: Humans are arguably one of the most important entities that AI systems would need to understand to be useful and ubiquitous. From autonomous cars observing pedestrians to assistive robots helping the elderly, a large part of this understanding is focused on recognizing human actions, and potentially, their intentions. Humans themselves are quite good at [...]

PhD Thesis Defense
Robotics Institute,
Carnegie Mellon University

Sensing, Measuring, and Modeling Social Signals in Nonverbal Communication

GHC 4405

Abstract: Humans convey their thoughts, emotions, and intentions through a concert of social displays: voice, facial expressions, hand gestures, and body posture, collectively referred to as social signals. Despite advances in machine perception, machines are unable to discern the subtle and momentary nuances that carry so much of the information and context of human communication. [...]