PhD Thesis Proposal
Robotics Institute,
Carnegie Mellon University

Resource-Constrained State Estimation with Multi-Modal Sensing

GHC 4405

Abstract: Accurate and reliable state estimation is essential for safe mobile robot operation in real-world environments because ego-motion estimates are required by many critical autonomy functions such as control, planning, and mapping. Computing accurate state estimates depends on the physical characteristics of the environment, the selection of suitable sensors to capture that information, and the [...]

PhD Thesis Proposal
Robotics Institute,
Carnegie Mellon University

Open-world Object Detection and Tracking

NSH 3002

Abstract: Computer vision today excels at recognition in narrow slices of the real world. Our systems seem to accurately detect cats, cars, or chairs, but largely ignore the vast diversity of objects in the world that are absent from our training datasets. Perception in the open world, however, requires detecting and tracking any object, regardless [...]

PhD Thesis Proposal
Robotics Institute,
Carnegie Mellon University

‘Unboxing’ anomaly detection and panoptic segmentation

GHC 4405

Abstract: Panoptic segmentation is a recent problem in computer vision that attempts to classify each pixel in an image according to its semantic and instance label (accomplishing both semantic segmentation and instance segmentation respectively). Most existing panoptic and instance segmentation methods run a detection-first pipeline, where a bounding box is placed around an object and [...]

PhD Thesis Proposal
Robotics Institute,
Carnegie Mellon University

Transfers Between Multiple Service Robots

GHC 4405

Abstract: With the deployment of more robots, human-robot interaction will no longer be limited to a one-to-one interaction between a user and a robot. Instead, users will likely have to interact with multiple robots, simultaneously or sequentially, throughout their day to receive services and complete different tasks. In this thesis proposal, I am proposing joint [...]

PhD Thesis Proposal
Robotics Institute,
Carnegie Mellon University

Machine Learning Parallelism Could Be Adaptive, Composable and Automated

NSH 3305

Abstract: In recent years, the pace of innovations in the fields of machine learning has accelerated. To cope with the sheer computational complexity of training large ML models on large datasets, researchers in SysML have created algorithms and systems that parallelize ML training and inference over multiple CPUs or GPUs, or even multiple computing nodes [...]

PhD Thesis Proposal
Robotics Institute,
Carnegie Mellon University

Expressive Real-time Intersection Scheduling: New Methods for Adaptive Traffic Signal Control

GHC 6501

Abstract: Traffic congestion is a widespread problem throughout global metropolitan areas. In this thesis, we consider methods to optimize the performance of traffic signals to reduce congestion. We begin by presenting Expressive Real-time Intersection Scheduling (ERIS), a schedule-driven intersection control strategy that runs independently on each intersection in a traffic network. For each intersection, ERIS [...]

PhD Thesis Proposal

Adaptive Planning and Control of Wheeled Mobile Robots in Challenging Environments

GHC 4405

Abstract: Over the last two decades, we have seen driverless cars conquer the Mojave desert, drive on mars and operate on our streets and warehouses. One of the most fundamental requirements of such robots is their ability to navigate their environment with minimal human oversight. As more robots graduate from the confines of laboratories to [...]

PhD Thesis Proposal
Robotics Institute,
Carnegie Mellon University

Learning Dense 3D Object Reconstruction without Geometric Supervision

GHC 6501

Abstract: Geometric alignment across visual data has been the fundamental issue for effective and efficient computer vision algorithms. The established pixel correspondences between images indirectly infer the underlying 3D geometry, physically or semantically. While this builds the foundation of classical multi-view 3D reconstruction algorithms such as Structure from Motion (SfM) and Simultaneous Localization and Mapping [...]

PhD Thesis Proposal
Robotics Institute,
Carnegie Mellon University

Eye Gaze for Assistive Manipulation

NSH 4305

Abstract: Full robot autonomy is the traditional goal of robotics research. To work in a human-inhabited world, however, robots will often need to collaborate with humans. Many scenarios require human users to teleoperate robots to perform tasks, a paradigm that appears everywhere from space exploration, to disaster recovery, to assistive robotics. This collaboration enables tasks [...]

PhD Thesis Proposal
Robotics Institute,
Carnegie Mellon University

Stability-Centric Mechanics for Rigid Body Manipulation

NSH 4305

Abstract: The repertoire of human manipulation is filled with creative use of contacts to move the object about the hand and the environment. It’s the combination of these skills that makes human manipulation dexterous. However, in most robotic applications the robot just fix all contact points on the object and do grasping. Reliable robot manipulation [...]