PhD Thesis Defense
PhD Student
Robotics Institute,
Carnegie Mellon University

Learning to Manipulate Using Diverse Datasets

NSH 4305

Abstract: Autonomous agents can play games (like Chess, Go, and even Starcraft), they can help make complex scientific predictions (e.g., protein folding), and they can even write entire computer programs, with just a bit of prompting. However, even the most basic physical manipulation skills, like unlocking and opening a door, still remain literally out-of-reach. The [...]

VASC Seminar
Mian Wei
PhD Candidate
University of Toronto

Passive Ultra-Wideband Single-Photon Imaging

3305 Newell-Simon Hall

Abstract: High-speed light sources, fast cameras, and depth sensors have made it possible to image dynamic phenomena occurring in ever smaller time intervals with the help of actively-controlled light sources and synchronization. Unfortunately, while these techniques do capture ultrafast events, they cannot simultaneously capture slower ones too. I will discuss our recent work on passive ultra-wideband [...]

PhD Thesis Proposal
PhD Student
Robotics Institute,
Carnegie Mellon University

3D Perception In-The-Wild

NSH 4305

Abstract: State estimation is a fundamental component of embodied perception. Contemporary autonomous vehicle (AV) benchmarks have advanced techniques for training 3D detectors, particularly on large-scale data. Notably, although prior work has nearly solved 3D object detection for a few common classes (e.g., pedestrian and car), detecting many rare classes in-the-tail (e.g., debris and stroller) remains [...]

MSR Thesis Defense
MSR Student
Robotics Institute,
Carnegie Mellon University

Learning on the Move: Integrating Action and Perception for Mobile Manipulation

Newell-Simon Hall 4305

Abstract: While there has been remarkable progress recently in the fields of manipulation and locomotion, mobile manipulation remains a long-standing challenge. Compared to locomotion or static manipulation, a mobile system must make a diverse range of long-horizon tasks feasible in unstructured and dynamic environments. While the applications are broad and interesting, there are a plethora [...]

PhD Thesis Proposal
PhD Student
Robotics Institute,
Carnegie Mellon University

Differentiable Convex Modeling for Robotic Planning and Control

NSH 4305

Abstract: Robotic simulation, planning, estimation, and control, have all been built on top of numerical optimization. In this same time, modern convex optimization has matured into a robust technology delivering globally optimal solutions in polynomial time. With advances in differentiable optimization and custom solvers capable of producing smooth derivatives, convex modeling has become fast, reliable, [...]

Seminar
Dr. Audrey Sedal
Assistant Professor
Mechanical Engineering, McGill University

Simulation-Driven Soft Robotics

Newell-Simon Hall 4305

Abstract: Soft-bodied robots present a compelling solution for navigating tight spaces and interacting with unknown obstacles, with potential applications in inspection, medicine, and AR/VR.  Yet, even after a decade, soft robots remain largely in the prototype phase without scaling to the tasks where they show the most promise. These systems are difficult to design and [...]

PhD Thesis Defense
PhD Student
Robotics Institute,
Carnegie Mellon University

Plan to Learn: Active Robot Learning by Planning

NSH 4305

Abstract: Robots need a diverse repertoire of capable motor skills to succeed in the open world. Such a skillset cannot be learned or designed purely on human initiative. In this thesis, we advocate for an active continual learning approach that enables robots to take charge of their own learning. The goal of an autonomously learning [...]

Faculty Events

RI Faculty Business Meeting

Newell-Simon Hall 4305

Meeting for RI Faculty. Discussions include various department topics, policies, and procedures. Generally meets weekly.

MSR Thesis Defense
MSR Student
Robotics Institute,
Carnegie Mellon University

Continual Personalization of Human Actions with Prompt Tuning

3305 Newell-Simon Hall

Abstract: In interactive computing devices (VR/XR headsets), users interact with the virtual world using hand gestures and body actions. Typically, models deployed in such XR devices are static and limited to their default set of action classes. The goal of our research is to provide users and developers with the capability to personalize their experience by [...]

PhD Thesis Defense
PhD Student
Robotics Institute,
Carnegie Mellon University

Policy Decomposition

NSH 4305

Abstract: Optimal Control is a popular formulation for designing controllers for dynamic robotic systems. Under the formulation, the desired long-term behavior of the system is encoded via a cost function and the policy, i.e. a mapping from the state of the system to control commands, to achieve the desired behavior are obtained by solving an [...]