PhD Thesis Proposal
PhD Student
Robotics Institute,
Carnegie Mellon University

Communication Efficient and Differentially Private Optimization

NSH 4305

Abstract: In recent years, the integration of communication efficiency and differential privacy in distributed optimization has gained significant attention, motivated by large-scale applications such as Federated Learning (FL), where both data privacy and efficient communication are critical. This thesis explores the development of novel techniques to address these challenges, with a focus on distributed mean [...]

PhD Thesis Defense
PhD Student
Robotics Institute,
Carnegie Mellon University

Towards a Universal Data Engine for Robotics and Beyond

GHC 4405

Abstract: Robotics researchers have been attempting to extend data-driven breakthroughs in fields like computer vision and language processing into robot learning. However, unlike vision or language domains where massive amounts of data is readily available on the internet, training robotic policies relies on physical and interactive data collected via interacting with the physical world -- [...]

RI Seminar
Assistant Professor
Robotics Institute,
Carnegie Mellon University

Learning for Dynamic Robot Manipulation of Deformable and Transparent Objects

1403 Tepper School Building

Abstract: Dynamics, softness, deformability, and difficult-to-detect objects will be critical for new domains in robotic manipulation. But there are complications--including unmodelled dynamic effects, infinite-dimensional state spaces of deformable objects, and missing features from perception. This talk explores learning methods based on multi-view sensing, acoustics, physics-based regularizations, and Koopman operators and proposes a novel multi-finger soft [...]

PhD Speaking Qualifier
PhD Student
Robotics Institute,
Carnegie Mellon University

HaptiClay: An Interactive Haptic Interface for Gestured Concretization of Polynomial Functions

NSH 4305

Abstract: In this work we present HaptiClay, a low-cost kinesthetic haptic interface that elevates the understanding of mathematics language by providing embodied non-verbal representations of math concepts. Our interface integrates four key components: a haptic device, a high-level simulation that communicates with a low-level controller for force and position updates, a low-level controller that executes [...]

VASC Seminar
Dr. Yin Yang
Associate Professor
Kahlert School of Computing, University of Utah

High-resolution cloth simulation in milliseconds: Efficient GPU Cloth Simulation with Non-distance Barriers and Subspace Reuse Interactions

3305 Newell-Simon Hall

Abstract: We show how to push the performance of high-resolution cloth simulation, making the simulation interactive (in milliseconds) for models with one million degrees of freedom (DOFs) while keeping every triangle untangled. The guarantee of being penetration-free is inspired by the interior-point method, which converts the inequality constraints to barrier potentials. Nevertheless, we propose a [...]

PhD Thesis Proposal
PhD Student
Robotics Institute,
Carnegie Mellon University

Better Standards for Trajectory Forecasting: Data, Evaluation, and Methods

GHC 8102

Abstract: Ensuring pedestrian safety in dynamic environments is a key challenge for autonomous systems, particularly in dynamic, multi-agent environments. Trajectory forecasting plays a central role in enabling these systems to anticipate pedestrian behaviors and respond appropriately. This thesis addresses three core limitations in trajectory forecasting systems which impede safe and robust trajectory forecasting: inadequate evaluation protocols [...]

PhD Thesis Proposal
PhD Student
Robotics Institute,
Carnegie Mellon University

Bridging Generative and Discriminative Learning with Diffusion Models

GHC 4405

Abstract: Generative models have advanced significantly, synthesizing photorealistic images, videos, and text. Building on this progress, our work explores the potential of diffusion models to bridge generative and discriminative learning, uncovering new pathways for leveraging their strengths in visual perception tasks. In the first part, we propose Diff-2-in-1, a unified framework for multi-modal data generation [...]

PhD Thesis Proposal
PhD Student
Robotics Institute,
Carnegie Mellon University

Bring Hand to The Air: Towards Universal Aerial Manipulation

NSH 4305

Abstract: Uncrewed Aerial Vehicles (UAVs) have attracted the interest of researchers, industry, and the general public in many applications. Noticing that high-altitude tasks sometimes require active interaction with the environment, there have been more and more works focusing on aerial manipulation recently. Each of them has demonstrated the ability to use a specific aerial manipulator [...]

PhD Thesis Defense
PhD Student
Robotics Institute,
Carnegie Mellon University

Robust Reinforcement Learning for Safety Critical Applications via Curricular Learning

NSH 4305

Abstract:  Reinforcement Learning (RL) presents great promises for autonomous agents. However, when using robots in a safety critical domain, a system has to be robust enough to be deployed in real life. For example, the robot should be able to perform across different scenarios it will encounter. The robot should avoid entering undesirable and irreversible [...]

VASC Seminar
Jiaqi Ma
Assistant Professor
University of Illinois Urbana-Champaign

Practical Challenges and Recent Advances in Data Attribution

3305 Newell-Simon Hall

Abstract: Data plays an increasingly crucial role in both the performance and the safety of AI models. Data attribution is an emerging family of techniques aimed at quantifying the impact of individual training data points on a model trained on them, which has found data-centric applications such as training data curation, instance-based explanation, and copyright [...]

PhD Thesis Proposal
PhD Student
Robotics Institute,
Carnegie Mellon University

Spatial Reasoning and Semantic Representations for Intelligent Multi-Robot Exploration and Navigation

NSH 4305

Abstract: Autonomous robot exploration is widely applied in areas such as search and rescue, environmental monitoring, and structural inspection. Multi-robot exploration has garnered significant attention in the robotics research community, as it enables faster task completion and greater coverage than a single robot can achieve. However, it presents unique challenges: behavior coordination is complex, communication [...]

MSR Thesis Defense
MSR Student / MSR Student
Robotics Institute,
Carnegie Mellon University

Autonomous Sensor Insertion and Exchange for Cornstalk Monitoring Robot

Newell-Simon Hall 4305

Abstract: Interactive sensors are an important component of robotic systems but often require manual replacement due to wear and tear. Automating this process can enhance system autonomy and facilitate long-term deployment. We developed an autonomous sensor exchange and maintenance system for an agriculture crop monitoring robot that inserts a nitrate sensor into cornstalks. A novel [...]

PhD Thesis Proposal
PhD Student
Robotics Institute,
Carnegie Mellon University

Leveraging Sense of Agency to Improve the Experience of Control Over Assistive Robots

GHC 6121

Abstract: In an age of autonomous driving and robotics, we are increasingly engaging with robots that deploy autonomous assistance. Cognitive science and human-computer interaction literature tells us that, when we apply autonomy in assistive settings, we are often augmenting the user's sense of agency over the system. Sense of agency is a phenomenon from cognitive [...]

PhD Thesis Proposal
PhD Student
Robotics Institute,
Carnegie Mellon University

Artificial Intelligence in Support of Emergency Care in the Field

GHC 6115

Abstract: Medical emergencies demand rapid and accurate interventions to save lives. Severe injuries often require surgical care within the first 60 minutes when timely action significantly improves survival rates. However, limited resources, remote locations, and unpredictable conditions often obstruct access to advanced medical care during this critical period. This thesis focuses on developing a medical [...]

PhD Thesis Proposal
PhD Student
Robotics Institute,
Carnegie Mellon University

Efficient Synthetic Data Generation and Utilization for Action Recognition and Universal Avatar Generation

NSH 3305

Abstract: Human-centered computer vision technology relies heavily on large, diverse datasets, but collecting data from human subjects is time-consuming, labor-intensive, and raises privacy concerns. To address these challenges, researchers are increasingly using synthetic data to augment real-world datasets. This thesis explores efficient methods for generating and utilizing synthetic data to train human-based computer vision models. [...]

PhD Thesis Defense
PhD Student
Robotics Institute,
Carnegie Mellon University

Communication-Efficient Active Reconstruction using Self-Organizing Gaussian Mixture Models

GHC 4405

Abstract: For the multi-robot active reconstruction task, this thesis proposes using Gaussian mixture models (GMMs) as the map representation that enables multiple downstream tasks: high-fidelity static scene reconstruction, communication-efficient map sharing, and safe informative planning. A new method called Self-Organizing Gaussian mixture modeling (SOGMM) is proposed that estimates the model complexity (i.e., number of Gaussian [...]

Faculty Events

RI Faculty Business Meeting

Newell-Simon Hall 4305

Meeting for RI Faculty. Agenda was sent via a calendar invite.