Student Talks
Calendar of Events
S Sun
M Mon
T Tue
W Wed
T Thu
F Fri
S Sat
0 events,
0 events,
0 events,
0 events,
1 event,
PhD Speaking Qualifier
Willa Potosnak
Investigating Compositional Reasoning in Time Series Foundation Models
Abstract: Large pre-trained time series foundation models (TSFMs) have demonstrated promising zero-shot performance across a wide range of domains. However, a question remains: Do TSFMs succeed solely by memorizing training patterns, or do they possess the ability to reason? While reasoning is a topic of great interest in the study of Large Language Models (LLMs), […]
4 events,
MSR Thesis Defense
Ryan Aponte
Learning from Animal and Human Videos
Abstract: Animals and humans can learn from the billions of years of life on Earth and the evoluNon that has shaped it. If robots can borrow from that wealth of experience, they too could be enabled to learn from the experience, instead of learning through brute force trial-and-error. Learning from internet-scale videos, such as the […]
PhD Speaking Qualifier
Hanzhe Hu
Learning Efficient 3D Generation
Abstract: Recent advances in 3D generation have enabled the synthesis of multi-view images using large-scale pre-trained 2D diffusion models. However, these methods typically require dozens of forward passes, resulting in significant computational overhead. In this talk, we introduce Turbo3D, an ultra-fast text-to-3D system that generates high-quality Gaussian Splatting assets in under one second. Turbo3D features a […]
MSR Thesis Defense
Xinyu Wang
Reconstructing Tree Skeletons in Agricultural Robotics: A Comparative Study of Single-View and Volumetric Methods
Abstract: This thesis investigates the problem of reconstructing tree skeletons for agricultural robotics, comparing single-view image-based (Image to 3D) and volumetric (3D to 3D) methods. Accurate 3D modeling is essential for robotic tasks like pruning and harvesting, where understanding the underlying branch structure is critical. Using a custom-generated dataset of synthetic trees, we train encoder-decoder […]
MSR Thesis Defense
Tianxiang Lin
Acoustic Neural 3D Reconstruction Under Pose Drift
Abstract: We consider the problem of optimizing neural implicit surfaces for 3D reconstruction using acoustic images collected with drifting sensor poses. The accuracy of current state-of-the-art 3D acoustic modeling algorithms is highly dependent on accurate pose estimation; small errors in sensor pose can lead to severe reconstruction artifacts. In this paper, we propose an algorithm […]
0 events,
0 events,
2 events,
PhD Speaking Qualifier
Yilin Wu
Open-World Policy Steering for Robot Manipulation
Abstract: Generative robot policies have shown remarkable potential in learning complex, multimodal behaviors from demonstrations. However, at runtime, they still exhibit diverse failures ranging from task incompletion (e.g., toppling or dropping objects) to misaligned behaviors (e.g., placing the gripper inside of a cup of water). Instead of constantly re-training the policies with new data, we […]
PhD Thesis Defense
Benjamin Eisner
Deep 3D Geometric Reasoning for Robot Manipulation
Abstract: To solve general manipulation tasks in real-world environments, robots must be able to perceive and condition their manipulation policies on the 3D world. These agents will need to understand various common-sense spatial/geometric concepts about manipulation tasks: that local geometry can suggest potential manipulation strategies; that changes in observation viewpoint shouldn't affect the interpretation of […]
1 event,
PhD Thesis Proposal
Uksang Yoo
Deformation-Aware Manipulation: Compliant and Geometric Approaches for Non-Anthropomorphic Hands
Abstract: Soft robot hands offer compelling advantages for manipulation tasks, including inherent safety through material compliance, robust adaptation to uncertain object geometries, and the ability to conform to complex shapes passively. However, these same properties create significant challenges for conventional sensing and control approaches. This talk presents approaches to bridging advances in geometric learning and […]
0 events,
1 event,
MSR Thesis Defense
Vihaan Misra
Towards Natural Language-Driven Shape Arrangement Synthesis using Semantically-Aware Geometric Constraints
Abstract: While diffusion-based models excel at generating photorealistic images from text, a more nuanced challenge emerges when constrained to using only a fixed set of rigid shapes—akin to solving tangram puzzles or arranging real-world objects to match semantic descriptions. We formalize this problem as shape-based image generation, a new natural language-guided image-to-image translation task that […]
1 event,
PhD Thesis Proposal
Ingrid Navarro
Toward Generalizable Interaction-aware Human Motion Prediction
Abstract: As autonomous robots are increasingly expected to operate in dynamic, human-centered environments, it is crucial to develop robot policies that ensure safe and seamless interactions with humans, all while allowing robots to complete their intended tasks efficiently. To achieve this, robots must be capable of making informed decisions that account for human preferences, ensuring [...]
0 events,
0 events,
4 events,
MSR Thesis Defense
Muhan Lin
Enhancing Reinforcement Learning with Error-Prone Language Models
The correct specification of reward models is a well-known challenge in reinforcement learning. Hand-crafted reward functions, which are usually sparse, often lead to inefficient or suboptimal policies, misalignment with user values, or difficulties in attributing credit or blame within multi-agent systems. Reinforcement learning from human feedback is a successful technique that can mitigate such issues [...]
PhD Thesis Proposal
Rishi Veerapaneni
Efficient Multi-Agent Motion Planning using Local Policies
Abstract: Teams of multiple robots working together can achieve challenging tasks like warehouse automation, search and rescue, and cooperative construction. However, finding efficient collision-free motions for all agents is extremely challenging as the complexity of the multi-agent motion planning (MAMP) problem grows exponentially with the number of agents. Multi-Agent Path Finding (MAPF) is a subset [...]
MSR Thesis Defense
Wenli Xiao
Foundation Control Model for General Embodied Intelligence
Abstract: With the growing accessibility of humanoid hardware and rapid advances in foundation models, we are entering an era where achieving general embodied intelligence is within reach—enabling humanoid robots to perform a wide range of tasks in human-centric environments. Despite significant progress in language and vision foundation models, controlling humanoids with high degrees of freedom [...]
MSR Thesis Defense
Tairan He
Learning Humanoid Robots from Simulation to Real to Simulation
Abstract: How do we teach humanoid robots to move like humans—and do so reliably in the real world? In this talk, I’ll share my journey in building a learning-based pipeline that closes the loop between simulation and reality for humanoid whole-body control. Starting from real-time teleoperation (H2O), to scalable data humanoid collection (OmniH2O), to learning [...]
2 events,
MSR Thesis Defense
Shuyang Shi
Experience-Based Action Advising for Multi-Agent Teaming
Abstract: We study how to improve coordination efficiency for multi-agent teams with heterogeneously experienced agents. In such a setting, experienced agents can transfer their knowledge to less experienced agents to accelerate their learning, while leveraging the students' initial expertise to inform what knowledge to transfer. Inspired by this idea, this work specifically assumes one teacher [...]
MSR Thesis Defense
Yanbo Xu
Towards Controllable Sampling and Diverse Score Distillation in Diffusion Models
Abstract: Denoising diffusion models have emerged as a powerful paradigm for generative modeling, which has been widely used for perception, generation, and action. These models can be utilized through sampling or score distillation; however, existing methods lack controllability in sampling and suffer from limited diversity in score distillation. In this thesis, we propose two complementary mechanisms to enhance the [...]
1 event,
MSR Thesis Defense
Sidney Nimako-Boateng
RESCUE Rollers: A Platform for Collaborative, Multi-robot Exploration in Search and Rescue
Abstract: The use of robotic platforms for search and rescue remains a significant challenge for many roboticist. While human and animal first responders play critical roles, their effectiveness can be limited by biological constraints. Robotic systems offer the potential to overcome these limitations, especially in environments inaccessible to humans and animals due to size or [...]
2 events,
PhD Thesis Proposal
Yufei Wang
Scaling, Automating and Adapting Sim-to-real Policy Learning
Abstract: Building a generalist robot capable of performing diverse tasks in unstructured environments remains a longstanding challenge. A recent trend in robot learning aims to address this by scaling up demonstration datasets for imitation learning. However, most large-scale robotics datasets are collected in the real-world, often via manual teleoperation. This process is labor-intensive, slow, hardware-dependent, [...]
PhD Thesis Defense
Mononito Goswami
Towards Pragmatic Time Series Intelligence
Abstract: This thesis aims to democratize time series intelligence by making advanced modeling capabilities accessible to users without specialized machine learning knowledge. We pursue this goal through three complementary contributions that build foundation models, improve our understanding of them, and address challenges emerging in their practical use. We start by introducing MOMENT, the first family [...]
1 event,
PhD Thesis Proposal
Paulo Rotband Marchtein Fisch
Advancing Spacecraft Autonomy: Optimal GNC, Vision-Based Estimation, and Systems Integration for Small Spacecraft
Abstract: Optimization and machine learning-based methods are increasingly critical in enhancing the autonomy, efficiency, and overall return on investment (ROI) of small, resource-constrained spacecraft. By enabling more effective decision-making, adaptive control, and robust state estimation, these techniques expand mission capabilities while operating within strict mass, power, and computational limitations. This thesis builds on previous contributions […]
0 events,
0 events,
0 events,
1 event,
PhD Thesis Proposal
Huy Quyen Ngo
Human-System Communications for Expectation Mismatch
Abstract: Robots, and autonomous systems in general, are becoming increasingly more advanced beyond traditional functions. This can potentially widen the mismatch between human expectations of system behaviors during interaction, especially when the systems behave unexpectedly. Unexpected system behaviors could induce negative emotional responses in humans, which not all systems have the capability of recognizing and […]