Student Talks
Reconstructing Tree Skeletons in Agricultural Robotics: A Comparative Study of Single-View and Volumetric Methods
Abstract: This thesis investigates the problem of reconstructing tree skeletons for agricultural robotics, comparing single-view image-based (Image to 3D) and volumetric (3D to 3D) methods. Accurate 3D modeling is essential for robotic tasks like pruning and harvesting, where understanding the underlying branch structure is critical. Using a custom-generated dataset of synthetic trees, we train encoder-decoder [...]
Acoustic Neural 3D Reconstruction Under Pose Drift
Abstract: We consider the problem of optimizing neural implicit surfaces for 3D reconstruction using acoustic images collected with drifting sensor poses. The accuracy of current state-of-the-art 3D acoustic modeling algorithms is highly dependent on accurate pose estimation; small errors in sensor pose can lead to severe reconstruction artifacts. In this paper, we propose an algorithm [...]
Open-World Policy Steering for Robot Manipulation
Abstract: Generative robot policies have shown remarkable potential in learning complex, multimodal behaviors from demonstrations. However, at runtime, they still exhibit diverse failures ranging from task incompletion (e.g., toppling or dropping objects) to misaligned behaviors (e.g., placing the gripper inside of a cup of water). Instead of constantly re-training the policies with new data, we [...]
Deep 3D Geometric Reasoning for Robot Manipulation
Abstract: To solve general manipulation tasks in real-world environments, robots must be able to perceive and condition their manipulation policies on the 3D world. These agents will need to understand various common-sense spatial/geometric concepts about manipulation tasks: that local geometry can suggest potential manipulation strategies; that changes in observation viewpoint shouldn't affect the interpretation of [...]
Deformation-Aware Manipulation: Compliant and Geometric Approaches for Non-Anthropomorphic Hands
Abstract: Soft robot hands offer compelling advantages for manipulation tasks, including inherent safety through material compliance, robust adaptation to uncertain object geometries, and the ability to conform to complex shapes passively. However, these same properties create significant challenges for conventional sensing and control approaches. This talk presents approaches to bridging advances in geometric learning and [...]
Integrating Safety Across the Learning-Based Perception Pipeline: From Training to Deployment
Abstract: Robots operating in safety-critical environments must reason under uncertainty and novel situations. However, recent advances in data-driven perception have made it challenging to provide formal safety guarantees, particularly when systems encounter out-of-distribution or previously unseen inputs. For such systems to be safely deployed in the real world, we need to incorporate safety considerations alongside [...]
Toward Generalizable Interaction-aware Human Motion Prediction
Abstract: As autonomous robots are increasingly expected to operate in dynamic, human-centered environments, it is crucial to develop robot policies that ensure safe and seamless interactions with humans, all while allowing robots to complete their intended tasks efficiently. To achieve this, robots must be capable of making informed decisions that account for human preferences, ensuring [...]