Title: Robot Learning for Manipulation of Granular Materials   Abstract: Granular materials are ubiquitous in household and industrial manipulation tasks, but their dynamics are difficult to model analytically or through simulation. During manipulation, they provide rich multimodal sensory feedback. We present a robotic system we constructed for investigating manipulation of granular materials.   We present [...]

Title: Volumetric Correspondence Networks for Stereo Matching and Optical Flow Abstract: Many classic tasks in vision, such as the estimation of optical flow or stereo disparities, can be cast as dense correspondence matching. Well-known techniques for doing so make use of a cost volume, which is typically a 3D/4D tensor of match costs between all [...]

Title: Surfel-based RGB-D Reconstruction and SLAM with Global and Local Consistency   Abstract: Achieving high surface reconstruction accuracy in dense mapping has been a desirable target for both robotics and vision communities. In the robotics literature, simultaneous localization and mapping (SLAM) systems use depth-enabled cameras to reconstruct a dense map of the environment. They leverage [...]

Title: Precision UAV Landing in Unstructured Environments Abstract: The autonomous landing of a drone is an important part of autonomous flight. One way to have a high certainty of safety in landing is to return the drone to the same location it took-off from. Current implementations of the return-to-home functionality fall short when relying solely [...]

Title: Joint Surface Reconstruction from Monocular Vision and LiDAR   Abstract: In recent years, dense reconstruction gains popularity because of its broad applications in inspection, mapping, and planning. Cameras or LiDARs are generally deployed for 3D dense reconstruction. However, current reconstruction pipelines based on cameras or LiDARs have significant limitations in achieving an accurate and [...]

Title: Automatic detection of human affective behavior in dyadic conversations Abstract: Emotion is communicated through face, voice, and body motion in interpersonal contexts. Yet, most approaches to automatic detection emphasize a single modality (especially face or voice), ignore social context, and focus on well-defined signs of emotion (e.g., smile).  This thesis addresses multimodal, interpersonal emotion [...]

Title: Structured Representations for Behaviors of Autonomous Robots   Abstract: Autonomous robot behavior can be captured in many ways: as code, as modules of code, in an unstructured form such as a neural net, or in one of several more structured formats such as a graph, table, or tree. This talk explores structured representations that [...]

Title: Vision and Improved Learned-Trajectory Replay for Assistive-Feeding and Food-Plating Robots   Abstract: Food manipulation offers an interesting frontier for robotics research because of the direct application of this research to real-world problems and the challenges involved in robust manipulation of deformable food items. In this talk, we focus on the challenges associated with robots manipulating [...]

Title: Leveraging Multimodal Sensory Data for Robust Cutting   Abstract: Cutting food is a challenging task due to the variety of material properties across food items. In addition, different events occur during the slicing process that need to be monitored and detected for robust execution, such as when a knife has completely cut through a [...]