Title: Interpretable Intuitive Physics Model   Abstract: Humans have a remarkable ability to use physical commonsense and predict the effect of collisions. But do they understand the underlying factors? Can they predict if the underlying factors have changed? Interestingly, in most cases humans can predict the effects of similar collisions with different conditions such as changes [...]

Title: Learning for Registration in 2D and 3D   Abstract: We explore the application of deep learning to 2D (image) and 3D (point cloud) registration, especially in scenarios where traditional methods can fail.   In the 2D case, we apply a recently-proposed learning method to the problem of aligning outdoor imagery taken across different seasons or [...]

Title: Inverse Reinforcement Learning for Autonomous Ground Navigation Using Aerial and Satellite Observation Data   Abstract: Inverse Reinforcement Learning(IRL) is a supervised learning paradigm where a learner observes expert demonstrations to learn the hidden cost function to mimic the expert's behavior. Eliminating the need for elaborate feature engineering, deep IRL approaches have been gaining interests [...]

Title: Detecting objects in videos under occlusion   Abstract: While object detection in videos has received a lot of attention in the past few years, most existing methods in this domain do not target detecting objects when they are occluded. However, being able to detect or track an object of interest through occlusion has been [...]

Title: Detailed Image Captioning with Hierarchical Attention   Abstract:  Automatic image description is the task of generating a natural sentence which reflects the visual content of an image. A lot of deep learning architectures have been explored in the past few years. While researchers have made great improvement on generating syntactically correct sentences by learning from [...]

Title:  Inching for Planetary Rovers   Abstract: . Inching, also called push-rolling, is method of moving for vehicles that can change the position of their wheels relative to their body.  Like an inchworm, it is possible to hold some wheels stationary while advancing the others and the body.  In this research a test apparatus capable [...]

Title: Improving Scalability in Multi-Robot Systems with Abstraction and Specialization   Abstract: Planning and controlling multi-robot systems is challenging due to high dimensionality. When the number of robots increases in the system, the complexity of computation grows exponentially. In this thesis, we examine the scalability problem in planning and control of the multi-robot system. We propose [...]

Title: A Generative Approach for Socially Compliant Navigation   Abstract: Robots navigating in human crowds need to optimize their paths not only for the efficiency of their tasks performance but also for the compliance to social norms. One of the key challenges in this context is due to the lack of suitable metrics for evaluating and [...]

Title: 3D Face Geometry Capture Using Monocular Video   Abstract: Accurate reconstruction of facial geometry has been one of the oldest tasks in computer vision. Despite being a long-studied problem, many modern methods fail to reconstruct realistic looking faces or rely on highly constrained environments for capture. High fidelity face reconstructions have so far been [...]

Title: Unsupervised Learning for 3D Reconstruction and Blocks World Representation Abstract: Recovering the dense 3D structure of a scene from its images has been a long-standing goal in computer vision. Recent years have seen attempts of encoding richer priors into the geometry-based pipelines with the introduction of learning based methods. We argue that the form of 3D [...]

Title: A structured model for action detection   Abstract:  A dominant paradigm for learning-based approaches in computer vision is training generic models, such as ResNet for image recognition, or I3D for video understanding, on large datasets and allowing them to discover the optimal representation for the problem at hand. While this is an obviously attractive approach, [...]

Title: Canonical Surface Mapping via Geometric Cycle Consistency   Abstract: We explore the task of Canonical Surface Mapping (CSM).  Specifically, given an image, we learn to map pixels on the object to their corresponding locations on an abstract 3D model of the category. But how do we learn such a mapping? A supervised approach would [...]

Title: Leveraging Structure for Generalization and Prediction in Visual System. Abstract: Our surrounding world is highly structured. Humans have a great capacity of understanding and leveraging those structures to generalize to novel scenarios and to predict the future. The thesis studies how computer vision systems benefit from the similar process -- leveraging inherent structures in [...]

Title: Self-Supervised Robot Learning   Abstract: Supervised learning has been used in robotics to solve various tasks like navigation, fine manipulation, etc.  While it has shown a promising result, in most cases the supervision comes from the human agent.  However, relying on human is a huge bottleneck to scale up these approaches.  In this thesis, [...]

Title: A fast algorithm for consecutive ones with applications in item labeling   Abstract: We develop and analyze a general problem in a crowd-sourced setting: users pick a label from a set of candidates for a set of items; the problem is to determine the most likely label for each item, as well as a ranking [...]

Title: Real-Time Collision Forecasting from Monocular Video   Abstract:  We explore the possibility of using a single monocular camera to forecast the time to collision between a suitcase-shaped robot being pushed by its user and other nearby pedestrians. We develop a purely image-based deep learning approach that directly estimates the time to collision without the need [...]

*LOCATION CHANGE TO NEWELL SIMON HALL ROOM 1305* Title: Computer Vision for Live Map Updates Abstract: Real-time traffic monitoring has had widespread success via crowd-sourced GPS data.  While drivers benefit from this low-level, low-latency map information, any high-level traffic data such as road closures and accidents currently have very high latency since such systems rely solely [...]

Title: Stereo Visual-Inertial-LiDAR Simultaneous Localization and Mapping   Abstract: Simultaneous Localization and Mapping (SLAM) is a fundamental task to mobile and aerial robotics. The goal of SLAM is to utilize onboard sensors for estimating the robot’s trajectory while reconstructing the surrounding environment (map) in real-time. The algorithm should also be able to perform loop closure, such [...]

Title: Robot Learning for Manipulation of Granular Materials   Abstract: Granular materials are ubiquitous in household and industrial manipulation tasks, but their dynamics are difficult to model analytically or through simulation. During manipulation, they provide rich multimodal sensory feedback. We present a robotic system we constructed for investigating manipulation of granular materials.   We present [...]

Title: Volumetric Correspondence Networks for Stereo Matching and Optical Flow Abstract: Many classic tasks in vision, such as the estimation of optical flow or stereo disparities, can be cast as dense correspondence matching. Well-known techniques for doing so make use of a cost volume, which is typically a 3D/4D tensor of match costs between all [...]

Title: Surfel-based RGB-D Reconstruction and SLAM with Global and Local Consistency   Abstract: Achieving high surface reconstruction accuracy in dense mapping has been a desirable target for both robotics and vision communities. In the robotics literature, simultaneous localization and mapping (SLAM) systems use depth-enabled cameras to reconstruct a dense map of the environment. They leverage [...]

Title: Precision UAV Landing in Unstructured Environments Abstract: The autonomous landing of a drone is an important part of autonomous flight. One way to have a high certainty of safety in landing is to return the drone to the same location it took-off from. Current implementations of the return-to-home functionality fall short when relying solely [...]

Title: Joint Surface Reconstruction from Monocular Vision and LiDAR   Abstract: In recent years, dense reconstruction gains popularity because of its broad applications in inspection, mapping, and planning. Cameras or LiDARs are generally deployed for 3D dense reconstruction. However, current reconstruction pipelines based on cameras or LiDARs have significant limitations in achieving an accurate and [...]

Title: Automatic detection of human affective behavior in dyadic conversations Abstract: Emotion is communicated through face, voice, and body motion in interpersonal contexts. Yet, most approaches to automatic detection emphasize a single modality (especially face or voice), ignore social context, and focus on well-defined signs of emotion (e.g., smile).  This thesis addresses multimodal, interpersonal emotion [...]

Title: Structured Representations for Behaviors of Autonomous Robots   Abstract: Autonomous robot behavior can be captured in many ways: as code, as modules of code, in an unstructured form such as a neural net, or in one of several more structured formats such as a graph, table, or tree. This talk explores structured representations that [...]

Title: Vision and Improved Learned-Trajectory Replay for Assistive-Feeding and Food-Plating Robots   Abstract: Food manipulation offers an interesting frontier for robotics research because of the direct application of this research to real-world problems and the challenges involved in robust manipulation of deformable food items. In this talk, we focus on the challenges associated with robots manipulating [...]

Title: Leveraging Multimodal Sensory Data for Robust Cutting   Abstract: Cutting food is a challenging task due to the variety of material properties across food items. In addition, different events occur during the slicing process that need to be monitored and detected for robust execution, such as when a knife has completely cut through a [...]

Title: Toward Safe Reinforcement Learning in the Real World   Abstract: Control for mobile robots in slippery, rough terrain at high speeds is difficult. One approach to designing controllers for complex, non-uniform dynamics in unstructured environments is to use model-free learning-based methods. However, these methods often lack the necessary notion of safety which is needed [...]

Title: Data-Efficient Stage Classification and Failure Detection for Robotic Screwdriving   Abstract: Screwdriving is one of the most common assembly methods, yet its full automation is still challenging, especially for small screws. A critical reason is that existing techniques perform poorly in process monitoring and failure prediction. In addition, most solutions are essentially data-driven, thereby [...]

Title: Environment Generalization in Deep Reinforcement Learning Abstract: A key challenge in deep reinforcement learning (RL) is environment generalization: a policy trained to solve a task in one environment often fails to solve the same task in a slightly different test environment. In this work, we propose the ``Environment-Probing'' Interaction (EPI) policy, which allows the agent [...]

Title: Human Torso Pose Forecasting for the Real World   Abstract: Anticipatory human intent modeling is important for robots operating alongside humans in dynamic or crowded environments. Humans often telegraph intent through posture cues, such as torso or head cues. In this paper, we describe a computationally lightweight approach to human torso pose recovery and forecasting [...]

Title: Object-level visual SLAM for plant modeling   Abstract: A 3D model that can capture the finer details of the plant structure as well as the overall field statistics, plays an important role in automating agriculture. However, modeling and mapping an agricultural field is challenging due to dynamics, illumination conditions and limited texture inherent in an outdoor environment. We propose a pipeline that combines the recent [...]

Title: Behavior planning at roundabouts   About the talk: Roundabouts or traffic circles represent a significant portion of unsignalized intersections commonly found in urban and rural roads and pose a specific challenge for autonomous or self-driving cars. In this work, we present model-free techniques that allow a self-driving car to navigate a roundabout safely.  We [...]

Title: Towards retinal membrane peeling with a handheld robotic instrument   Abstract: Vitreoretinal surgery procedures demand high precision and have to be performed with limited visualization and access. One such procedure is membrane peeling, which involves peeling of the 5-10 µm thick internal limiting membrane around macular holes. Using virtual fixtures in conjunction with robotic [...]

Title: Spatiotemporal Modeling using Recurrent Neural Processes   Abstract: Spatiotemporal processes, such as temperature in an area, motion of a vehicle, etc., depend on the spatial features of the underlying phenomena as well as time. Developing models that can estimate both mean and uncertainty associated with the prediction is important for building robust systems capable of [...]

Title: Localization and Active Exploration in Indoor Underwater Environments Abstract: Autonomous underwater vehicles have the potential to inspect and map indoor underwater environments, such as spent nuclear fuel pools and ship ballast tanks. Towards this, the thesis makes contributions in the domains of visual localization and active SLAM for underwater environments. In the first work, [...]

Title: Multi-Sensor Fusion for Robust Simultaneous Localization and Mapping   Abstract:  Simultaneous Localization and Mapping (SLAM) consists of the estimation of the state of the robot, and the reconstruction of the surrounding environment simultaneously. Over the last few decades, numerous state-of-the-art SLAM algorithms are proposed and frequently utilized in the robotics community. However, a SLAM algorithm [...]

Title: State Estimation for Legged Robots using Proprioceptive Sensors   Abstract:  Mobile robots need good estimates of their state to perform closed-loop control in structured and unstructured environments. A number of existing algorithms rely on data fusion from multiple sensors to compute these estimates. This work focuses on state estimation using sensors which only measure [...]

Title: Leveraging Computer Vision and Reinforcement Learning for contact and non-contact based plant phenotyping.     Abstract:  Effective plant breeding requires scientists to find correspondences between genetic markers and desirable physical traits (phenotypes) of the genotype. Robotics can aid the acceleration of breeding pipeline by facilitating high throughput plant phenotyping. In this thesis we propose [...]

Title: Active Sampling for Planetary Rover Exploration Abstract: Planetary Robotics research has expanded beyond simply developing robust navigation strategies for rovers to providing them with the capability of performing intelligent actions so as to develop a better interpretation and understanding of the environment. This will become essential in the future, when rovers explore regions far [...]

Title:  Efficient Planning for High-Speed MAV Flight in Unknown Environments Using Sparse Topological Graphs   Abstract: Safe high-speed autonomous navigation for MAVs in unknown environments requires fast planning to enable the robot to adapt and react quickly to incoming information about obstacles within the world.  Furthermore, when operating in environments not known a priori, the robot [...]

Title: Recognizing Tiny Faces Abstract: Objects are naturally captured over a continuous range of distances, causing dramatic changes in appearance, especially at low resolutions. Recognizing such small objects at range is an open challenge in object recognition. In this paper, we explore solutions to this problem by tackling the fine-grained task of face recognition. State-of-the-art embeddings [...]