Title: Generating 3D Human Animations from Single Monocular Images   Abstract: Endowing AI systems with the ability to formulate a three-dimensional understanding of human appearance from a single RGB image is an important component technology for applications such as person re-identification, biometrics, virtual reality and augmented reality. However, jointly inferring the texture map and 3D […]

Title: Model-free Sensorless Manipulation   Abstract: This thesis is a study of 2D manipulation without sensing and planning, by exploring the effects of unplanned randomized action sequences on 2D object pose uncertainty. Our approach uses sensorless reorienting of an object to achieve a determined pose, regardless of the initial pose. Without using sensors and models […]

Title: OpenPose: Whole-Body Pose Estimation   Abstract: We present the first single-network approach for 2D whole-body (body, face, hand, and foot) pose estimation, capable of detecting an arbitrary number of people from in-the-wild images. Our method maintains constant real-time performance regardless of the number of people in the image. This network is trained in a […]

Title: Monocular Total Capture: Pose Face, Body, and Hands in the Wild   Abstract: We present the first method to capture the 3D total motion of a target person from a monocular view input. Given an image or a monocular video, our method reconstructs the motion from body, face, and fingers represented by a 3D deformable […]

Title: 3D Shape Completion and Canonical Pose Estimation with Structured Neural Networks   Abstract: 3D point cloud is an efficient and flexible representation of 3D structures and the raw output of many 3D sensors. Recently, neural networks operating on point clouds have shown superior performance on various 3D understanding tasks, thanks to their power to [...]

Title: Leveraging Simulation for Computer Vision   Abstract: A large amount of labeled data is required to train deep neural networks. The process of data annotation on such a large scale is expensive and time-consuming. A promising alternative in this regard is to use simulation to generate labeled synthetic data. However, a network trained solely [...]

Title: Visual Imitation Learning for Robot Manipulation   Abstract:   Imitation learning has been successfully applied to solve a variety of tasks in complex domains where an explicit reward function is not available. However, most imitation learning methods require access to the robot's actions during demonstration. This stands in a stark contrast to how we [...]

Title: Highly Miniaturized Robots for Inspection of Small Nuclear Piping   Abstract: Bomb making in the 20th century resulted in the creation of massive facilities to produce Uranium. As part of a multi-billion-dollar agenda, the measurement of radioactivity is required for the safe disposal of residual Uranium in piping. Manual techniques have proven too approximate, [...]

Title: Topological Path Planning for Mobile Robot Applications   Abstract: Many path planning problems in mobile robot applications can be solved more efficiently in the topological space. By using the language of topology, the richer spatial information failed to captured by graph/grid-based map representations can be explicitly expressed and exploited. With that, it is possible [...]

Title: Deep Reinforcement Learning with Prior Knowledge   Abstract: Deep reinforcement learning has been applied to many domains from computer games, natural language processing, recommendation systems to robotics.  While model-free reinforcement learning algorithms are promising approaches to learning policies without knowledge of the system dynamics, they usually require much more data. In this thesis, we [...]

Title: 3D Object Detection from CT Scans using a Slice-and-fuse Approach   Abstract: Automatic object detection in 3D X-ray Computed Tomography imagery has recently gained research attention due to its promising applications in aviation baggage screening. The huge dimension of an individual 3D scan, however, poses formidable computational challenges when coupled with deep 3D convolutional […]

Title: Interpretable Intuitive Physics Model   Abstract: Humans have a remarkable ability to use physical commonsense and predict the effect of collisions. But do they understand the underlying factors? Can they predict if the underlying factors have changed? Interestingly, in most cases humans can predict the effects of similar collisions with different conditions such as changes […]

Title: Learning for Registration in 2D and 3D   Abstract: We explore the application of deep learning to 2D (image) and 3D (point cloud) registration, especially in scenarios where traditional methods can fail.   In the 2D case, we apply a recently-proposed learning method to the problem of aligning outdoor imagery taken across different seasons or […]

Title: Inverse Reinforcement Learning for Autonomous Ground Navigation Using Aerial and Satellite Observation Data   Abstract: Inverse Reinforcement Learning(IRL) is a supervised learning paradigm where a learner observes expert demonstrations to learn the hidden cost function to mimic the expert's behavior. Eliminating the need for elaborate feature engineering, deep IRL approaches have been gaining interests […]

Title: Detecting objects in videos under occlusion   Abstract: While object detection in videos has received a lot of attention in the past few years, most existing methods in this domain do not target detecting objects when they are occluded. However, being able to detect or track an object of interest through occlusion has been […]

Title: Detailed Image Captioning with Hierarchical Attention   Abstract:  Automatic image description is the task of generating a natural sentence which reflects the visual content of an image. A lot of deep learning architectures have been explored in the past few years. While researchers have made great improvement on generating syntactically correct sentences by learning from […]

Title:  Inching for Planetary Rovers   Abstract: . Inching, also called push-rolling, is method of moving for vehicles that can change the position of their wheels relative to their body.  Like an inchworm, it is possible to hold some wheels stationary while advancing the others and the body.  In this research a test apparatus capable […]

Title: Improving Scalability in Multi-Robot Systems with Abstraction and Specialization   Abstract: Planning and controlling multi-robot systems is challenging due to high dimensionality. When the number of robots increases in the system, the complexity of computation grows exponentially. In this thesis, we examine the scalability problem in planning and control of the multi-robot system. We propose […]

Title: A Generative Approach for Socially Compliant Navigation   Abstract: Robots navigating in human crowds need to optimize their paths not only for the efficiency of their tasks performance but also for the compliance to social norms. One of the key challenges in this context is due to the lack of suitable metrics for evaluating and […]