Title: A Computational Framework for Norm-Aware Reasoning in Autonomous Systems   Abstract: Autonomous agents are increasingly deployed in complex social environments where they not only have to reason about their domain goals but also about norms that can impose constraints on task performance. Integrating task planning with norm aware reasoning is a challenging problem due to […]

Title: Learning Transferable Cooperative Behavior in Multi-Agent Teams   Abstract: We study the emergence of cooperative behavior and communication protocols in multi-agent teams, for collaboratively accomplishing tasks like coverage control and formation control for swarms. Using graph neural networks to model inter-agent communications, we present state-of-the-art results in a fully decentralized execution framework which assumes […]

Title: Decentralized Multiple Mobile Depots Route Planning for Replenishing Persistent Surveillance Robots   Abstract: Persistent surveillance of a target space using multiple robots has numerous applications. The continuous operation in these applications is challenged by the limited onboard battery capacity of the persistent robots. We consider the problem for replenishing persistent robots using mobile depots, […]

Title: Generating 3D Human Animations from Single Monocular Images   Abstract: Endowing AI systems with the ability to formulate a three-dimensional understanding of human appearance from a single RGB image is an important component technology for applications such as person re-identification, biometrics, virtual reality and augmented reality. However, jointly inferring the texture map and 3D […]

Title: Model-free Sensorless Manipulation   Abstract: This thesis is a study of 2D manipulation without sensing and planning, by exploring the effects of unplanned randomized action sequences on 2D object pose uncertainty. Our approach uses sensorless reorienting of an object to achieve a determined pose, regardless of the initial pose. Without using sensors and models […]

Title: OpenPose: Whole-Body Pose Estimation   Abstract: We present the first single-network approach for 2D whole-body (body, face, hand, and foot) pose estimation, capable of detecting an arbitrary number of people from in-the-wild images. Our method maintains constant real-time performance regardless of the number of people in the image. This network is trained in a […]

Title: Monocular Total Capture: Pose Face, Body, and Hands in the Wild   Abstract: We present the first method to capture the 3D total motion of a target person from a monocular view input. Given an image or a monocular video, our method reconstructs the motion from body, face, and fingers represented by a 3D deformable […]

Title: 3D Shape Completion and Canonical Pose Estimation with Structured Neural Networks   Abstract: 3D point cloud is an efficient and flexible representation of 3D structures and the raw output of many 3D sensors. Recently, neural networks operating on point clouds have shown superior performance on various 3D understanding tasks, thanks to their power to […]

Title: Leveraging Simulation for Computer Vision   Abstract: A large amount of labeled data is required to train deep neural networks. The process of data annotation on such a large scale is expensive and time-consuming. A promising alternative in this regard is to use simulation to generate labeled synthetic data. However, a network trained solely […]

Title: Visual Imitation Learning for Robot Manipulation   Abstract:   Imitation learning has been successfully applied to solve a variety of tasks in complex domains where an explicit reward function is not available. However, most imitation learning methods require access to the robot's actions during demonstration. This stands in a stark contrast to how we […]

Title: Highly Miniaturized Robots for Inspection of Small Nuclear Piping   Abstract: Bomb making in the 20th century resulted in the creation of massive facilities to produce Uranium. As part of a multi-billion-dollar agenda, the measurement of radioactivity is required for the safe disposal of residual Uranium in piping. Manual techniques have proven too approximate, […]

Title: Topological Path Planning for Mobile Robot Applications   Abstract: Many path planning problems in mobile robot applications can be solved more efficiently in the topological space. By using the language of topology, the richer spatial information failed to captured by graph/grid-based map representations can be explicitly expressed and exploited. With that, it is possible […]

Title: Deep Reinforcement Learning with Prior Knowledge   Abstract: Deep reinforcement learning has been applied to many domains from computer games, natural language processing, recommendation systems to robotics.  While model-free reinforcement learning algorithms are promising approaches to learning policies without knowledge of the system dynamics, they usually require much more data. In this thesis, we […]