Carnegie Mellon University
Routing for Persistent Exploration in Dynamic Environments with Teams of Energy-Constrained Robots
Abstract: In domains requiring effective situational awareness with limited resources, prioritizing focus is critical. Search and rescue tasks require fast identification of safe avenues for rescuers to traverse the area. Inspection tasks must realize trends over long durations to identify issues caused by the confluence of high-stress modes that compound into catastrophic failure. Deploying robots [...]
Carnegie Mellon University
Intra-Robot Replanning and Learning for Multi-Robot Teams in Complex Dynamic Domains
Abstract: In complex dynamic multi-robot domains, there is a set of individual robots that must coordinate together through a centralized planner that inevitably makes assumptions based on a model of the environment and the actions of the individual. Eventually, the individuals may encounter failures, because the centralized planner’s models of the states and actions are [...]
Carnegie Mellon University
Toward a New Type of Agile and Dexterous Mobile Manipulator
Abstract: Mobile robot bases have been developed over many decades, but only recently have researchers added arms to these bases, opening up the rich field of mobile manipulation. Most of these robots either need wide, heavy, statically-stable bases that may or may not be omnidirectional to support the arms and provide stability. Such robot bases, [...]
Carnegie Mellon University
Light Sheet Depth Imaging
Abstract: Once confined to industrial manufacturing facilities and research labs, robots are increasingly entering everyday life. As specialized robots are developed for tasks such as autonomous driving, package delivery, and aerial videography, there is a growing need for affordable depth sensing technology. Robots use sensors like scanning LIDAR, depth cameras, and passive stereo cameras to [...]
Carnegie Mellon University
Towards Generalization and Efficiency in Reinforcement Learning
Abstract: In classic supervised machine learning, a learning agent behaves as a passive observer: it receives examples from some external environment which it has no control over and then makes predictions. Reinforcement Learning (RL), on the other hand, is fundamentally interactive: an autonomous agent must learn how to behave in an unknown and possibly hostile [...]
Carnegie Mellon University
Akshat Agarwal – MSR Thesis Talk
Title: Learning Transferable Cooperative Behavior in Multi-Agent Teams Abstract: We study the emergence of cooperative behavior and communication protocols in multi-agent teams, for collaboratively accomplishing tasks like coverage control and formation control for swarms. Using graph neural networks to model inter-agent communications, we present state-of-the-art results in a fully decentralized execution framework which assumes [...]
Carnegie Mellon University
Yifan Ding – MSR Thesis Talk
Title: Decentralized Multiple Mobile Depots Route Planning for Replenishing Persistent Surveillance Robots Abstract: Persistent surveillance of a target space using multiple robots has numerous applications. The continuous operation in these applications is challenged by the limited onboard battery capacity of the persistent robots. We consider the problem for replenishing persistent robots using mobile depots, [...]
Active Learning in Robot Motion Control
Abstract: Motion motivated by information needs can be found throughout natural systems, yet there is comparatively little work in robotics on analyzing and synthesizing motion for information. Instead, engineering analysis of robots and animal motion typically depends on defining objectives and rewards in terms of states and errors on states. This is how we formulate [...]
Carnegie Mellon University
Tanya Marwah – MSR Thesis Talk
Title: Generating 3D Human Animations from Single Monocular Images Abstract: Endowing AI systems with the ability to formulate a three-dimensional understanding of human appearance from a single RGB image is an important component technology for applications such as person re-identification, biometrics, virtual reality and augmented reality. However, jointly inferring the texture map and 3D [...]
Human-guided Task Transfer for Interactive Robots
Abstract: Adaptability is an essential skill in human cognition, enabling us to draw from our extensive, life-long experiences with various objects and tasks in order to address novel problems. To date, most robots do not have this kind of adaptability, and yet, as our expectations of robots’ interactive and assistive capacity grows, it will be [...]
Pragna Mannam – MSR Thesis Talk
Title: Model-free Sensorless Manipulation Abstract: This thesis is a study of 2D manipulation without sensing and planning, by exploring the effects of unplanned randomized action sequences on 2D object pose uncertainty. Our approach uses sensorless reorienting of an object to achieve a determined pose, regardless of the initial pose. Without using sensors and models [...]
Carnegie Mellon University
Gines Hidalgo Martinez – MSR Thesis Talk
Title: OpenPose: Whole-Body Pose Estimation Abstract: We present the first single-network approach for 2D whole-body (body, face, hand, and foot) pose estimation, capable of detecting an arbitrary number of people from in-the-wild images. Our method maintains constant real-time performance regardless of the number of people in the image. This network is trained in a [...]
RI Faculty Social
All Robotics Institute faculty are invited to attend this informal team-building business/social event. Beverages and snacks will be provided.
Donglai Xiang – MSR Thesis Talk
Title: Monocular Total Capture: Pose Face, Body, and Hands in the Wild Abstract: We present the first method to capture the 3D total motion of a target person from a monocular view input. Given an image or a monocular video, our method reconstructs the motion from body, face, and fingers represented by a 3D deformable [...]
Carnegie Mellon University
Wentao Yuan – MSR Thesis Talk
Title: 3D Shape Completion and Canonical Pose Estimation with Structured Neural Networks Abstract: 3D point cloud is an efficient and flexible representation of 3D structures and the raw output of many 3D sensors. Recently, neural networks operating on point clouds have shown superior performance on various 3D understanding tasks, thanks to their power to [...]
Carnegie Mellon University
Planning under Uncertainty with Multiple Heuristics
Abstract: Many robotic tasks, such as mobile manipulation, often require interaction with unstructured environments and are subject to imperfect sensing and actuation. This brings substantial uncertainty into the problems. Reasoning under this uncertainty can provide higher level of robustness but is computationally significantly more challenging. More specifically, sequential decision making under motion and sensing uncertainty [...]
Rawal Khirodkar – MSR Thesis Talk
Title: Leveraging Simulation for Computer Vision Abstract: A large amount of labeled data is required to train deep neural networks. The process of data annotation on such a large scale is expensive and time-consuming. A promising alternative in this regard is to use simulation to generate labeled synthetic data. However, a network trained solely [...]
Carnegie Mellon University
Dexterous Manipulation via Simple Robot Hands
Abstract: Most of the industrial robotic applications nowadays can only deal with pick-and-place manipulation, in which fixed graspings are the only interactions between the object and the robot hand. Simple hands, such as pinch grippers and suction cups, suffice to accomplish such tasks. However, there exist many unsolved automation problems where more dexterous manipulations are [...]
Carnegie Mellon University
Maximilian Sieb – MSR Thesis Talk
Title: Visual Imitation Learning for Robot Manipulation Abstract: Imitation learning has been successfully applied to solve a variety of tasks in complex domains where an explicit reward function is not available. However, most imitation learning methods require access to the robot's actions during demonstration. This stands in a stark contrast to how we [...]
Carnegie Mellon University
Enabling Role-Reversible Human-Robot Interaction by Leveraging Standardized Tools for Provider-Receiver Interactions
Abstract: Developing 'social intelligence' for assistive robots to seamlessly interact with humans remains an open research challenge. However, socially assistive robots typically engage in types of interactions that already exist between humans, which makes models of human-human interactions useful to inform the design of robot social behaviors. In particular, in applications such as healthcare, therapy [...]
Carnegie Mellon University
Nikhil Jog – MSR Thesis Talk
Title: Highly Miniaturized Robots for Inspection of Small Nuclear Piping Abstract: Bomb making in the 20th century resulted in the creation of massive facilities to produce Uranium. As part of a multi-billion-dollar agenda, the measurement of radioactivity is required for the safe disposal of residual Uranium in piping. Manual techniques have proven too approximate, [...]
Carnegie Mellon University
Contrastive View Predictive Learning with 3D-Bottlenecked RNNs
Abstract: In this talk, I will describe our recent work on neural architectures for visual recognition, which use 3D not as input nor as the desired output space, but rather as the bottleneck of the learned representations. We consider embodied agents moving in otherwise static worlds equipped with these architectures; they learn 3D visual feature [...]
Chao Cao – MSR Thesis Talk
Title: Topological Path Planning for Mobile Robot Applications Abstract: Many path planning problems in mobile robot applications can be solved more efficiently in the topological space. By using the language of topology, the richer spatial information failed to captured by graph/grid-based map representations can be explicitly expressed and exploited. With that, it is possible [...]
Carnegie Mellon University
MSR Thesis Talk – Tao Chen
Title: Deep Reinforcement Learning with Prior Knowledge Abstract: Deep reinforcement learning has been applied to many domains from computer games, natural language processing, recommendation systems to robotics. While model-free reinforcement learning algorithms are promising approaches to learning policies without knowledge of the system dynamics, they usually require much more data. In this thesis, we [...]