RI Seminar
Sam Burden
Assistant Professor
Electrical & Computer Engineering, University of Washington

Toward telelocomotion: human sensorimotor control of contact-rich robot dynamics

1305 Newell Simon Hall

Abstract: Human interaction with the physical world is increasingly mediated by automation -- planes assist pilots, cars assist drivers, and robots assist surgeons. Such semi-autonomous machines will eventually pervade our world, doing dull and dirty work, assisting the elderly and disabled, and responding to disasters. Recent results (e.g. from the DARPA Robotics Challenge) demonstrate that, [...]

Faculty Events

2020 RI Faculty Dinner

Pittsburgh Golf Club 5280 Northumberland Street, Pittsburgh, PA, United States

Invitation with information will be emailed to invitees.

RI Seminar
Hadas Kress-Gazit
Associate Professor
College of Engineering, Cornell University

Formal Synthesis for Robots

Abstract: In this talk I will describe how formal methods such as synthesis – automatically creating a system from a formal specification – can be leveraged to design robots, explain and provide guarantees for their behavior, and even identify skills they might be missing. I will discuss the benefits and challenges of synthesis techniques and [...]

VASC Seminar
Thiemo Alldieck
PhD Candidate
Facebook Reality Labs

Reconstructing 3D Human Avatars from Monocular Images

GHC 6501

Abstract:  Statistical 3D human body models have helped us to better understand human shape and motion and already enabled exciting new applications. However, if we want to learn detailed, personalized, and clothed models of human shape, motion, and dynamics, we require new approaches that learn from ubiquitous data such as plain RGB-images and video. I [...]

PhD Thesis Proposal
Robotics Institute,
Carnegie Mellon University

Learning Dense 3D Object Reconstruction without Geometric Supervision

GHC 6501

Abstract: Geometric alignment across visual data has been the fundamental issue for effective and efficient computer vision algorithms. The established pixel correspondences between images indirectly infer the underlying 3D geometry, physically or semantically. While this builds the foundation of classical multi-view 3D reconstruction algorithms such as Structure from Motion (SfM) and Simultaneous Localization and Mapping [...]

RI Seminar
Assistant Professor
Robotics Institute,
Carnegie Mellon University

Extreme Motions in Biological and Engineered Systems

1305 Newell Simon Hall

Abstract: Dr. Temel’s work mainly focuses on understanding the dynamics and energetics of extreme motions in small-scale natural and synthetic systems. Small-scale biological systems achieve extraordinary accelerations, speeds, and forces that can be repeated with minimal costs throughout the life of the organism. Zeynep uses analytical and computational models as well as physical prototypes to learn about these systems, test [...]

VASC Seminar
Adriana Kovashka
Assistant Professor
University of Pittsburgh

Reasoning about complex media from weak multi-modal supervision

GHC 6501

Abstract:  In a world of abundant information targeting multiple senses, and increasingly powerful media, we need new mechanisms to model content. Techniques for representing individual channels, such as visual data or textual data, have greatly improved, and some techniques exist to model the relationship between channels that are “mirror images” of each other and contain [...]

RI Event
Omry Yadan
Research Engineer
Facebook AI Research

Vision Tool Seminar: Hydra

3305 Newell-Simon Hall

Abstract: Hydra is an open-source Python framework developed at FAIR that aims to reduce the amount of boilerplate code in research and other complex applications. The key feature is the ability to dynamically create a hierarchical configuration by composition and override it through config files and the command line. The name Hydra comes from its [...]

RI Seminar
Raquel Urtasun
Chief Scientist & Head
Uber Advanced Technologies Group Toronto

CANCELLED

CIC Building Room 1201

VASC Seminar
Benjamin Schmidt
President and Co-Founder
RoadBotics

Building Trust in Real World Applications of Vision Based Machine Learning

GHC 6501

Abstract:  In all machine learning problems, there is an explicit trade off between cost and benefit. In real world vision problems, this optimization becomes increasingly difficult since those trade offs directly impact technology and product development as well as business strategy. For any successful business case, it is critical that the cost/benefit trade offs in [...]

PhD Speaking Qualifier
PhD Student
Robotics Institute,
Carnegie Mellon University

Tendon Driven Foam Hands

GHC 6501

Abstract: There has been great progress in soft robot design, manufacture, and control in recent years, and soft robots are a tool of choice for safe and robust handling of objects in conditions of uncertainty. Still, dexterous in-hand manipulation using soft robots remains a challenge. This talk introduces a novel class of soft robots in [...]

VASC Seminar
Partha Pratim Talukdar
Associate Professor
IIScBangalore / Founder, KENOME

Knowledge Infused Deep Learning

Newell-Simon Hall 4305

Abstract:  This talk is motivated by the following thesis: Background knowledge is key to intelligent decision making. While deep learning methods have made significant strides over the last few years, they often lack the context in which they operate. Knowledge Graphs (and more generally multi-relational graphs) provide a flexible framework to capture and represent knowledge [...]

PhD Speaking Qualifier
Robotics Institute,
Carnegie Mellon University

Towards a Good Representation For Reinforcement Learning

WEH 5421

Abstract: Deep reinforcement learning has achieved many successes over the recent years. However, its high sample complexity and the difficulty in specifying a reward function have limited its application. In this talk, I will take a representation learning perspective towards these issues. Is it possible to map from the raw observation, potentially in high dimension, [...]

RI Seminar
Sarjoun Skaff
Co-Founder & CTO
Bossa Nova Robotics

Yes, That’s a Robot in Your Grocery Store. Now what?

CIC Building Room 1201

Abstract: Retail stores are becoming ground zero for indoor robotics. Fleet of different robots have to coexist with each others and humans every day, navigating safely, coordinating missions, and interacting appropriately with people, all at large scale. For us roboticists, stores are giant labs where we're learning what doesn't work and iterating. If we get [...]

VASC Seminar
Georgios Pavlakos
PhD Student
University of Pennsylvania

Learning to Reconstruct 3D Humans

GHC 6501

Abstract:  Recent advances in 2D perception have led to very successful systems, able to estimate the 2D pose of humans with impressive robustness. However, our interactions with the world are fundamentally 3D, so to be able to understand, explain and predict these interactions, it is crucial to reconstruct people in 3D. In this talk, I [...]

PhD Thesis Proposal
Robotics Institute,
Carnegie Mellon University

Eye Gaze for Assistive Manipulation

NSH 4305

Abstract: Full robot autonomy is the traditional goal of robotics research. To work in a human-inhabited world, however, robots will often need to collaborate with humans. Many scenarios require human users to teleoperate robots to perform tasks, a paradigm that appears everywhere from space exploration, to disaster recovery, to assistive robotics. This collaboration enables tasks [...]

RI Seminar
Scott Niekum
Assistant Professor
Department of Computer Science, University of Texas at Austin

CANCELLED

Abstract: Before learning robots can be deployed in the real world, it is critical that probabilistic guarantees can be made about the safety and performance of such systems.  In recent years, safe reinforcement learning algorithms have enjoyed success in application areas with high-quality models and plentiful data, but robotics remains a challenging domain for scaling [...]

VASC Seminar
Xingyu Liu
PhD Student
Stanford University

Deep Learning for Understanding Dynamic Visual Data

GHC 6501

Abstract:  Perceiving dynamic environments from visual inputs allows autonomous agents to understand and interact with the world and is a core topic in Artificial Intelligence. The success of deep learning motivates us to apply deep learning techniques to the perception of dynamic visual data. However, how to design and apply deep neural networks to effectively [...]

PhD Thesis Proposal
Robotics Institute,
Carnegie Mellon University

Stability-Centric Mechanics for Rigid Body Manipulation

NSH 4305

Abstract: The repertoire of human manipulation is filled with creative use of contacts to move the object about the hand and the environment. It’s the combination of these skills that makes human manipulation dexterous. However, in most robotic applications the robot just fix all contact points on the object and do grasping. Reliable robot manipulation [...]

RI Seminar
Anca Dragan
Assistant Professor
EECS Department, University of California Berkeley

Optimizing for coordination with people

1305 Newell Simon Hall

https://youtu.be/AQ-w5o2oGI8 Abstract: From autonomous cars to quadrotors to mobile manipulators, robots need to co-exist and even collaborate with humans. In this talk, we will explore how our formalism for decision making needs to change to account for this interaction, and dig our heels into the subtleties of modeling human behavior -- sometimes strategic, often irrational, [...]

VASC Seminar
James Hays
Associate Professor
Georgia Institute of Technology

Analyzing Grasp Contact via Thermal Imaging

GHC 6501

Abstract:  Grasping and manipulating objects is an important human skill. Because contact between hand and object is fundamental to grasping, measuring it can lead to important insights. However, observing contact through external sensors is challenging because of occlusion and the complexity of the human hand. I will discuss the use of thermal cameras to capture [...]

Special Talk
Zac Manchester
Assistant Professor
Stanford University

Numerical Methods for Things That Move: From Quadrupeds to Starships

Newell-Simon Hall 4305

Abstract:  Recent advances in motion planning and control have led to dramatic successes like SpaceX’s rocket landings and Boston Dynamics’ humanoid robot acrobatics. However, the underlying numerical methods used in these applications are typically decades old, not tuned for high performance on planning and control problems, and are often unable to cope with the types [...]

PhD Thesis Defense
Robotics Institute,
Carnegie Mellon University

Combining Multiple Heuristics: Studies on Neighborhood-base Heuristics and Sampling-based Heuristics

NSH 4305

Abstract: This thesis centers on the topic of how to automatically combine multiple heuristics. For most computationally challenging problems, there exist multiple heuristics, and it is generally the case that any such heuristic exploits only a limited number of aspects among all the possible problem characteristics that we can think of, and by definition, is [...]

VASC Seminar
Sanjeev J. Koppal
Assistant Professor
University of Florida

Fast Foveation for LIDARs, Projectors and Cameras

GHC 6501

Abstract:  Most cameras today capture images without considering scene content. In contrast, animal eyes have fast mechanical movements that control how the scene is imaged in detail by the fovea, where visual acuity is highest. This concentrates computational (i.e. neuronal) resources in places where they are most needed. The prevalence of foveation, and the wide [...]

Special Events

POSTPONED – 2020 Robotics Institute Semi-formal

Pittsburgh Golf Club 5280 Northumberland Street, Pittsburgh, PA, United States

Due to uncertainty and developing conditions of the coronavirus (COVID-19) outbreak, the Robotics Institute at Carnegie Mellon has determined it best to postpone our planned RI Semi-formal activity on March 20, 2020. More information will be sent out once a new date has been selected. __________________POSTPONED _____________________ By invitation only: The 2020 Robotics Institute Semi-formal [...]

PhD Thesis Proposal
Robotics Institute,
Carnegie Mellon University

Robotic Grasping in the Wild

Zoom Link Abstract Robotics and artificial intelligence have witnessed tremendous progress in the past decade. Yet, we are still far from building the general purpose robot butler that can autonomously operate in homes and help with manipulation tasks like household chores. Grasping is an important action primitive for manipulation and needs to generalize to unstructured [...]

PhD Speaking Qualifier
Robotics Institute,
Carnegie Mellon University

Resource-constrained learning and inference for visual perception

Zoom Link Abstract Real-world applications usually require computer vision algorithms to meet certain resource constraints. In this talk, I will present evaluation methods and principled solutions for both cases of training and testing. First, I will talk about a formal setting for studying training under the non-asymptotic, resource-constrained regime, i.e., budgeted training. We analyze the [...]

PhD Thesis Defense
Robotics Institute,
Carnegie Mellon University

Multi-hypothesis iSAM2 for Ambiguity-aware Passive and Active SLAM

Archived video Abstract Simultaneous localization and mapping (SLAM) is the problem of estimating the state of a moving agent with sensors on it while simultaneously reconstructing a map of its surrounding environment, which has been a popular research field due to its wide applications. As many state-of-the-art SLAM algorithms can already achieve high accuracy in [...]

VASC Seminar
Jia-Bin Huang
Assistant Professor
Virginia Tech

Learning to See Through Occlusions and Obstructions

Virtual VASC:  https://cmu.zoom.us/j/249106600   Abstract:  Photography allows us to capture and share memorable moments of our lives. However, 2D images appear flat due to the lack of depth perception and may suffer from poor imaging conditions such as taking photos through reflecting or occluding elements. In this talk, I will present our recent efforts to [...]

PhD Thesis Defense
Robotics Institute,
Carnegie Mellon University

Terrain Relative Navigation for Lunar Polar Roving: Exploiting Geometry, Shadows, and Planning

Archived Zoom Video Abstract Water ice at the lunar poles could be the most valuable resource beyond planet Earth. However, that value is not foregone, and can only be determined by rovers that evaluate the distributions of abundance, concentration, and characteristics of this ice. The near-term explorations will be solar and unlikely to endure night, [...]

PhD Thesis Defense
Robotics Institute,
Carnegie Mellon University

Resource-Constrained State Estimation with Multi-Modal Sensing

Zoom Link Accurate and reliable state estimation is essential for safe mobile robot operation in real-world environments because ego-motion estimates are required by many critical autonomy functions such as control, planning, and mapping. Computing accurate state estimates depends on the physical characteristics of the environment, the selection of suitable sensors to capture that information, and [...]

VASC Seminar
Yuxin Wu
Research Engineer
Facebook AI Research

Detectron2 in Object Detection Research

Virtual VASC:  https://cmu.zoom.us/j/249106600   Abstract:  Detectron2 is Facebook's library for object detection and segmentation. It has been used widely in FAIR's research and Facebook's products. This talk will introduce detectron2 with a focus on its use in object detection research, including the lessons we learned from building it, as well as the new research enabled [...]

MSR Speaking Qualifier
Robotics Institute,
Carnegie Mellon University

Aditya Dhawale – MSR Thesis Talk

TBA

Title: Hierarchical Gaussian Distributions for Real-Time SLAM ZOOM Link: (Virtual Presentation) https://cmu.zoom.us/j/7210519673 Abstract: We present Gaussian distributions as structure primitives in a hierarchical multi-fidelity framework to enable accurate real-time Simultaneous Localization and Mapping (SLAM) using uncertain depth data. Real-time mapping and localization capabilities on a mobile robot can enable deployment of robots in real-world scenarios. An autonomous system must [...]

VASC Seminar
Olga Russakovsky
Assistant Professor
Department of Computer Science, Princeton University

Fairness in visual recognition

Virtual VASC Seminar:  https://cmu.zoom.us/j/249106600   Abstract: Computer vision models trained on unparalleled amounts of data hold promise for making impartial, well-informed decisions in a variety of applications. However, more and more historical societal biases are making their way into these seemingly innocuous systems. Visual recognition models have exhibited bias by inappropriately correlating age, gender, sexual [...]

PhD Speaking Qualifier
Robotics Institute,
Carnegie Mellon University

Planning and Execution using Inaccurate Models with Provable Guarantees

Zoom Link Abstract: Models used in modern planning problems to simulate outcomes of real world action executions are becoming increasingly complex, ranging from simulators that do physics-based reasoning to precomputed analytical motion primitives. However, robots operating in the real world often face situations not modeled by these models before execution. This imperfect modeling can lead [...]