PhD Thesis Proposal
Robotics Institute,
Carnegie Mellon University

Safe and Resilient Multi-Robot Systems: Heterogeneity and Human Presence

Zoom Link Abstract: In the mission of a multi-robot team, the large number of robots behave like a system that relies on networking to enable smooth information propagation and inter-robot interaction as the mission evolves in a collective fashion. Key to the success of mission operation demands for safe and reliable robot interactions within the [...]

MSR Speaking Qualifier
Robotics Institute,
Carnegie Mellon University

Michael Tatum – MSR Thesis Talk

Archived Zoom Video Password: 1u%i4YO%   Title: Communications Coverage in Unknown Underground Environments   Abstract:In field robotics, maintaining communications between the user at a stationary basestation and all deployed robots is essential.  This task's difficulty increases when the test environment is underground and the environment is unknown to the operator and robots.  A common approach [...]

MSR Speaking Qualifier
Robotics Institute,
Carnegie Mellon University

Brendan Miller – MSR Thesis Talk

NSH 4305

Zoom Link: https://cmu.zoom.us/j/96617143856 Title: IBB-Net: Fast Iterative Bounding Box Regression for Point Clouds Abstract: Currently, most point cloud based detection pipelines are focused on producing high accuracy results while requiring significant computational resources and a high-end GPU. Our research explores how to reduce the computational overhead by improving a key element of detection: bounding box regression. We [...]

PhD Speaking Qualifier
Robotics Institute,
Carnegie Mellon University

Interactive Weak Supervision – Learning Useful Heuristics for Data Labeling

Zoom Link Abstract: Obtaining large annotated datasets is critical for training successful machine learning models and it is frequently a bottleneck in practice. Weak supervision offers a promising alternative for producing labeled datasets without ground truth annotations by generating probabilistic labels using multiple noisy heuristics. This process can scale to large amounts of data and [...]

PhD Thesis Defense
Robotics Institute,
Carnegie Mellon University

Automated Action Selection and Embodied Simulation for Socially Assistive Robots using Standardized Interactions

Zoom Link Abstract: Robots have the tremendous potential of assisting people in their lives, allowing them to achieve goals that they would not be able to achieve by themselves. In particular, socially assistive robots provide assistance primarily through social interaction, in healthcare, therapy, and education contexts. Despite their potential, current socially assistive robots still lack [...]

VASC Seminar
Bryan Russell
Senior Research Scientist
Adobe Research

Telling Left from Right: Learning Spatial Correspondence Between Sight and Sound

Virtual VASC Seminar:  https://cmu.zoom.us/j/92741882813?pwd=R1R0eGRaeXFHTEF2VWNwY2VIZmU5Zz09 Abstract:  Self-supervised audio-visual learning aims to capture useful representations of video by leveraging correspondences between visual and audio inputs. Existing approaches have focused primarily on matching semantic information between the sensory streams. In my talk, I’ll describe a novel self-supervised task to leverage an orthogonal principle: matching spatial information in the [...]

PhD Thesis Proposal
Robotics Institute,
Carnegie Mellon University

Heuristics for routing and scheduling of Spatio-Temporal type problems in industrial environments

Zoom Link Abstract: Spatio-temporal problems are fairly common in industrial environments. In practice, these problems come with different characteristics and are often very hard to solve optimally. So practitioners prefer to develop heuristics that exploit mathematical structure specific to the problem for obtaining good performance. In this proposal, I will present work on heuristics for [...]

MSR Speaking Qualifier
Robotics Institute,
Carnegie Mellon University

Aditya Agarwal – MSR Thesis Talk

Zoom Link:  https://cmu.zoom.us/j/3276236755   Title: Fast and High-Quality GPU-based Deliberative Perception for Object Pose Estimation Abstract:  Pose estimation of known objects is fundamental to tasks such as robotic grasping and manipulation. The need for reliable grasping imposes stringent accuracy requirements on pose estimation in cluttered, occluded scenes in dynamic environments. Existing methods either require large sets of [...]

PhD Speaking Qualifier
Robotics Institute,
Carnegie Mellon University

Learning Active Task-Oriented Exploration Policies for Bridging the Sim-to-Real Gap

Zoom Link Abstract: Training robotic policies in simulation suffers from the sim-to-real gap, as simulated dynamics can be different from real-world dynamics. Past works tackled this problem through domain randomization and online system-identification. The former is sensitive to the manually-specified training distribution of dynamics parameters and can result in behaviors that are overly conservative. The [...]

PhD Thesis Proposal
Robotics Institute,
Carnegie Mellon University

Understanding, Exploiting and Improving Inter-view Relationships

 Zoom Link Abstract: Multi-view machine learning has received substantial attention in various applications over recent years. These applications typically involve learning on data obtained from multiple sources of information, such as, for example, in multi-sensor systems such as self-driving cars and patient bed-side monitoring. Learning models for such applications can often benefit from leveraging not [...]

PhD Speaking Qualifier
Postdoctoral Fellow
Robotics Institute,
Carnegie Mellon University

Interferometric light transmission probing with coded mutual intensity

Zoom Link Abstract: We introduce a new interferometric imaging methodology that we term interferometry with coded mutual intensity, which allows selectively imaging photon paths based on attributes such as their length and endpoints. At the core of our methodology is a new technical result that shows that manipulating the spatial coherence properties of the light [...]

MSR Speaking Qualifier
Robotics Institute,
Carnegie Mellon University

Josh Jaekel – MSR Thesis Talk

Zoom Link: https://cmu.zoom.us/j/97161117200?pwd=QlpkS0hFOFVLRDlKVlFqby9JbWZTUT09 Title: Towards Robust Multi-Camera Visual Inertial Odometry Abstract: Visual inertial odometry (VIO) has become an increasingly popular method of obtaining a state estimate on board smaller robots like micro aerial vehicles (MAVs). While VIO has demonstrated impressive results in certain environments, there is still work to be done in improving the robustness of [...]

MSR Speaking Qualifier
Robotics Institute,
Carnegie Mellon University

John Mai – MSR Thesis Talk

Zoom Link: https://cmu.zoom.us/j/7518832261 Title: System Design, Modelling, and Control for an Off-Road Autonomous Ground Vehicle Abstract: Autonomy in passenger road vehicles has long been a goal for many research groups and companies, and there has been a significant amount of focus on achieving this endeavour. A lesser focused upon area is the task of precise autonomous [...]

MSR Speaking Qualifier
Robotics Institute,
Carnegie Mellon University

Zoom Link: https://cmu.zoom.us/j/5523238059   Title: Robust Instance Tracking via Uncertainty Flow   Abstract: Current state-of-the-art trackers often fail due to distractors and large object appearance changes. In this work, we explore the use of dense optical flow to improve tracking robustness. Our main insight is that, because flow estimation can also have errors, we need [...]

VASC Seminar
Ciprian Corneanu
Research Assistant
Tawny GmbH, University of Barcelona

The Topology of Learning

Zoom Virtual Meeting:  https://cmu.zoom.us/j/92178295543?pwd=L2dwZU5SbDY5NzZZNzZ4ZmFUclRqQT09   Abstract: Deep Neural Networks (DNNs) have revolutionized computer vision. We now have DNNs that achieve top results in many computer vision problems, including object recognition, facial expression analysis, and semantic segmentation, to name but a few. Unfortunately, the rise in performance has come with a cost.  DNNs have become so [...]

MSR Speaking Qualifier
Robotics Institute,
Carnegie Mellon University

Sarthak Ahuja – MSR Thesis Talk

NSH 4305

Zoom Link: https://cmu.zoom.us/j/8978517404 Title: Visual Assessment for Non-Disruptive Object Extraction Abstract: Robots operating in human environments need to perform a variety of dexterous manipulation tasks on object arrangements that have complex physical support relationships, e.g. procuring utensils from a large pile of dishes, grabbing a bottle from a stuffed fridge, or fetching a book from a loaded [...]

MSR Speaking Qualifier
Robotics Institute,
Carnegie Mellon University

Eric Dexheimer – MSR Thesis Talk

Location: https://cmu.zoom.us/j/98262481359?pwd=dnN4UERmQlF6dVVROTQ1czYrU215UT09 Title: Efficient Multiresolution Scrolling Grid for MAV Obstacle Avoidance Abstract: In this talk, we propose the use of an efficient, structured multiresolution representation for robot mapping and planning.  We focus on expanding the sensor range of dense local grids for memory-constrained platforms.  While multiresolution data structures have been proposed previously, we avoid processing [...]

MSR Speaking Qualifier
Robotics Institute,
Carnegie Mellon University

Tanmay Agarwal – MSR Thesis Talk

Zoom link: https://cmu.zoom.us/j/3388909661 Title: On-Policy Reinforcement Learning for Learning to Drive in Urban Settings Abstract: Traditional autonomous vehicle pipelines that follow a modular approach have been very successful in the past both in academia and industry, which has led to autonomy deployed on road. Though this approach provides ease of interpretation, its generalizability to unseen [...]

MSR Speaking Qualifier
PhD Student
Robotics Institute,
Carnegie Mellon University

Jay Patrikar – MSR Thesis Talk

Zoom link: https://cmu.zoom.us/j/93391276533?pwd=RTM4NTc0cTJETmRudGcwenNCSVgzdz09 Title: Wind-Field Estimation and Curvature Continuous Path Planning for Low Altitude Urban Aerial Mobility Abstract: Unmanned Aerial Vehicles (UAVs) operating in dense urban areas need the ability to generate wind-aware collision-free, smooth, dynamically feasible trajectories between two locations. The complex and high-rise structure of the modern urban landscape affects the wind flow [...]

MSR Speaking Qualifier
PhD Student
Robotics Institute,
Carnegie Mellon University

Benjamin Freed – MSR Thesis Talk

Where?:https://cmu.zoom.us/j/96355036481?pwd=OCtBeWZpMnZsZzFlRkJWc2dkZW5qUT09   Title: Discrete Communication Learning via Backpropagation for Distributed Computing on Bandwidth-Limited Communication Networks   Abstract: Efficient inter-agent communication is an important requirement for both cooperative multi-agent robotics tasks, as well as distributed computing.  In both of these domains, the rate at which information can be transferred between robots or computing nodes is often [...]

MSR Speaking Qualifier
Robotics Institute,
Carnegie Mellon University

Tanvir Parhar – MSR Thesis Talk

Zoom Link:https://cmu.zoom.us/j/3399055387 Title: Applications of Deep Learning for Robotic Agriculture.   Abstract: Agricultural automation is a varied and challenging field, with tasks ranging from detection to sizing and from manipulation to navigation. These are also precursors to effective plant breeding and management. Making plant measurements by manually scouting is labor-intensive and intractable at large scale. [...]

MSR Speaking Qualifier
Robotics Institute,
Carnegie Mellon University

Hitesh Arora – MSR Thesis Talk

Zoom link: https://cmu.zoom.us/j/4937138807   Title: Off-Policy Reinforcement Learning for Autonomous Driving   Abstract: Modern autonomous driving systems continue to face the challenges of handling complex and variable multi-agent real-world scenarios. Some subsystems, such as perception, use deep learning-based approaches to leverage large amounts of data to generalize to novel scenes. Other subsystems, such as planning [...]

MSR Speaking Qualifier
Robotics Institute,
Carnegie Mellon University

Scott Sun – MSR Thesis Talk

Zoom link: https://cmu.zoom.us/j/93097644031?pwd=RzZVSXEvdE5zZ0RDaU9FdmRUMU1vQT09 Title: Accurate Orientation Estimates for Deep Inertial Odometry Abstract: Many smartphone applications use inertial measurement units (IMUs) to sense movement, but the use of these sensors for pedestrian localization can be challenging due to their noise characteristics. Recent deep inertial odometry approaches to pedestrian navigation have demonstrated the increasing feasibility of inertial navigation. However, [...]

MSR Speaking Qualifier
Robotics Institute,
Carnegie Mellon University

Allen Cheng – MSR Thesis Talk

Zoom link: https://cmu.zoom.us/j/6056258382   Title: Search-Based Planning with Extend Operator   Abstract: Sampling-based approaches are often favored in robotics for high-dimensional motion planning for their fast coverage of the search space. However, at best they offer asymptotic guarantees on completeness and solution quality, and returned paths are typically unpredictable due to their inherent stochasticity. By [...]

VASC Seminar
Vincent Sitzmann
Postdoc
MIT CSAIL

Implicit Neural Scene Representations

Virtual Zoom Seminar:  https://cmu.zoom.us/j/92178295543?pwd=L2dwZU5SbDY5NzZZNzZ4ZmFUclRqQT09   Abstract How we represent signals has major implications for the algorithms we build to analyze them. Today, most signals are represented discretely: Images as grids of pixels, shapes as point clouds, audio as grids of amplitudes, etc. If images weren't pixel grids - would we be using convolutional neural networks [...]

MSR Speaking Qualifier
Robotics Institute,
Carnegie Mellon University

Chenfeng Tu – MSR Thesis Talk

Location: https://cmu.zoom.us/j/96696044200?pwd=MVl4aUpiZlYvYlRwRmF1SVBUeGx6Zz09   Title: On-the-fly Targetless Extrinsics Calibration For Multi-Stereo Systems Without Field-of-View Overlap Abstract: In this talk, we propose an on-the-fly extrinsics calibration method for stereo pairs lacking overlapping field of view that is robust to visual odometry errors. Multi-stereo systems are becoming increasingly popular because of their large field of view (FoV) that benefits [...]

MSR Speaking Qualifier
Robotics Institute,
Carnegie Mellon University

Shuoqi Chen – MSR Thesis Talk

Zoom link: https://cmu.zoom.us/j/9608506704   Title: Towards Geometric Motion Planning for 3-link Kinematic Systems   Abstract: Geometric mechanics offers a powerful mathematical framework for studying locomotion for mobile systems. Despite the well-established literature, challenges remain when using geometric mechanics to design gaits for robots made of multi-link chain; in this thesis, we look at two of them. First, [...]

PhD Thesis Defense
Robotics Institute,
Carnegie Mellon University

Robot Deep Reinforcement Learning: Tensor State-Action Spaces and Auxiliary Task Learning with Multiple State Representations

Zoom Link Abstract: A long standing goal of robotics research is to create algorithms that can automatically learn complex control strategies from scratch. Part of the challenge of applying such algorithms to robots is the choice of representation. Reinforcement Learning (RL) algorithms have been successfully applied to many different robotic tasks such as the Ball-in-a-Cup [...]

MSR Speaking Qualifier
PhD Student
Robotics Institute,
Carnegie Mellon University

Raunaq Bhirangi – MSR Thesis Talk

Zoom link: https://cmu.zoom.us/j/93803046130?pwd=dE5LU21lakcxNjBmZ0EvVDdNOWswdz09   Title: Learning Families of Behaviors for Legged Locomotion using Model-Free Deep Reinforcement Learning   Abstract: Conventional planning and control of highly articulated legged robots is challenging because of the high dimensionality of the state space, and such conventional techniques normally produce a single point solution. In this work, we present a [...]

MSR Speaking Qualifier
Robotics Institute,
Carnegie Mellon University

William Qi – MSR Thesis Talk

Location: https://cmu.zoom.us/j/96923127678?pwd=TWt3Zk5neFUzSlJWUjZEN2F6UVhudz09 Title: Representation Learning for Safe Autonomous Movement Abstract: Mobile robots have become an increasingly common presence in our homes and on our roads. To move safely within these shared spaces, autonomous agents must understand how other dynamic actors behave and how such behavior influences the navigability of the surrounding scene. Towards this goal, we [...]

MSR Speaking Qualifier
Robotics Institute,
Carnegie Mellon University

Ryan Coulson – MSR Thesis Talk

Zoom link: https://cmu.zoom.us/j/91138367616 Title: Soft Materials Architectures for Robot Manipulation Abstract: Robot manipulation has been a prolific subject of academic research for several decades - however, today's robotic manipulators have yet to demonstrate an ability to perform robust and versatile dexterous manipulation. This challenge can largely be attributed to a tradeoff between complexity and capability [...]

MSR Speaking Qualifier
Robotics Institute,
Carnegie Mellon University

Anish Bhattacharya – MSR Thesis Talk

Zoom link: https://cmu.zoom.us/j/4413360562 Title: Toward Increased Airspace Safety: Quadrotor Guidance for Targeting Aerial Objects Abstract: As the market for commercially available unmanned aerial vehicles (UAVs) booms, there is an increasing number of small, teleoperated or autonomous aircraft found in protected or sensitive airspace. Existing solutions for removal of these aircraft are either military-grade and too [...]

MSR Speaking Qualifier
Robotics Institute,
Carnegie Mellon University

Aaron Miller – MSR Thesis Talk

Zoom link: https://cmu.zoom.us/j/95386019509?pwd=cmNnTm9lWWlNbTh1SmQ0RU5PVTBmQT09 Title: Cooperative Perception for Pairs of Self-Driving Cars   Abstract: Fully autonomous vehicles are expected to share the road with less advanced vehicles for a significant period of time. Furthermore, an increasing number of vehicles on the road are equipped with a variety of low-fidelity sensors which provide some perception and localization [...]

MSR Speaking Qualifier
Robotics Institute,
Carnegie Mellon University

Sara Misra – MSR Thesis Talk

Zoom link: https://cmu.zoom.us/j/3216213856   Title: Learning-based modular framework for environment-adaptive planning in exploration tasks   Abstract: Search-based path planning has spawned a number of different solutions using different paradigms and strategies, both generalized and specific to certain problems, representations, and environments. Split into heuristic and non-heuristic based approaches, where heuristic-based approaches, embedded within these approaches [...]

MSR Speaking Qualifier
Robotics Institute,
Carnegie Mellon University

Blake Buchanan – MSR Thesis Talk

Location: https://cmu.zoom.us/j/99874277969?pwd=Q1MvczNhWTB4UmF3UXFOMEFtVG1uZz09 Title: Mechanics and Control of Coupled Interactions in Ambient Media Abstract: Many multi-agent systems in nature comprise agents that interact with, and respond to, the dynamics of their environment. For example, fish school based on the fundamental fluid phenomena of vortex shedding, birds shed leading-edge vortices in formation for flocking, and E. coli bacteria [...]

PhD Thesis Defense
Robotics Institute,
Carnegie Mellon University

Online Inference of Joint Occupancy using Forward Sensor Models and Trajectory Posteriors for Deliberate Robot Navigation

Zoom Link Abstract: Robotic navigation algorithms for real-world robots require dense and accurate probabilistic volumetric representations of the environment in order to traverse efficiently. Sensor data in a Simultaneous Localisation And Mapping (SLAM) context, however, always has associated acquisition noise and pose uncertainty, and encoding this within the map representation while still maintaining computational tractability [...]