VASC Seminar
Bryan Russell
Senior Research Scientist
Adobe Research

Telling Left from Right: Learning Spatial Correspondence Between Sight and Sound

Virtual VASC Seminar:  https://cmu.zoom.us/j/92741882813?pwd=R1R0eGRaeXFHTEF2VWNwY2VIZmU5Zz09 Abstract:  Self-supervised audio-visual learning aims to capture useful representations of video by leveraging correspondences between visual and audio inputs. Existing approaches have focused primarily on matching semantic information between the sensory streams. In my talk, I’ll describe a novel self-supervised task to leverage an orthogonal principle: matching spatial information in the [...]

PhD Thesis Proposal
Robotics Institute,
Carnegie Mellon University

Heuristics for routing and scheduling of Spatio-Temporal type problems in industrial environments

Zoom Link Abstract: Spatio-temporal problems are fairly common in industrial environments. In practice, these problems come with different characteristics and are often very hard to solve optimally. So practitioners prefer to develop heuristics that exploit mathematical structure specific to the problem for obtaining good performance. In this proposal, I will present work on heuristics for [...]

MSR Speaking Qualifier
Robotics Institute,
Carnegie Mellon University

Aditya Agarwal – MSR Thesis Talk

Zoom Link:  https://cmu.zoom.us/j/3276236755   Title: Fast and High-Quality GPU-based Deliberative Perception for Object Pose Estimation Abstract:  Pose estimation of known objects is fundamental to tasks such as robotic grasping and manipulation. The need for reliable grasping imposes stringent accuracy requirements on pose estimation in cluttered, occluded scenes in dynamic environments. Existing methods either require large sets of [...]

PhD Speaking Qualifier
Robotics Institute,
Carnegie Mellon University

Learning Active Task-Oriented Exploration Policies for Bridging the Sim-to-Real Gap

Zoom Link Abstract: Training robotic policies in simulation suffers from the sim-to-real gap, as simulated dynamics can be different from real-world dynamics. Past works tackled this problem through domain randomization and online system-identification. The former is sensitive to the manually-specified training distribution of dynamics parameters and can result in behaviors that are overly conservative. The [...]

PhD Thesis Proposal
Robotics Institute,
Carnegie Mellon University

Understanding, Exploiting and Improving Inter-view Relationships

 Zoom Link Abstract: Multi-view machine learning has received substantial attention in various applications over recent years. These applications typically involve learning on data obtained from multiple sources of information, such as, for example, in multi-sensor systems such as self-driving cars and patient bed-side monitoring. Learning models for such applications can often benefit from leveraging not [...]

PhD Speaking Qualifier
Postdoctoral Fellow
Robotics Institute,
Carnegie Mellon University

Interferometric light transmission probing with coded mutual intensity

Zoom Link Abstract: We introduce a new interferometric imaging methodology that we term interferometry with coded mutual intensity, which allows selectively imaging photon paths based on attributes such as their length and endpoints. At the core of our methodology is a new technical result that shows that manipulating the spatial coherence properties of the light [...]

MSR Speaking Qualifier
Robotics Institute,
Carnegie Mellon University

Josh Jaekel – MSR Thesis Talk

Zoom Link: https://cmu.zoom.us/j/97161117200?pwd=QlpkS0hFOFVLRDlKVlFqby9JbWZTUT09 Title: Towards Robust Multi-Camera Visual Inertial Odometry Abstract: Visual inertial odometry (VIO) has become an increasingly popular method of obtaining a state estimate on board smaller robots like micro aerial vehicles (MAVs). While VIO has demonstrated impressive results in certain environments, there is still work to be done in improving the robustness of [...]

MSR Speaking Qualifier
Robotics Institute,
Carnegie Mellon University

John Mai – MSR Thesis Talk

Zoom Link: https://cmu.zoom.us/j/7518832261 Title: System Design, Modelling, and Control for an Off-Road Autonomous Ground Vehicle Abstract: Autonomy in passenger road vehicles has long been a goal for many research groups and companies, and there has been a significant amount of focus on achieving this endeavour. A lesser focused upon area is the task of precise autonomous [...]

MSR Speaking Qualifier
Robotics Institute,
Carnegie Mellon University

Zoom Link: https://cmu.zoom.us/j/5523238059   Title: Robust Instance Tracking via Uncertainty Flow   Abstract: Current state-of-the-art trackers often fail due to distractors and large object appearance changes. In this work, we explore the use of dense optical flow to improve tracking robustness. Our main insight is that, because flow estimation can also have errors, we need [...]

VASC Seminar
Ciprian Corneanu
Research Assistant
Tawny GmbH, University of Barcelona

The Topology of Learning

Zoom Virtual Meeting:  https://cmu.zoom.us/j/92178295543?pwd=L2dwZU5SbDY5NzZZNzZ4ZmFUclRqQT09   Abstract: Deep Neural Networks (DNNs) have revolutionized computer vision. We now have DNNs that achieve top results in many computer vision problems, including object recognition, facial expression analysis, and semantic segmentation, to name but a few. Unfortunately, the rise in performance has come with a cost.  DNNs have become so [...]