PhD Thesis Proposal

Abstract: Reasoning about the future is fundamental to intelligence. In this work, I consider the problem of reasoning about the future actions of an intelligent agent. This poses two key questions. How can we build learning-based systems to forecast the behavior of observed agents (third-person, "allocentric forecasting")? More challenging is the question: how should we [...]

Abstract: Motion planning has achieved a great success in many robotic applications but still suffers in the real world under ample uncertainty. For example, manipulation involves interaction with unstructured and stochastic environments, which results in motion uncertainty. Perception that provides understanding of the environment is also not perfect, which in turn leads to sensing uncertainty. [...]

Abstract: A robot that operates efficiently in a team with a human in an unstructured outdoor environment must be able to translate commands from a modality that is intuitive to its operator into actions. This capability is especially important as robots become ubiquitous and interact with untrained users. For this to happen, the robot must [...]

Abstract: A general purpose robot will need to interact with objects in cluttered environments with minimal supervision. Machine learning provides methods that can deal with these complex tasks without explicitly modelling the environment. More recently, deep learning techniques combined with large scale data has revolutionized the fields of computer vision, language processing and reinforcement learning. [...]

Abstract: Robust robotic flight requires tightly coupled perception and control. Conventional approaches employ a SLAM algorithm to infer the most likely trajectory and then generate an occupancy grid map using dense sensor data for planning purposes. In such approaches all the robustness and accuracy costs are offset to the SLAM algorithm; if there are any [...]

Abstract: Imaging sonars have been used for a variety of tasks geared towards increasing autonomy of underwater vehicles: image registration and mosaicing, vehicle localization, object recognition, mapping, and path planning, to name a few. However, the complexity of the image formation has led many algorithms to make the restrictive assumption that the scene geometry is [...]

Abstract: Current non-rigid structure from motion (NRSfM) algorithms are limited with respect to: (i) the number of images, and (ii) the type of shape variability they can handle. This has hampered the practical utility of NRSfM for many applications within vision. Deep Neural Networks (DNNs) are an obvious candidate to help with such issue. However, [...]

Abstract: Portable camera sensor systems are becoming more and more popular in computer vision applications such as autonomous driving, virtual reality, robotics manipulation and surveillance, due to the decreasing expense and size of RGB camera. Despite the compactness and portability of the small baseline vision systems, it is well-known that the uncertainty in range finding [...]

Abstract: Humans have the remarkable ability to create visual worlds far beyond what could be seen by human eye, including inferring the state of unobserved, imagining the unknown, and thinking about diverse possibilities about what lies in the future. Machines lack this inquisitive ability despite the current revolution in machine learning and computer vision. We [...]

Abstract: Humans are arguably one of the most important entities that AI systems would need to understand to be useful and ubiquitous. From autonomous cars observing pedestrians to assistive robots helping the elderly, a large part of this understanding is focused on recognizing human actions, and potentially, their intentions. Humans themselves are quite good at [...]