Faculty Candidate Talk: Aja Carter
Title: Paleorobotics: Design Principles 540 million years in the making Abstract: Bioinspiration has provided key design insights in many fields, particularly in robotics, where there has been an explosion of interest in quadrupedal robot “dogs” and bipedal humanoid robots. However, the designs prescribed by only considering living animals are a small subset of available designs; [...]
Deformation-Aware Manipulation: Compliant and Geometric Approaches for Non-Anthropomorphic Hands
Abstract: Soft robot hands offer compelling advantages for manipulation tasks, including inherent safety through material compliance, robust adaptation to uncertain object geometries, and the ability to conform to complex shapes passively. However, these same properties create significant challenges for conventional sensing and control approaches. This talk presents approaches to bridging advances in geometric learning and [...]
Faculty Candidate Talk: Carlo Sferrazza
Title: The Path to Humanoid Intelligence Abstract: Humanoid robots represent the ideal physical embodiment to assist us in the diversity of our daily tasks and human-centric environments. Driven by substantial hardware advancements, progress in artificial intelligence (AI), and a growing demand for adaptable automation, this vision appears increasingly feasible. Yet, to date, humanoid intelligence remains [...]
Towards Natural Language-Driven Shape Arrangement Synthesis using Semantically-Aware Geometric Constraints
Abstract: While diffusion-based models excel at generating photorealistic images from text, a more nuanced challenge emerges when constrained to using only a fixed set of rigid shapes—akin to solving tangram puzzles or arranging real-world objects to match semantic descriptions. We formalize this problem as shape-based image generation, a new natural language-guided image-to-image translation task that [...]
Toward Generalizable Interaction-aware Human Motion Prediction
Abstract: As autonomous robots are increasingly expected to operate in dynamic, human-centered environments, it is crucial to develop robot policies that ensure safe and seamless interactions with humans, all while allowing robots to complete their intended tasks efficiently. To achieve this, robots must be capable of making informed decisions that account for human preferences, ensuring [...]
Physical Intelligence and Cognitive Biases Toward AI
Abstract: When will robots be able to clean my house, dishes, and take care of laundry? While we source labor primarily from automated machines in factories, the penetration of physical robots in our daily lives has been slow. What are the challenges in realizing these intelligent machines capable of human level skill? Isn’t AI advanced [...]
Robotics Institute Semi-formal
Hello all Robotics Institute faculty, students, visitors and staff, You and a guest are cordially invited to attend The Robotics Institute Semi-formal
Enhancing Reinforcement Learning with Error-Prone Language Models
The correct specification of reward models is a well-known challenge in reinforcement learning. Hand-crafted reward functions, which are usually sparse, often lead to inefficient or suboptimal policies, misalignment with user values, or difficulties in attributing credit or blame within multi-agent systems. Reinforcement learning from human feedback is a successful technique that can mitigate such issues [...]
Efficient Multi-Agent Motion Planning using Local Policies
Abstract: Teams of multiple robots working together can achieve challenging tasks like warehouse automation, search and rescue, and cooperative construction. However, finding efficient collision-free motions for all agents is extremely challenging as the complexity of the multi-agent motion planning (MAMP) problem grows exponentially with the number of agents. Multi-Agent Path Finding (MAPF) is a subset [...]
Foundation Control Model for General Embodied Intelligence
Abstract: With the growing accessibility of humanoid hardware and rapid advances in foundation models, we are entering an era where achieving general embodied intelligence is within reach—enabling humanoid robots to perform a wide range of tasks in human-centric environments. Despite significant progress in language and vision foundation models, controlling humanoids with high degrees of freedom [...]