Papers
39
Total Citations
3,131
H-Index
19
About
Pierre Sermanet is a pioneering robotics and machine learning researcher whose work sits at the intersection of computer vision, self-supervised learning, and embodied AI. Over more than a decade, he has made foundational contributions to how robots perceive, learn from, and act within the physical world. Sermanet's early work demonstrated that autonomous vehicles could learn long-range terrain classification from unlabeled data using deep belief networks — a prescient application of unsupervised learning to real-world robotics. He later developed Time-Contrastive Networks (TCN), an elegant self-supervised framework enabling robots to learn directly from multi-viewpoint video without human annotation, garnering over 550 citations and influencing a generation of imitation learning research. His more recent work has shaped the frontier of language-grounded robotics. As a contributor to landmark projects including SayCan (516 citations), PaLM-E (350 citations), and RT-2 (267 citations), Sermanet has helped establish how large language and vision-language models can be grounded in robotic affordances and sensor data to enable flexible, generalizable robot behavior. His contributions to Inner Monologue further advanced embodied planning through language model reasoning. Collectively, his publications have accumulated thousands of citations, reflecting substantial and sustained influence on both academic research and real-world robotics deployment.
Research Focus
Key Achievements
Top Papers
- 1Time-Contrastive Networks: Self-Supervised Learning from Video555 citations · 2018
- 2Do As I Can, Not As I Say: Grounding Language in Robotic Affordances516 citations · 2022
- 3PaLM-E: An Embodied Multimodal Language Model350 citations · 2023
- 4Learning long‐range vision for autonomous off‐road driving316 citations · 2009
- 5RT-2: Vision-Language-Action Models Transfer Web Knowledge to Robotic Control267 citations · 2023
- 6Inner Monologue: Embodied Reasoning through Planning with Language Models206 citations · 2022
- 7Unsupervised Perceptual Rewards for Imitation Learning124 citations · 2017
- 8Time-Contrastive Networks: Self-Supervised Learning from Multi-view Observation116 citations · 2017
- 9Language Conditioned Imitation Learning Over Unstructured Data99 citations · 2021
- 10