Papers
10
Total Citations
38
H-Index
4
About
Francis Ferraro is a leading researcher at the intersection of natural language processing, robotics, and human-robot interaction (HRI), with a core focus on grounded language acquisition—teaching robots to understand language by connecting words to physical percepts. His pioneering work addresses the critical data bottleneck in robotics by developing virtual reality (VR) simulators that generate rich, multimodal training data for real-world robots, as demonstrated in his highly cited 2021 paper "A Simulator for Human-Robot Interaction in Virtual Reality" (8 citations). Ferraro has made significant contributions to speech-based and multilingual grounded learning, creating datasets like the Spoken Language Dataset for speech-based grounding (6 citations) and extending systems to Spanish ("¿Es un platano?", 2 citations). His research explores active learning strategies for efficient training, deep acoustic representations for processing raw speech, and even ethical reasoning in robots using large language models (GPT-4 as a Moral Reasoner, 2024). With over 35 total citations across his most-cited works, Ferraro's innovative use of VR for HRI and his commitment to building language-agnostic, sample-efficient systems are shaping the future of how robots learn to communicate naturally with humans in diverse, real-world environments.
Research Focus
Key Achievements
Top Papers
- 1A Simulator for Human-Robot Interaction in Virtual Reality8 citations · 2021
- 2
- 3Towards Making Virtual Human-Robot Interaction a Reality6 citations · 2021
- 4Building Language-Agnostic Grounded Language Learning Systems4 citations · 2019
- 5
- 6Learning from human-robot interactions in modeled scenes3 citations · 2019
- 7
- 8
- 9
- 10GPT-4 as a Moral Reasoner for Robot Command Rejection1 citations · 2024