Papers
16
Total Citations
1,273
H-Index
12
About
Ofir Nachum is a prominent machine learning researcher whose work spans reinforcement learning, safe AI, robotics, and foundation models for decision-making. He has made foundational contributions to hierarchical reinforcement learning, most notably through his widely adopted HIRO framework ("Data-Efficient Hierarchical Reinforcement Learning," 2018, 265 citations), which addressed key scalability challenges in complex sequential tasks without requiring extensive task-specific engineering. His influential work on Lyapunov-based approaches to safe reinforcement learning (2018–2019, over 230 combined citations) established rigorous theoretical frameworks for ensuring agent safety during both training and deployment — a critical concern for real-world applications. Nachum has also been a key contributor to large-scale robotics research, co-authoring the landmark RT-1 paper (2023, 512 citations), which demonstrated that transformer models trained on diverse robotic datasets could generalize impressively to real-world manipulation tasks. His broader interests in offline reinforcement learning, deployment efficiency, and video-guided policy generation reflect a consistent drive to make AI agents more practical and generalizable. With work featured across top venues and hundreds of citations, Nachum stands as a significant voice bridging theoretical rigor and real-world applicability in modern AI research.
Research Focus
Key Achievements
Top Papers
- 1RT-1: Robotics Transformer for Real-World Control at Scale512 citations · 2023
- 2Data-Efficient Hierarchical Reinforcement Learning265 citations · 2018
- 3Lyapunov-based Safe Policy Optimization for Continuous Control153 citations · 2019
- 4A Lyapunov-based Approach to Safe Reinforcement Learning78 citations · 2018
- 5Foundation Models for Decision Making: Problems, Methods, and Opportunities51 citations · 2023
- 6
- 7RT-1: Robotics Transformer for Real-World Control at Scale38 citations · 2022
- 8Learning Universal Policies via Text-Guided Video Generation29 citations · 2023
- 9
- 10Benchmarks for Deep Off-Policy Evaluation25 citations · 2021