Shaobo Hou

Google (United States)

Papers

1

Total Citations

38

H-Index

1

About

Shaobo Hou is a researcher whose work lies at the intersection of reinforcement learning and skill acquisition, with a particular focus on hierarchical and transfer learning. His most notable contribution is the introduction of the "Option Keyboard," a framework that enables agents to combine known skills in the space of pseudo-rewards, or cumulants, to solve complex, long-horizon problems. This work, published in 2019 and garnering 38 citations, provides a robust method for composing skills without retraining, offering a principled approach to lifelong learning in AI. Hou’s research addresses a fundamental challenge in reinforcement learning: how to reuse and recombine existing behaviors to tackle novel tasks efficiently. By formalizing skill composition through cumulants, his work has influenced subsequent studies in hierarchical reinforcement learning and multi-task transfer. For students and researchers, Hou’s contributions offer a clear pathway for building modular, scalable agents that can adapt over extended time horizons, making his research essential reading for those interested in the future of autonomous decision-making and skill-based learning systems.

Research Focus

Key Achievements

1
H-Index
1
Papers
38
Total Citations
38
Avg Citations/Paper
🏆 Most Cited Paper
The Option Keyboard: Combining Skills in Reinforcement Learning
38 citations · 2019
📈 Most Prolific Year: 2019 (1 Papers)
🤝 Key Collaborators: 10
🏛 Institutions: Google (United States)

Top Papers

  1. 1

Key Collaborators

Contact & Links

Available for collaboration
Content generated · 12 days ago