Vashisht Madhavan

Uber AI (United States)

Papers

2

Total Citations

264

H-Index

2

About

Vashisht Madhavan is a researcher specializing in deep reinforcement learning and evolutionary optimization methods, with a particular focus on improving exploration strategies for training neural networks. His most recognized contribution centers on enhancing Evolution Strategies (ES) — a class of black-box optimization algorithms — by incorporating populations of novelty-seeking agents to overcome one of reinforcement learning's most persistent challenges: efficient exploration of complex environments. Madhavan's work demonstrates that ES can train deep neural networks to perform comparably to established methods like Q-learning and policy gradient approaches, while offering dramatic speed advantages through superior parallelization — reducing training time from days to mere hours. By integrating novelty-seeking behavior into the evolutionary population, his research addresses the tendency of standard ES to converge prematurely on suboptimal solutions, enabling more robust and diverse exploration of the solution space. His primary paper on this topic has accumulated over 260 combined citations across its versions, reflecting meaningful influence within the reinforcement learning community. This research contributes to the broader effort of making deep RL both computationally practical and more reliable — an important step toward scalable intelligent systems.

Research Focus

Key Achievements

2
H-Index
2
Papers
264
Total Citations
132
Avg Citations/Paper
🏆 Most Cited Paper
Improving Exploration in Evolution Strategies for Deep Reinforcement Learning via a Population of Novelty-Seeking Agents
148 citations · 2018
📈 Most Prolific Year: 2018 (1 Papers)
🤝 Key Collaborators: 5
🏛 Institutions: Uber AI (United States)

Top Papers

  1. 1
  2. 2

Key Collaborators

Contact & Links

Available for collaboration
Content generated · 14 days ago