About

Louis-Philippe Morency is a leading figure in multimodal machine learning, a field he has helped define through pioneering work on how computers perceive and integrate human communicative signals—from language and tone to facial expressions and gestures. His foundational contributions are captured in the widely cited *Foundations & Trends in Multimodal Machine Learning* (2024, 150+ citations), which serves as a definitive roadmap for the discipline. Morency’s research has a strong human-centered focus, advancing automatic emotion recognition across the lifespan. He created the EmoReact dataset (2016, 117 citations) to enable emotion recognition in children, and later ElderReact (2019, 37 citations) to extend this capability to aging adults—critical steps for developing socially intelligent robots and affect-aware tutors. His earlier work on head pose estimation and gesture recognition (e.g., head-nod recognition in human-robot conversation, 2006, 104 citations) laid the technical groundwork for natural, non-verbal human-robot interaction. With over 800 citations across his top papers, Morency’s research bridges computer vision, affective computing, and conversational AI, shaping how machines understand us through the rich, multimodal tapestry of human communication.

Research Focus

Key Achievements

14
H-Index
28
Papers
956
Total Citations
34
Avg Citations/Paper
🏆 Most Cited Paper
Foundations & Trends in Multimodal Machine Learning: Principles, Challenges, and Open Questions
150 citations · 2024
📈 Most Prolific Year: 2024 (4 Papers)
🤝 Key Collaborators: 59
🏛 Institutions: Carnegie Mellon University, IIT@MIT, USC Institute for Creative Technologies, University of Southern California, Seikei University, Creative Technologies (United States)

Top Papers

  1. 1
  2. 2
  3. 3
  4. 4
  5. 5
  6. 6
  7. 7
  8. 8
  9. 9
  10. 10

Key Collaborators

Contact & Links

Available for collaboration
Content generated · 14 days ago