Papers
12
Total Citations
457
H-Index
9
About
Derek Hoiem is a computer vision researcher whose work spans 3D scene understanding, multimodal AI, and robotic perception. Best known for his pioneering contributions to spatial layout estimation and 3D scene reconstruction, Hoiem has consistently pushed the boundaries of how machines interpret and reason about the physical world from limited sensor data. His most celebrated contribution, "3D-PRNN: Generating Shape Primitives with Recurrent Neural Networks" (2017, 194 citations), introduced an elegant framework for representing 3D shapes as collections of simple geometric primitives — mirroring human perceptual intuition and enabling more structured scene understanding for robotics and digital content creation. Complementing this, his work on predicting complete 3D models of indoor scenes from single RGBD images demonstrated remarkable ability to infer both visible and occluded scene geometry, advancing the field of holistic scene parsing. Hoiem's research extends into multimodal AI, contributing to Unified-IO 2 (2024), a groundbreaking autoregressive model unifying vision, language, audio, and action understanding. Early work in audio-visual object localization and robot navigation further illustrates his breadth. His dissertation on spatial layout for 3D scene understanding remains a foundational reference, cementing his reputation as a key architect of modern scene comprehension research.
Research Focus
Key Achievements
Top Papers
- 13D-PRNN: Generating Shape Primitives with Recurrent Neural Networks194 citations · 2017
- 2
- 3Predicting Complete 3D Models of Indoor Scenes51 citations · 2015
- 4SOLAR: Sound Object Localization and Retrieval in Complex Audio Environments45 citations · 2006
- 5Complete 3D Scene Parsing from an RGBD Image30 citations · 2018
- 63D-PRNN: Generating Shape Primitives with Recurrent Neural Networks22 citations · 2017
- 7Opportunistic Use of Vision to Push Back the Path-Planning Horizon18 citations · 2006
- 8ChromaTag: A Colored Marker and Fast Detection Algorithm14 citations · 2017
- 9Seeing the World Behind the Image: Spatial Layout for 3D Scene Understanding13 citations · 2007
- 10Complete 3D Scene Parsing from Single RGBD Image.7 citations · 2017