Ryan Marten

University of Illinois Urbana-Champaign

Papers

2

Total Citations

58

H-Index

2

About

Ryan Marten is a leading researcher in multimodal artificial intelligence, with a focus on scaling autoregressive models that unify vision, language, audio, and action. His most notable contribution is the development of Unified-IO 2, the first autoregressive multimodal model capable of both understanding and generating across these diverse modalities. By tokenizing inputs and outputs—including images, text, audio, action, and bounding boxes—into a shared semantic space, Marten’s work enables a single model to perform tasks ranging from image captioning to robotic control. This breakthrough, detailed in his 2024 paper (55 citations), represents a significant step toward general-purpose AI systems. His earlier 2023 paper (3 citations) laid the foundational architecture for this scaling approach. Marten’s research has profound implications for robotics, accessibility, and human-computer interaction, demonstrating how unified models can streamline complex multimodal tasks. His work is widely recognized for pushing the boundaries of what autoregressive models can achieve, making him a key figure in the next generation of AI research.

Research Focus

Key Achievements

2
H-Index
2
Papers
58
Total Citations
29
Avg Citations/Paper
🏆 Most Cited Paper
Unified-IO 2: Scaling Autoregressive Multimodal Models with Vision, Language, Audio, and Action
55 citations · 2024
📈 Most Prolific Year: 2024 (1 Papers)
🤝 Key Collaborators: 8
🏛 Institutions: University of Illinois Urbana-Champaign

Top Papers

  1. 1
  2. 2

Key Collaborators

Contact & Links

Available for collaboration
Content generated · 13 days ago