I train multimodal models to act in the real world. Start from the capability we want, build the tasks, environments, rewards, and synthetic data that teach it, then train with RL.

At Meta Superintelligence Labs I lead synthetic data and RL for Muse, a real-time omni model for personal agents, and built the offline RL system behind Vibes. Before that, I worked on Visual Intelligence at Apple and foundation models at MIT-IBM Watson. I got my Ph.D. in Computer Science at MIT, and B.A. in Physics at UC Berkeley. Outside work I read, write, bike, and hike.

Open questions
  • What does an agent need to perceive and act continuously, rather than turn by turn? Muse ↓
  • How far can a task definition alone take you: environment, reward, and data? Synthetic Data RL ↓
  • How small can a model be and still plan on-device? Octo-planner ↓
Talk to me
If you work on real-time agents, RL environments, or post-training, email me. I reply. I'll be at COLM 2026, Oct 6–9.

Research

Muse · 2025–26

Muse: Real-time perception and action

An omni model that perceives and responds in real time instead of turn by turn, and can be interrupted mid-action. I lead synthetic data and RL, and work on the distillation that makes it fast and natural enough to talk to.

Blog

Vibes: AI video creation and remix in the Meta AI app
Vibes · 2025

Offline RL for a generated-video feed

Built the agentic long-form video workflow and the offline RL system behind Vibes, Meta AI's personalized video feed, and led its human-evaluation data.

Blog

Apple Intelligence features across iPhone, Mac, and iPad
Apple · 2025

Visual Intelligence on device

Built the datasets for on-device visual question answering on iPhone with privacy-preserving VLMs, and post-trained Apple's foundation model for proactive question answering on egocentric video. Shipped in Apple Intelligence at WWDC 2025.

Blog

JetMoE-8B benchmark comparison against Llama2-13B
JetMoE · 2024

Open MoE at Llama2-13B quality

JetMoE-8B, an open-source mixture-of-experts model trained for a fraction of the usual cost that outperforms Llama2-13B, with a synthetic corpus for pre-training and post-training.

PaperCode

Octo-planner decomposing a user request into web search, video search, and email actions on a phone
Octo-planner · 2024

On-device planner-action agents

Efficient on-device task planning and decomposition, trained on a synthetic planning dataset with a multi-LoRA post-training pipeline.

Paper

News

Essays on AI