I train multimodal models to act in the real world. Start from the capability we want, build the tasks, environments, rewards, and synthetic data that teach it, then train with RL.
At Meta Superintelligence Labs I lead synthetic data and RL for Muse, a real-time omni model for personal agents, and built the offline RL system behind Vibes. Before that, I worked on Visual Intelligence at Apple and foundation models at MIT-IBM Watson. I got my Ph.D. in Computer Science at MIT, and B.A. in Physics at UC Berkeley. Outside work I read, write, bike, and hike.
Open questions
What does an agent need to perceive and act continuously, rather than turn by turn? Muse ↓
How far can a task definition alone take you: environment, reward, and data? Synthetic Data RL ↓
How small can a model be and still plan on-device? Octo-planner ↓
Talk to me
If you work on real-time agents, RL environments, or post-training, email me. I reply. I'll be at COLM 2026, Oct 6–9.
Research
Muse · 2025–26
Muse: Real-time perception and action
An omni model that perceives and responds in real time instead of turn by turn, and can be interrupted mid-action. I lead synthetic data and RL, and work on the distillation that makes it fast and natural enough to talk to.
Built the agentic long-form video workflow and the offline RL system behind Vibes, Meta AI's personalized video feed, and led its human-evaluation data.
Built the datasets for on-device visual question answering on iPhone with privacy-preserving VLMs, and post-trained Apple's foundation model for proactive question answering on egocentric video. Shipped in Apple Intelligence at WWDC 2025.
Given a target capability, synthesize the tasks, the environment, and the reward, then train with RL. No labeled dataset required; the task definition is the input.
JetMoE-8B, an open-source mixture-of-experts model trained for a fraction of the usual cost that outperforms Llama2-13B, with a synthetic corpus for pre-training and post-training.
When the headline metric becomes output per joule, a technology has become a utility. Intelligence just did, and the money will go where it always goes: upstairs.