Research Lead at @Meta TBD Labs I lead agent research in MSL and training of @Muse. Previously @OpenAI posttraining/agent research

San Francisco, CA
We launched 🍉 (Muse Wonder) and 🍉 Ultra (Muse Wonder Full) today! What excites me most is how much closer we’re getting to agents you can actually delegate work to. Personal agents that understand you and your life, and professional agents that can take on complex, long-running projects. 🍉 is designed for personal and professional agent use Pretty Wonder Full to see this come together just a year after starting the agent team at TBD Labs. Huge credit to the incredible team that made it happen!
Introducing Muse Wonder, our new family of frontier models with state of the art performance for personal and professional agentic work.
12
23
231
13,345
Yes we just don’t like markdown table or list and don’t like the model to ask a question back
Meta's @Muse answers questions very differently from ChatGPT or Anthropic. It cites more sources but uses far fewer words and tables, and doesn't try to ask a follow-up. This short-form content is designed for dealing with tasks rather than continuing a conversation, and frankly, it's far less exhausting to read. This speaks to a really well designed AI experience and its so different from the base LLMs. Great study by the AirOps team 👇 gg @alexandr_wang
2
3
63
6,650
Zhiqing Sun retweeted
“Muse 强就强在浏览器操作上。它是在真实浏览器里一步步点,登录、验证这种关口过不去就叫我,我上去登一下,登完剩下的全是它的活。” cheers! 🍻
Muse 帮我干的 10 件事(1):网上购物 这是我第一次真正用 AI 完成一次网上购物。以前不是没试过,是根本走不通:App 它点不了,浏览器登录、验证码、反爬虫,没几步就卡死。 Muse 强就强在浏览器操作上。它是在真实浏览器里一步步点,登录、验证这种关口过不去就叫我,我上去登一下,登完剩下的全是它的活。 背景是刚到香港,人生地不熟,住进上环的公寓,连附近哪有超市都不知道。我直接问它:新住公寓应该买点什么?它自己去找香港能网购送货的超市,最后落在 HKTVmall,列了一车入住清单:卫生纸、洗洁精、油盐酱醋、牛奶、水饺、海鲜,19 样,594 港币。我一键下单还真的挺齐全。 HKTVmall 这网站本身非常难用,点起来慢得要死。我要自己用估计得气吐血,现在 muse 用,我只需要干点别的,等它说,找好了! 付款这一步是关键:卡号我从来没给过它。同一账号,我在手机上下个 App,购物车同步过去,我看一眼,点付款。这个招是我想出来的,暗暗佩服自己... 磨合过程也真实。第一单送货要等好几天,我等不及先去超市买了,拍张小票回来,它对照着把购物车里重复的划掉。后来我们一起摸出了 8 小时直送的规律,能次日达了。中间也出过问题:胶囊尺寸、饺子包装没跟我商量就定了,买错了 245 港币;说完之后,规格先问我,成了铁律。 还有个小事很能说明问题:后来我想买保鲜膜,问它买过没有,它一查,10 月 1 号那单里已经有了,不用再买,后来我果然在厨房找到了保鲜膜。 所以这不是"AI 帮我下单",而是它把找、比、选、加车这些耗时间的活全干了,最后那个不能反悔的动作,永远留给我自己。 下一篇讲它怎么接管我的飞书,大幅度提高我的工作效率的!助理 2.0 是真的来了,我的人类助理估计正在哭鼻子🤣
3
2
28
2,715
Zhiqing Sun retweeted
muse wonder full on webdev arena not bad, but clearly lots of room for us to improve!
Exciting news: Muse Wonder Full (Max) by @AIatMeta has just debuted in the Code Arena: WebDev at #6 overall with 1726 pts, putting Meta in the top 3 labs! This is +75 pts and 11 places above Muse Wonder (Max) at #17 (1651 pts), and +67 pts and 8 places above Muse Spark 1.3 (Max) at #14 (1659 pts). Muse Wonder Full (#6) also landed +16 pts above Claude Sonnet 5.5 (#17), and +48 pts above Gemini 4 Argon (#10). With this score, Muse took the #3 lab spot (previously held by Google). Across categories, Muse Wonder Full (Max) landed: - #4 in Data & Analytics and in Consumer Product - #5 in Brand & Marketing - #6 in Content Creation Tools - #7 in Gaming and in Simulations - #8 in Reference-Based Design Congrats to the @AIatMeta team and @alexandr_wang on this release!
111
26
584
81,840
Zhiqing Sun retweeted
iPhoneDuoBench is totally next level 🏎️💨
???我怎么没想到
1
3
7
2,460
???我怎么没想到
muse还是太超前了
8
3
97
57,212
Zhiqing Sun retweeted
Excited to see Muse Spark Open released! 🚀 Proud that vLLM powered RL inference during its training at Meta. A glimpse of recursive self-improvement: RL makes models better; LLMs help us optimize inference; faster inference enables more RL. The flywheel keeps spinning. 🔁
🎉 Day-0 support for Meta's open-weight Muse Spark Open is live on vLLM, verified on NVIDIA and AMD GPUs as well as on TPUs! 816B parameters, 42B active per token, a 1M-token image, video and audio inputs, built for long-horizon agentic coding. We’re excited to have worked with Meta Superintelligence Labs to bring Muse Spark Open to vLLM from day one as the most capable US open-weight model. ✨ 1M context for large, complex codebases 👀 Native image, video, audio & document understanding ⚡ BF16, NVFP4 & MXFP4 support 🚀 DSpark speculative decoding on both CUDA and ROCm 1/6
11
14
104
12,502
Zhiqing Sun retweeted
Muse Spark Open -- weights releasing today -- runs great on new Mac Studios thanks to work with @johnternus and Apple.
1,925
1,741
32,061
4,889,573
Zhiqing Sun retweeted
muse spark open -- weights out today! best US open-source model, and runs on the new mac studio 🍎
Muse Spark Open -- weights releasing today -- runs great on new Mac Studios thanks to work with @johnternus and Apple.
177
232
5,823
264,757
Muse Spark Open was literally as good as the best model we released just two months ago. Now it’s open-weight. Enjoy! research.meta.ai/blog/muse-s…
1/ muse spark open is the most capable US open-weight model to date. 816B total params, 42B active. 1M-token context. natively multimodal. built for coding and agentic work like long-horizon tasks, hard software engineering, multi-step reasoning. america! 🇺🇲
4
18
185
7,876
Zhiqing Sun retweeted
In our health workstream at Meta we did a project where we wanted to see what research papers medical experts could write using a Muse Wonder coding scaffold that could access a database of 5M electronic health records we licensed from a vendor. The goal is that with 5M patients in this database, AI could do research to answer arbitrary questions like “did people who take statin have higher rates of diabetes later in life”? The thing we were betting on here is on what happens when you put human experts, a strong coding model, and access to data all together We worked with a small group of medical experts to help them use this AI tool and the punchline is that they all found that this setup enabled a much faster pace of health research. They generated ten manuscripts in around two weeks, with one researcher (Paddy Ssentongo) generating three. Throughout the process, they collaborated with each other to review manuscripts and write skill files to help our coding scaffold improve at doing research. The medical experts liked how quickly they could test different hypotheses and choose the best ones to continue working on Health research is pretty unique in that it is super important to be able to interpret noisy data and have taste to know which variables are important, which was still a significant value add from human researchers. Given that medicine is one of the oldest fields in human history and it is ultimately about humans, keeping a substantial human component in this type of research is probably important. In the near future I see AI primarily as a tool to facilitate human-led research. With the right scaffold I believe health researchers can be 10x or even 100x more productive using AI tools that have appropriate access to the wealth of data that the world has collected about human health One way to see this work is through the broader lens of AI for science. You can think of science as two parts: (1) collecting raw data about the world, and (2) synthesizing that raw data into understanding. In this project we already had existing data about the world and we aimed to accelerate part (2) using AI. Eventually, I imagine a world where we have such great AI tools that the time to synthesize raw data into understanding is driven towards zero. In that world, science will be substantially faster and most of the work will be focused on collecting the right raw data via physical experiments We did this in a pretty short amount of time (which was the point) and I think the future of scientific research will be more faster and more exciting than ever
We’re exploring how AI can accelerate health science research. While AI has made significant breakthroughs in formal sciences like mathematics, health data science depends on imperfect real-world data and consequential choices about cohorts, variables, and causal assumptions. To explore how AI can assist health researchers, we built a human-led research scaffold powered by Muse Spark 1.3 and Muse Wonder with access to 5M retrospective de-identified electronic health records and publicly available data. A cohort of medical experts used the system to conduct original research, accelerate hypothesis generation, code execution, and manuscript drafting while maintaining full authority over scientific decisions. Today, we’re sharing 10 research manuscripts produced through this exploration, spanning cardiology, oncology, infectious disease, emergency medicine, and more. Read more in our research blog: go.meta.me/3U06wvD
41
59
434
68,606
Zhiqing Sun retweeted
We’re exploring how AI can accelerate health science research. While AI has made significant breakthroughs in formal sciences like mathematics, health data science depends on imperfect real-world data and consequential choices about cohorts, variables, and causal assumptions. To explore how AI can assist health researchers, we built a human-led research scaffold powered by Muse Spark 1.3 and Muse Wonder with access to 5M retrospective de-identified electronic health records and publicly available data. A cohort of medical experts used the system to conduct original research, accelerate hypothesis generation, code execution, and manuscript drafting while maintaining full authority over scientific decisions. Today, we’re sharing 10 research manuscripts produced through this exploration, spanning cardiology, oncology, infectious disease, emergency medicine, and more. Read more in our research blog: go.meta.me/3U06wvD
76
101
728
225,365
Zhiqing Sun retweeted
muse wonder full is SOTA on VCB 1-100, new coding eval out today
Muse Wonder Full tops VCB 1–100 which measures sustained, multi-turn software development in the real-world setting and mogs on cost!
34
12
173
31,547
Muse Wonder Full tops VCB 1–100 which measures sustained, multi-turn software development in the real-world setting and mogs on cost!
Existing coding benchmarks stop at the first working version. We are releasing Vibe Code Bench 1-100 today, to measure what comes next. This benchmark asks if models can handle a large number of modifications to a product, without breaking what already works.
2
11
76
31,714
Zhiqing Sun retweeted
Replying to @Wahndo_
that's just my face
753
564
38,915
8,540,828
Zhiqing Sun retweeted
hiiii 👋🏻
anyone know who the girl at 0:30 is??? asking for a friend
43
18
1,105
439,162
Zhiqing Sun retweeted
Excited to share Muse Wonder and Muse Wonder Full!
We launched 🍉 (Muse Wonder) and 🍉 Ultra (Muse Wonder Full) today! What excites me most is how much closer we’re getting to agents you can actually delegate work to. Personal agents that understand you and your life, and professional agents that can take on complex, long-running projects. 🍉 is designed for personal and professional agent use Pretty Wonder Full to see this come together just a year after starting the agent team at TBD Labs. Huge credit to the incredible team that made it happen!
2
24
1,293
Zhiqing Sun retweeted
Brought to you by the world’s best agents research team. Our team puts an unbelievable amount of love, care and taste into developing Muse models. Benchmark scores alone won’t even tell how awesome our models are. If in doubt, keep calm and muse on yourself.
We launched 🍉 (Muse Wonder) and 🍉 Ultra (Muse Wonder Full) today! What excites me most is how much closer we’re getting to agents you can actually delegate work to. Personal agents that understand you and your life, and professional agents that can take on complex, long-running projects. 🍉 is designed for personal and professional agent use Pretty Wonder Full to see this come together just a year after starting the agent team at TBD Labs. Huge credit to the incredible team that made it happen!
Made with AI
1
14
1,257
apparently visual coding is the social media meta 😅 3D demo PT sprint incoming
whole team feels dumb now, but it's true, we did not explicitly train our model on 3d demo games obviously in retrospect we probably should've done a bit of that... but no regrets, please try muse wonder on your actual coding work!
4
2
64
7,410
Zhiqing Sun retweeted
Some thoughts on the new Meta release today: - The models from MSL have improved quickly. They’re not just competing for Pareto optimal anymore, but driving for the frontier. - To me, the biggest unlock of these models is their token efficiency. They’re able to see significant performance increases while reasoning less and spending fewer tokens / turns. In Vibe Code Bench ,WF gets the same performance as MS 1.3 in half the number of steps. Smarter models think more efficiently. - Today, Muse Wonder Full is only available in in-app experiences (not via API). It may be that we see an even tighter coupling between models and first party applications. Or that this gating prevents nefarious actors from misusing the most capable intelligence. Not yet clear what the plan is. - MSL is making some serious progress on alignment. We’ll have more to share publicly here soon. Meta hasn’t been as vocal about safety, but to service Muse so widely they have needed to solve some fundamental alignment challenges. - Relatedly, we saw 0 refusals and Wonder did better than Wonder Full on our cyber capabilities benchmarks. This is itself very good! People should not expect their hard economically valuable work to be inhibited by these models. - The models have room for improvement on scientific discovery. They are strong executors, especially in code, but don’t have the intuition for which experiments to try. We’re still running our RSI Index, sharing results soon. If they aren’t able to maintain the frontier, this would be why. - META went up 3% today. I’ve said it before and I’ll say it again. As AI underpins a larger part of our economy, third party benchmarks will be the best value predictor of AI labs. The market for intelligence is rationalizing.
4
38
4,077