Cofounder/CEO @theworldlabs, Prof (CS @Stanford), Co-Director @StanfordHAI, #AI #SpatialIntelligence #GenAI #computervision #robotics #AI-healthcare
Stanford, CA, U.S.A.
- Tweets 3,123
- Following 1,197
- Followers 1,094,863
- Likes 7,883
Fei-Fei Li retweeted
Atlas beta access has started rolling out!
Here’s a look at how you can control camera paths with pixel-perfect precision.
23
59
368
27,628
Every one of my mathematician friend sees beauty in the numbers, shapes and the natural phenomena they work with. Who defines beauty in the age of machines?🤔
237
106
1,455
137,474
Fei-Fei Li retweeted
Experimenting with Chisel in Atlas beta. We’ve been rolling out beta access to a bunch of users and it’s been really cool seeing what people are building.
14
10
75
17,204
So excited to welcome @theworldlabs and @drfeifei to the @AMD family! I’ve always been a huge fan of Fei-Fei and her pioneering research in AI. Together, we’ll combine World Labs’ deep expertise in AI and world models with AMD’s compute leadership to power the future of AI and strengthen the open AI ecosystem. Can’t wait for all we’ll accomplish!
210
502
5,291
776,895
The goal of building any technology, AI included, should be bettering human lives and society.
“Any threat to human society, including existential, is within ourselves,” says World Labs Technologies CEO Fei-Fei Li as she discusses the risks surrounding AI, and the responsibility humans have in shaping how the technology is developed and used.
Listen to our full interview here: bloom.bg/3V74HgP
94
170
1,145
159,148
Agents can be AI, but agency is human. It is every individual’s responsibility to empower our own agency, with the help of tools. But the North Star should always remain human centered.
195
384
2,437
185,943
What happens when you give a world model 32 images of a place we know very well?
World Labs put Atlas to the test on Voyager.
Atlas brings text, images, video, and 3D into a shared spatial context, enabling one model to generate new views, reconstruct scenes, and simulate worlds. With Voyager, you can now see that in action in real time.
Pretrained from scratch on NVIDIA Blackwell GPUs. Take a look around 👇
From 32 input images to real-time flight through @nvidia's Voyager headquarters.
Trained on NVIDIA Blackwell GPUs, Atlas uses these images as 3D spatial context to generate new views, letting you explore with pixel-perfect camera control.
Take a look around.
31
43
293
56,079
Fei-Fei Li retweeted
From 32 input images to real-time flight through @nvidia's Voyager headquarters.
Trained on NVIDIA Blackwell GPUs, Atlas uses these images as 3D spatial context to generate new views, letting you explore with pixel-perfect camera control.
Take a look around.
55
79
494
233,247
Fei-Fei Li retweeted
Atlas beta access is rolling out to users, some ideas for API developers
- give Astra "eyes" in Blender, let it place and render new camera views with Atlas
- 3D reconstruction (this video uses 9 image inputs of my studio to make a scene, any Zillow apartment works)
- graybox-to-world, use depth inputs and generate multi-view renders of a scene
20
53
600
47,001
Incredible opportunity for robotic learning researchers/engineers to join @theworldlabs! ❤️🔥
We're hiring in robot learning at @theworldlabs! Join me, @drfeifei, and the team to define and scale the next generation of world models for robot learning!
Atlas for Robotics: worldlabs.ai/blog/atlas#robo…
Real-to-Sim-to-Real: worldlabs.ai/blog/real-to-si…
Apply: jobs.ashbyhq.com/worldlabs/8…
33
75
844
149,035
Fei-Fei Li retweeted
SparkJS 2.2.0 is out packing tons of bug fixes an improvements. Enjoy!
🎉 🥳
20% faster splat sorting, 14% FPS gains in some systems, 50% smaller bundle size and more.
Dive into the full detailed change log github.com/sparkjsdev/spark/…
7
36
14,071
Fei-Fei Li retweeted
University leaders should make sure they reason about the broader trend.
Around 2020, Fei-Fei and others at Stanford identified the growing compute divide between industry and academia, and the need for policy response in pushing for the National Research Cloud.
In 2021, the same point was made when applied to model training in the foundation models paper.
In 2022, the same point was made when applied to model evaluation in HELM among other works.
In 2026, the same point was made when applied to model use. OpenAI spent more than $6.5 million to resolve Navier Stokes (Astra prices for 130B output tokens only).
The stakes are not just the academic computer scientists doing frontier research on how to build AI models. The stakes are about the whole university system doing frontier research.
Coping with "scarcity is the mother of invention" won't cut it, and we should trust the "godmother of AI" on that.
The world of R&D is forking into two paths: the token-abundant research, and the token-starved research. The future is in the former - evidentially, the progress by today's top AI industry teams and neolabs is breathtaking, where researchers’ human brilliance is super charged by AI’s assistance. Every research university president should be reading this report and reflecting on what the future of higher education research should be.
openai.com/index/research-ac…
4
8
95
34,254
The world of R&D is forking into two paths: the token-abundant research, and the token-starved research. The future is in the former - evidentially, the progress by today's top AI industry teams and neolabs is breathtaking, where researchers’ human brilliance is super charged by AI’s assistance. Every research university president should be reading this report and reflecting on what the future of higher education research should be.
openai.com/index/research-ac…
83
410
2,623
335,288
Fei-Fei Li retweeted
Real time streaming of next view prediction model that has accurate camera positioning and is 3D consistent. Unbelievable.
4
8
121
31,907
Fei-Fei Li retweeted
For those who remember @theworldlabs original RTFM demo: Atlas allows us to break out of these small spaces.
Here I took the kids playroom and using Atlas-turbo prompted a new outside area into existence.
RTFM, a new generative interactive world model by World Labs, generates real-time video from a single image for exploring 3D worlds.
Trained on large-scale video data to predict the next frame. Achieves unbounded persistence via spatial memory.
try it: rtfm.worldlabs.ai
2
4
49
18,686
Fei-Fei Li retweeted
Our new Atlas model now runs real-time after some intense inference optimization! Generating and navigating worlds is so much more visceral when it's interactive.
Inference runs on both B200 and MI355X with similar performance. Both devices are incredible workhorses!
6
13
151
27,379
World Labs co-founders Justin Johnson and Dr. Fei-Fei Li say LLMs use next-token prediction, but spatial intelligence has its own equivalent:
Justin: "The soft definition of AI-completeness is there's this fundamental primitive that's an AI task. But if I could solve this AI task in its full, broadest generality, it would solve any intelligence problem."
"The classic example in LLMs is that next-token prediction is AI-complete... I think from Ilya: there's a mystery novel, the thing has to read the whole novel, and the final sentence is, 'And the killer was.' Predict the next token. You could basically frame any kind of intelligence task in terms of that."
"So clearly next-token prediction is something people believe is AI-complete."
"New-view prediction, this primitive that we have in Atlas, especially generative new-view prediction, is also AI-complete."
"I want to have a world where Martin is writing a proof of the Riemann hypothesis on the blackboard, and then the camera pans over to the next whiteboard."
Fei-Fei: "Evolution had to solve new-viewpoint prediction by making animals move. Nature gave animals eyes, but nature didn't give trees eyes. Why? Because when you move, you see a new viewpoint... We do believe very strongly that next-viewpoint prediction is the equivalent of next-token prediction."
@jcjohnss @drfeifei @martin_casado
World Labs co-founders Fei-Fei Li, Justin Johnson, Ben Mildenhall, and a16z's Martin Casado on Atlas, a world model for spatial intelligence:
LLMs are built on next token prediction. Video models are built on next frame prediction. Atlas is built on new view prediction, and it's the first model to unify pixel generation and pixel reconstruction, two problems computer vision has kept in separate tracks for half a century.
The practical result is a 50 to 100x reduction in what it takes to digitally capture a 3D representation of a space. Previously, you needed 100 to 300 photos of a single room. Atlas can work from just three.
In this conversation, they get into the slow motion shot from The Matrix that took hundreds of cameras and now takes three iPhones, the overnight Slack message that made them bet the company in five seconds, why robotics is bottlenecked on data rather than chips, and the case that new view prediction is AI-complete.
00:00 Intro
01:50 The Matrix slow motion scene now takes three iPhones
02:48 Why new view prediction is the primitive
07:10 Unifying generation and reconstruction
11:15 Gaussian splats became the bottleneck
14:17 Dense capture used to mean 300 photos
17:30 Why reconstruction needs generation to fill the gaps
18:44 The LLM lesson image models missed
23:39 The video that made them go all in
28:04 3D design is 95% revisions
30:50 The problem in robotics is data, not chips
32:48 Why a robot policy can't be trained like an image model
34:44 When the simulator becomes the planner
36:45 Frozen time required footage full of movement
40:57 Why new view prediction is AI-complete
42:43 Nature gave animals eyes but not trees
YouTube: piped.video/watch?v=qn1QDDBn…
@drfeifei @jcjohnss @BenMildenhall @theworldlabs @martin_casado
24
37
350
89,022