I build sane open-source RL tools. MIT PhD, creator of Neural MMO and founder of PufferAI. DM for business: non-LLM sim engineering, RL R&D, infra & support.

Releasing PufferLib 5.0: Train agents in under a second
47
156
1,839
172,278
Joseph Suarez 🐑 retweeted
🚁 HyperDrone: Drone simulator at >10M FPS ⚑️ HyperLux: Massively parallel ray tracing for RL πŸ”Œ Any GPU: Nvidia, Apple Metal, Vulkan, WebGPU 🦾 Sim2Real transfer of an RGB policy βœ… Accepted at CoRL 2026 Check it out: pip install hyperdrone Links πŸ‘‡
10
13
159
6,548
The issue with AI is the people, not the tech. Devs have devoted their lives to a craft. Instead of focusing on how new tools can help them achieve the previously impossible, we have huge swaths of people who have never accomplished anything frothing at the mouth at the prospect of obsoleting people better than them. Directly spurred on by the execs of top "labs" marketing to the lowest of men.
The games we've long wanted, which didn't exist because they'd cost several times more to make than they'd earn back, will soon become possible. As will the games developers wanted to build, but couldn't with the resources available. It'll be a new golden age of gaming.
35
71
901
31,581
As with usual on X, a heck of a lot of people seem mad about something I didn't write! @grok kindly explain the difference between what's actually in this post and how the comments have "read" it
2
13
1,197
My last post on this was serious. It would be awesome to send on release with a group of researchers. I know a disproportionate number of you are end-game OSRS players. Reply below!
Only 4 Days until The Fractured Archive is out! πŸ‘€ Mods Ayiza and Kieren will be hosting a Watch Party live on Twitch so you can keep up with the progress as we watch to see who will be among the first to clear the raid! πŸ“Ί πŸ”— Check out the blog for more details: osrs.game/TFA-Need-To-Know
1
17
2,385
RLed the roadster with PufferLib
26
47
1,114
40,839
Joseph Suarez 🐑 retweeted
Hey! **raylib 6.2** is out! πŸ”₯ It was supposed to be a small patch version but it comes with +300 improvements from +100 new contributors! πŸš€ Release notes: github.com/raysan5/raylib/re… Windows Installer: raysan5.itch.io/raylib
21
58
753
13,411
PufferLib's RL Agents beat the Inferno and Colosseum, but how fast can their developers conquer The Fractured Archive? Raids with researchers starts on release, and you can join. Coordinate on our discord.gg/puffer.
2
45
4,606
Anyone following my work for a long time will know what a huge influence OSRS has had on NMMO and PufferLib, but this is mostly for fun. We may decide to RL some of the bosses (in sim, not live game) later if they are mechanically interesting enough.
1
14
1,398
Looking for reasonably experienced players for the first few hours (~inferno + quiver and a mega, or more exp less gear). Will open it up more casually depending on how hard it ends up being thereafter. All drops split.
10
781
Joseph Suarez 🐑 retweeted
In our Nature paper, we introduce the first superhuman Stratego AI, which we built using general techniques that we developed for RL & test-time compute under imperfect information. 1/N
43
188
1,420
287,201
If you're using raylib professionally, get your company to pitch in a couple hundred bucks a month. Or do it yourself.
How is it possible to get that level of open source support while many other projects like raylib struggle to get enough finance to even pay a developer minimal salary? I don't know... 😞
1
2
89
8,393
Two tasks, ~30 minute and ~90 minute horizon respectively. Typically completed by the top 1-3% of players after 10's of hours of attempts. These results changed my understanding of what PufferLib is capable of doing!
1
4
116
8,333
Note: we do NOT run any of this on the live game servers! It's all sim. OSRS is my favorite game and I hate seeing the econ + major account achievements ruined by botting
16
944
>Double RL SOTA w/ a very vanilla setup. Probably the first major point of comparison to existing lit for PufferLib! I consider this saturated without tweaking the enchant system. The current impl doesn't really fit an RL benchmark.
2
54
6,195
Joseph Suarez 🐑 retweeted
i'd like to keep it low key and say this is no big deal, but in reality this has to be the coolest project i've worked on maybe ever, and there's a lot more to come!
Article

Old School RuneScape in PufferLib 5.0

banner image: final boss enraged, with ~unavoidable damage pummeling the player, while trying to stay behind a moving shield In Old School RuneScape a game tick has happened every 600 milliseconds

10
10
81
15,236