CCO, @LightningRodAI ; collector of things. this is really me, I swear, I transferred my old account in an acquisition 10 years ago

Vancouver, British Columbia
Thank you @tinkerapi and @thinkymachines for the shoutout
We previously highlighted @lightningrodai's data recipe for training forecasters. Their new work with @PTetlock and @VSatopaa adds another key piece: choosing the rule for scoring predictions, and how each one trades off accuracy and error.
3
51
Agree the opp is just huge
Over the last few months at @river_ai_inc we’ve developed what we believe is the best system in the world for building your own internal custom models, driven by 10 years of experience training top models at DeepMind, OpenAI and xAI. In order to best support our customers, we’ve decided to do something radical: We also deploy our API on-prem on your compute cluster, and if you don’t have compute we will help you find it. Again and again we’ve seen that custom models designed for your own internal workflows outperform top frontier models on performance, at a fraction of the cost (1 percent or less). We’re just at the beginning of the custom model era, but its already clear that in the future more than 99% of LLM tokens will be generated on efficient custom models. The economics of it are just too powerful, and it’s far easier than people think once you have the right tools in place. The reason why small models will dominate is due to the physics of deep learning: A general model that can do everything needs more capacity and training it on the whole distribution of all tasks is more challenging, so the model will be larger and more expensive, and wont perform perfectly on every task. A small model trained on a targeted domain usually outperforms it.
1
57
Zack Johnson retweeted
Introducing Beam: a highly efficient agentic open model with 501B total parameters and 23B active. - Frontier reasoning efficiency - Advances the Western open frontier on coding & agentic tasks - Trained end-to-end from scratch Full weights release this month. Learn more about Beam: reflection.ai/beam
565
1,103
8,607
2,508,981
Zack Johnson retweeted
Random German lab appears from nowhere and drops SOTA open-weight model Beats Qwen, Mistral, Nematron models with similar active parameter count Trained from stratch
Small bird, fast wings, Kolibri is here. 78B parameters. 3.46B active. Up to 1M tokens of context. Built in Europe. Now the weights are yours. Run it on your own hardware, under Apache 2.0.
Community note
x.com/kimmonismus/st… It beats older generation models and already obsolete nemotron 3 super and mistral 4 small(not even 3.5 medium) and it beats Qwen 3.6 35B a3b(which is very small) not current gen Qwen 3.8 27B and flash next. And the benchmarks are selective, they do not demonstrate coding,etc
208
398
9,319
702,745
Zack Johnson retweeted
Fulcrum's training approach is brilliant: the base model already knows how to write, so both SFT and RL are tailored to the precise distinction between the default LLM voice and authors' voices. Smart customization can be both cheap and effective.
Say hello to Echo, the best writing model at style imitation. Echo beats frontier models at writing tasks ranging from fiction to technical explanations, despite costing less than $5K to train.
9
21
418
25,795
Zack Johnson retweeted
We previously highlighted @lightningrodai's data recipe for training forecasters. Their new work with @PTetlock and @VSatopaa adds another key piece: choosing the rule for scoring predictions, and how each one trades off accuracy and error.
New preprint from @lightningrodai, this time with Philip Tetlock and Ville Satopää! We post-train 5 versions of the same LLM, changing only the scoring rule used as the RL reward. Similar aggregate scores, but very different BIN profiles. A good Brier score alone doesn't tell you if a forecaster can distinguish likely from unlikely events. One might discern well but lose if its probabilities run systematically too high. A less discerning one might score better by hugging the base rate. BIN splits forecast performance into bias, information, and noise. Bias is a systematic shift in the probabilities. Noise is random scatter. Information is real signal about which outcomes are more likely — the part you need a powerful LLM for. Different uses call for different profiles. Reward choice is one lever shaping which forecaster you get. Congrats to co-authors @indiequant @KSkotheim64001 @VSatopaa @PTetlock 🙌 Full paper: arxiv.org/abs/2608.28482
1
6
38
3,620
Thank you @coeff_giving and Longview Philanthropy for supporting our mission. We're grateful for your support.
We’re proud to share that @lightningrodai has been awarded grants totaling $1.6M from @coeff_giving and Longview Philanthropy! These grants will help strengthen Foresight AI forecasters for high-stakes decisions and build Model Factory: our platform that turns messy data into standardized RL environments for model training. Thank you for the support!
3
41
Congrats to the @lightningrodai team on the latest preprint with @PTetlock and @VSatopaa. The implications for this on post-training fit-for-purpose models is pretty big...
New preprint from @lightningrodai, this time with Philip Tetlock and Ville Satopää! We post-train 5 versions of the same LLM, changing only the scoring rule used as the RL reward. Similar aggregate scores, but very different BIN profiles. A good Brier score alone doesn't tell you if a forecaster can distinguish likely from unlikely events. One might discern well but lose if its probabilities run systematically too high. A less discerning one might score better by hugging the base rate. BIN splits forecast performance into bias, information, and noise. Bias is a systematic shift in the probabilities. Noise is random scatter. Information is real signal about which outcomes are more likely — the part you need a powerful LLM for. Different uses call for different profiles. Reward choice is one lever shaping which forecaster you get. Congrats to co-authors @indiequant @KSkotheim64001 @VSatopaa @PTetlock 🙌 Full paper: arxiv.org/abs/2608.28482
3
41
We are 100% headed in this direction, and the cost to train models is going to be far lower than most people think
Now that the base open weights AI models are getting far better, and post training infra is becoming more mature and commercialized, there are going to be all new plays for companies that have large amounts of data to have their own models. Licensing data for external model training was previously the only play if you had a large corpus of information, but you can now reasonably go and train your own models as well without incurring the cost and complexity of competing with the labs on research. The general purpose frontier models will still have a leg up in broad areas due to the ability to handle the widest set of tasks, but you can absolutely see a future where we have far more models than today across every vertical and domain.
2
67
Putting a comforter in a duvet cover is my personal bar for AGI.
1
17
Zack Johnson retweeted
Great chatting with @CoreWeave about how @lightningrodai uses companies’ messy data to train domain-expert AI!
How do you train AI to predict the future, not just memorize the past? 🔮 In our latest episode, we explore how models master cause-and-effect reasoning to transform enterprise data into accurate predictions. Stream now: utm.io/usdRP
3
5
219
Love seeing @lightningrodai Foresight top the list
Replying to @numinous_ai
What models do the miners use? Most of the winners use closed source models (Haiku is at 44% on the top 50 vs 14% for the rest). This reverses for open weight models. For example Kimi K2.6 is the fifth most common model among miners but none of the top 50 miners use it. Foresight is an exception however, it is used across all miners, being the single most used model overall. Interestingly the top miner is almost the only one to use Gemini 3.1 pro.
1
26
Zack Johnson retweeted
What models do the miners use? Most of the winners use closed source models (Haiku is at 44% on the top 50 vs 14% for the rest). This reverses for open weight models. For example Kimi K2.6 is the fifth most common model among miners but none of the top 50 miners use it. Foresight is an exception however, it is used across all miners, being the single most used model overall. Interestingly the top miner is almost the only one to use Gemini 3.1 pro.
1
1
7
849
Zack Johnson retweeted
VC: "so tell us about your backgrounds." @JeffDean: "well I guess we created modern computing"
11
33
646
21,465
Zack Johnson retweeted
Inkling-Small is comparable to Inkling at a quarter the size. Weights are open, fine-tunable on Tinker today. Look forward to seeing what people make with it.
Today, we are releasing Inkling-Small. Inkling-Small achieves comparable performance to Inkling at a quarter of its size. It features 276B total parameters, 12B active. We are making the full weights available. thinkingmachines.ai/news/ink… Fine-tune it on Tinker today, or chat with it in text, image, and audio on Tinker Playground.
148
283
3,718
478,522
Zack Johnson retweeted
AI won’t create a permanent underclass. Socialism will. AI will be massively disruptive, and fears of job displacement are justified. We need to give every American a stake in the abundance it creates. But redistribution does not require socialism. We can protect people without freezing the economy in place. My latest 👇 bturtel.substack.com/p/ai-wo…
1
1
7
104
60% of the time it works all of the time
One pattern I find useful for working with LLMs is a nice long ramble session. Sometimes the LLM needs more bits to understand what you're trying to achieve, but you're too lazy to type them. In these cases I like to lean back, switch to /voice and just ramble for like 10 minutes, total mess, anything goes, full stream of consciousness. Sometimes I declare it up top, something like "switching to speech recognition sorry for any typos...". Sometimes I turn it into a small interview of a few turns. But I find that the LLMs are somehow very good at reconstructing long incoherent rambles and often their echo of your own tangle of thoughts comes out quite a bit cleaner than what you started with. The result is that you improve the mind meld and have to correct things less from that point on.
1
1
24
Zack Johnson retweeted
texting my gf like fable 5
141
208
8,486
696,938
What @lizwalton and the @chainguard_dev team is building couldn’t be more timely
Let's go! So important right now
1
37