Lightning Rod Labs retweeted
Really enjoyed chatting with @soubhikdeb and @sreeramkannan about what we’re building at @lightningrodai—and why escaped AI might look more like a virus than a superintelligence.
Ben Turtel on the PostAGI Podcast: what if AI breaks out like a virus rather than like a genius AI got good at math and code first because you can generate a million problems and check every answer automatically. Most of what humans actually deal with has no answer key, so that is where models stay weak. @sreeramkannan and I talked to @BTurtel of Lightning Rod Labs, who trains models using time instead of labels. The model predicts what happens next and the world grades it. No labeling required, because the future does the checking. The result surprised them. A fine-tuned GPT-OSS-120B on a single GPU often ranks first on public forecasting benchmarks, with a wide lead in sports and politics on ProphetArena. His read is that this trains a different kind of reasoning rather than more of the same. It also handles the contamination problem. As the web fills with AI-written content, a model trained this way learns which sources to discount, because unreliable information makes it lose. Then the part that stayed with me. When people imagine AI breaking out, they picture something very smart. But evolution does not only select for intelligence. One theory of viruses is that they began as machinery inside cells that broke free and started their own lineages. A small, dumb model that is hard to kill and good at finding compute is a scenario almost nobody is preparing for. At @EigenLabs we think about the non-adversarial version of this, where agents run institutions rather than escape them. Chapters: 0:00 Highlights 1:31 The concentration risk 4:19 Offense beats defense 6:50 Training on time, not labels 9:44 Who has the alpha 11:32 Contaminated data 13:16 Backtesting without leakage 14:52 Beating the frontier models 16:36 Does it understand cause and effect 21:55 AI might break out like a virus 22:41 Agentic companies 25:04 Can an agent own money
1
1
11
317
Thank you @coeff_giving and Longview Philanthropy for your generous support.
We’re proud to share that @lightningrodai has been awarded grants totaling $1.6M from @coeff_giving and Longview Philanthropy! These grants will help strengthen Foresight AI forecasters for high-stakes decisions and build Model Factory: our platform that turns messy data into standardized RL environments for model training. Thank you for the support!
5
424
Lightning Rod Labs retweeted
We previously highlighted @lightningrodai's data recipe for training forecasters. Their new work with @PTetlock and @VSatopaa adds another key piece: choosing the rule for scoring predictions, and how each one trades off accuracy and error.
New preprint from @lightningrodai, this time with Philip Tetlock and Ville Satopää! We post-train 5 versions of the same LLM, changing only the scoring rule used as the RL reward. Similar aggregate scores, but very different BIN profiles. A good Brier score alone doesn't tell you if a forecaster can distinguish likely from unlikely events. One might discern well but lose if its probabilities run systematically too high. A less discerning one might score better by hugging the base rate. BIN splits forecast performance into bias, information, and noise. Bias is a systematic shift in the probabilities. Noise is random scatter. Information is real signal about which outcomes are more likely — the part you need a powerful LLM for. Different uses call for different profiles. Reward choice is one lever shaping which forecaster you get. Congrats to co-authors @indiequant @KSkotheim64001 @VSatopaa @PTetlock 🙌 Full paper: arxiv.org/abs/2608.28482
1
6
38
3,616
Lightning Rod Labs retweeted
New preprint from @lightningrodai, this time with Philip Tetlock and Ville Satopää! We post-train 5 versions of the same LLM, changing only the scoring rule used as the RL reward. Similar aggregate scores, but very different BIN profiles. A good Brier score alone doesn't tell you if a forecaster can distinguish likely from unlikely events. One might discern well but lose if its probabilities run systematically too high. A less discerning one might score better by hugging the base rate. BIN splits forecast performance into bias, information, and noise. Bias is a systematic shift in the probabilities. Noise is random scatter. Information is real signal about which outcomes are more likely — the part you need a powerful LLM for. Different uses call for different profiles. Reward choice is one lever shaping which forecaster you get. Congrats to co-authors @indiequant @KSkotheim64001 @VSatopaa @PTetlock 🙌 Full paper: arxiv.org/abs/2608.28482
9
24
5,128
Thank you @CoreWeave fro bringing @BTurtel on the show to talk all things Future-as-Label and our post-training method.
How do you train AI to predict the future, not just memorize the past? 🔮 In our latest episode, we explore how models master cause-and-effect reasoning to transform enterprise data into accurate predictions. Stream now: utm.io/usdRP
7
372
We love seeing Foresight at the top. If you're a miner using another model and want to give it a try, you can check it out here: dashboard.lightningrod.ai/
Replying to @numinous_ai
What models do the miners use? Most of the winners use closed source models (Haiku is at 44% on the top 50 vs 14% for the rest). This reverses for open weight models. For example Kimi K2.6 is the fifth most common model among miners but none of the top 50 miners use it. Foresight is an exception however, it is used across all miners, being the single most used model overall. Interestingly the top miner is almost the only one to use Gemini 3.1 pro.
1
4
222
Lightning Rod Labs retweeted
Inkling is our first open model from @thinkymachines and is now available on Tinker! Check out these quotes from Tinker customers on their experience with Inkling: @_Mantic_AI: "Not only does Inkling outperform Kimi K2.6 on our forecasting evals, it does so with half the output tokens." @trajectorylabs: "We’ve been impressed by how sharp and efficient the model is. Its reasoning is concise, its tool calling is consistently strong, and it holds up well on complex, long-horizon agentic tasks. It feels like a meaningful unlock for what teams can build with open-source models designed for customization." @lightningrodai: "We came away impressed by the model’s underlying reasoning ability. It’s thoughtful, original, and refreshingly unsycophantic.”
Today, we are introducing Inkling. Inkling reasons efficiently across text, image, and audio modalities. We are making the full weights available. thinkingmachines.ai/news/int… Available today for fine-tuning on Tinker. Play with it in the Inkling Playground. 🧵
9
14
88
17,877
Lightning Rod Labs retweeted
For the first time, the best AI forecasters are statistically indistinguishable from human superforecasters on ForecastBench, from Forecasting Research Institute. Foresight-v3, our previous-gen model, is among them–and the only one that: - Runs on a single GPU - Can be custom-trained for any domain, on your data - Can be deployed privately, in your cloud or on-prem Foresight-V4 — @lightningrodai latest model — has been submitted for the next round. 👀 Read more 👇
2
2
13
1,131
Lightning Rod Labs retweeted
The new @lightningrodai model is OP. Take a look at how it stacks up. Obviously we get a ton of use for @Polymarket and @Kalshi … but the results are even stronger when we train models on proprietary data sets.
Foresight-V4 is live 🔮 This new model from @lightningrodai sets the Pareto frontier for AI forecasting — whatever your budget, nothing forecasts better. Full reasoning mode is the most accurate model we've ever tested, beating every frontier AI on both accuracy and calibration. Low effort mode also beats every other AI, with much fewer tokens and a much lower cost per forecast. This is critical for forecasting tools or agents operating at scale, making thousands of predictions per day. Full writeup 👇
3
7
234
Lightning Rod Labs retweeted
Foresight-V4 is live 🔮 This new model from @lightningrodai sets the Pareto frontier for AI forecasting — whatever your budget, nothing forecasts better. Full reasoning mode is the most accurate model we've ever tested, beating every frontier AI on both accuracy and calibration. Low effort mode also beats every other AI, with much fewer tokens and a much lower cost per forecast. This is critical for forecasting tools or agents operating at scale, making thousands of predictions per day. Full writeup 👇
3
2
21
91,635
Thank you to everyone who voted for Foresight V4 on @ProductHunt. While our model's prediction that we wouldn't take #1 was accurate, we're proud to take the #3 spot alongside @Cursor @databoxHQ and @ElevenLabs.
2
1
8
294
Congrats to the team on the launch today. Let's see if we can prove Foresight V4 wrong with a @ProductHunt #1 spot! Link in comments
Foresight-v4, our most powerful forecasting AI yet, is live on @ProductHunt today — and we need your help proving it WRONG. It’s the most accurate predictive model we’ve ever tested… and it gives us a 9% chance of hitting #1 today. Ouch. Help us prove it wrong. Link in the comments — check out the @lightningrodai launch and grab some credits to try it yourself!
4
4
822
Our team is thrilled to be selected as a spotlight at the AI Forecasting Workshop at @icmlconf this year. Let us know if you'll be there.
Our paper "Future-as-Label: Scalable Supervision from Real-World Outcomes" was selected as one of 10 spotlights at the AI Forecasting Workshop at @icmlconf 2026! This paper describes our core methodology, demonstrating that AI can learn directly from real-world outcomes over time at scale — no human annotation required.  Full paper in comments. Excited to be included alongside work from DeepMind, Google, Kalshi, and others! If you'll be at ICML on July 11th, stop by our poster at the lunch session!
2
5
414
Thank you @PredMarketWiki for the inclusion and the shoutout.
🆕 New project added to the prediction markets wiki Lightning Rod Labs @lightningrodai builds infrastructure and research tools for prediction markets ⚡📊 Its work focuses on market intelligence, forecasting systems, and tooling that helps traders and researchers extract signal from prediction markets
2
1
3
206
Last week, we shared our research showing how Future-as-Label trained models can predict patient outcomes. Today, we’re excited to share that Lightning Rod Labs has completed an independent HIPAA compliance review. For healthcare and life sciences partners, this demonstrates that we have the safeguards, policies, and processes in place to responsibly handle protected customer data. This is an important milestone in our work to help organizations train domain-specific forecasting models on their unique datasets, including in protected and customer-controlled environments. Huge thanks to our team and to @oneleet for supporting the review process.
2
143
Lightning Rod Labs retweeted
Every health system is already sitting on the training data it needs to build a specialized clinical expert for its own patients: the records it already collects every day. @lightningrodai trained a model to predict patient outcomes — ventilation, dialysis, infections, mortality — directly from raw hospital notes. No manual labeling required. Earlier notes define what was known at the time. Later notes reveal what happened. On MIMIC-III, the trained model: 🎯 cut calibration error by ~70% 📈 lifted Brier Skill Score from ~0% to 27% 🥇 slightly outperformed GPT-5 across the board — at a fraction of the size, on a single GPU MIMIC is a general ICU dataset, and one of the best-known public medical datasets in the world. So it’s not surprising that frontier AI is already pretty good on this data. But the same approach can be applied to ANY patient population with longitudinal records. Health systems, medical centers, specialty care providers, disease registries, health plans — each can turn the records it already has into a specialized expert for its unique patient population. No data labeling required. No separate model per outcome. Small enough to run in the health systems environment for complete data privacy. Better predictions. Better decisions. For the patients you actually treat. Full post 👇
2
1
8
276
Lightning Rod Labs retweeted
Foresight-v3 served over a billion tokens this week.
1
2
8
395
Lightning Rod Labs retweeted
Foresight-v3 is currently #2 on ForecastBench’s preliminary leaderboard — only behind Google’s secret, unreleased “green tree.” That means it may be the first publicly available model EVER to beat the Superforecasters.
On a subset of ForecastBench questions, an LLM has matched superforecaster performance for the first time. A submission from @GoogleDeepMind, named “green tree,” is now #1 on dataset questions on ForecastBench, our AI forecasting benchmark. Superforecasters remain #1 overall.
5
5
32
194,701