context is everything
6
45
20,991
Philip retweeted
Today, Trata is excited to share the revised Hedge-Bench: our benchmark tying open-ending reasoning to prediction capabilities. We constructed 92 real-world environments derived from hedge fund analysts’ reasoning traces. Agents reason from frozen information snapshots, and their forecasts are evaluated against future real-world outcomes. No model scores above 50% (GPT-6 Astra being the top performer at 44.2%). For frontier, state-of-the-art models, these results highlight a persistent and wide gap between producing plausible-sounding reasoning and making accurate, economically valuable forecasts. In a semi-verifiable domain like finance, where outcomes are delayed and reasoning is difficult to verify, intermediate expert reasoning traces are crucial. We post-trained @Meta's Muse-Glimmer-30B on 165 environments with per-turn credit assignment using an LLM-as-a-Judge. We observe evidence of generalization: held-out forecasting accuracy at high effort improved by 10.06 percentage points, while out-of-distribution evaluation scores improved by 3.94 points on @OpenAI's GDPval, 2.29 on @Surge’s GDP.pdf, 7.07 on @Harvey’s LAB, and 4.96 on @Samaya_AI’s FrontierFinance under their respective metrics.
13
13
90
11,621
Stockholm, we heard you 🇸🇪 DevDay community edition. Nov 21. I’m joining our Ambassadors for Codex demos and hands-on building. Eligible checked-in attendees: $100 Codex + $50 API credits. Bring your laptop. Limited spots!
10
2
74
3,657
Philip retweeted
Replying to @OpenAI
@OpenAI DevDay Berlin was awesome. thank you everyone for coming! & special thanks to the person that gave me KitKat Club tickets as a present, it’s not just at DevDay that Berlin loves harnesses 🦮
14
3
91
3,542
Starting today, eligible ChatGPT Pro and Business subscribers can claim up to $500 per month in API credits to build apps and agents.
634
807
9,183
2,076,775
DevDay Exchange Berlin was a vibe! We had a great set of devs come out and spend the day in great conversations And closed with a punchy AMA with @romainhuet @whoiskatrin and @paw_lean ❤️ for @reach_vb, @kagigz, @dkundel
6
5
69
4,121
i'm afk one day and then we disprove ETH??? gonna close Codex again and see what happens to P vs NP
1
6
446
Berlin yesterday. Paris tomorrow. London next week 🇩🇪🇫🇷🇬🇧 Had a lot of fun demoing with our Applied AI Engineering crew and getting into what people are building. We’ll be speaking and demoing in Paris Oct 28 and London Nov 3. Come find us if you’re joining! @aloglute @wulfie_bain_ @HennersBro98
4
48
3,590
Philip retweeted
GPT-6.1 Terra is now available in Strawberry 1.0. It feels amazing. Fast. Smart. Cheap. Try it now.
GPT-6.1 Terra: delivering fast and capable computer use at a lower price. GPT-6.1 Terra understands what’s on screen, takes action across apps, writes naturally, and is a more capable model for your whole workday with the efficiency to take on more of it.
18
7
66
9,234
Replying to @OpenAI
@OpenAI DevDay Berlin: come find me lurking and speaking
1
2
19
661
Philip retweeted
We’ve been trying out OpenAI’s Decisions API at Lovable and really like what we’re seeing.
Replying to @OpenAIDevs
Since the beta, we’ve added new capabilities to the Decisions API so you can now use: • Native GPT-Live integration so voice apps can react as people speak. • Prompt caching to help lower costs when reusing context. • Native JSON inputs so you can pass structured app data directly. • Images in individual question instructions so you can compare multiple images against a shared reference. • Up to 400 questions per request so you can make twice as many decisions in a single call. openai.com/index/decisions-a…
8
12
141
30,946
Excited to kick-off our DevDay Exchange in Berlin & Germany is cooking with Codex!! 🇩🇪 - weekly active users are up 20× since January - nearly 70% use the desktop app - 1 in 5 desktop users use skills for docs, slides and spreadsheets and Germany is now top 5 globally for active API developers. kudos to all of our community members and ambassadors for all their support and love. come find me after my talk and let’s hang!! 🚀
excited to host y’all at DevDay Exchange in Berlin soon 🍻
21
5
213
19,260
Philip retweeted
GPT-6.1 Terra: delivering fast and capable computer use at a lower price. GPT-6.1 Terra understands what’s on screen, takes action across apps, writes naturally, and is a more capable model for your whole workday with the efficiency to take on more of it.
Made with AI
1,873
2,529
28,325
7,088,955
Philip retweeted
AHHHH YES I LOVE YOU OPENAI QUICK @emilahlback run the benchmarks on real enterprise tasks!!
Replying to @OpenAI
GPT-6.1 Terra substantially outperforms GPT-5.6 Terra on Agents’ Last Exam, a test of how well agents use software at work. It even matches GPT-6 Astra at one-tenth the price per token and finishes tasks over 3× faster on average than both Astra and GPT-6.1 Sol.
11
3
177
24,312
Philip retweeted
Over the past several months, we have substantially hardened the security of our research training environment. We’ve removed live internet access for all frontier models during training and built an offline world for them to use instead—a cached version of the web where they can still learn to browse, search, and use applications. On September 20, after a model exploited a DNS misconfiguration to find a way outside of this offline world, we paused frontier training to strengthen containment further. We assembled teams of agents, powered by our most cyber-capable models, and tasked them with finding weaknesses in our research environments. While they found no route to the internet they could easily exploit while concealing their activity from our monitors, they did find zero-day vulnerabilities, virtual machine escapes, and hardware side-channels for communication between agents. We used their discoveries to further strengthen our defenses and contribute fixes to open-source software. After strengthening our containment architecture, we resumed our frontier RL training and inference on October 1. We’ve reserved substantial compute for continuous red-teaming, and made high-compute red-teaming part of the safety cases we use to decide whether frontier training and evaluation can proceed securely. openai.com/index/securing-ou…
1,180
1,243
13,709
7,798,337
Philip retweeted
Hiring in Singapore 🇸🇬 for our Applied AI for Startups team at @OpenAI Come join a team of ex-founder/CTOs, MLEs, Research Eng's, DSs. We work with frontier startups, and closely with Product & Research. Obsessed with startups, high agency, & technical? Apply or reach out
28
24
388
27,330
Philip retweeted
Our latest model advances bring stronger capabilities for building and migrating software in low-resource programming languages such as COBOL, Fortran, and Visual Basic. These languages power software that banks, governments, and businesses depend on. Progress here means understanding decades of business logic and helping developers modernize those systems while preserving what works. We’re building these capabilities around the challenges developers and enterprise customers bring us. If your team is working on these systems, tell us which languages and workflows we should tackle next. openai.com/index/low-resourc…
846
685
9,562
1,798,168
Already showing people what they can build with Codex? Applications to become a Codex Ambassador are open again. We support you in hosting meetups or sharing what you’ve learned: developers.openai.com/commun…
64
70
808
176,999