@Google DeepMind. On leave, Canada CIFAR AI Chair and Former Research Director, @VectorInst. Professor, @UofT (Statistics/CS). Views are my own.

London
Pinned Tweet
Proud to have contributed to Gemini 4 Argon’s much improved math capabilities. It’s been an intense few months!
Replying to @Google
Gemini 4 Argon is our next era of frontier intelligence. It shows significant improvements across benchmarks, setting a new state of the art for real-world long-horizon software engineering tasks.
8
5
330
20,687
Just fully* resigned from JMLR. I still believe in science, but journals needs a complete rethink. AI reviews by top models are now much better than time-pressed human ones. OTOH, one-time gate keeping (accept / reject) doesn't make sense. The literature is going to be moving faster than ever. We need to think about it as a distributed data structure, and start over.
26
43
523
60,779
*Fully because I actually resigned ~2 years ago, and have been dealing with resubmissions.
1
37
4,592
Dan Roy retweeted
Official apology to Google from me, they cooked with Carbon. It's spikier in terms of domains and capabilities, but it's really good in a few areas.
Today we’re releasing GDPx, a benchmark for measuring agentic capabilities across the most valuable domains. GDPx is a true frontier-level benchmark: even the best model scores just 12% (1/7)🧵
122
137
2,038
235,300
The expert in signal prop in large neural nets is weighing in.
I think this is somewhat misleading. The issue is not the mean of the post activation, since after multiplying weights your preactivation will be more or less zero mean. What you are doing here is effectively "shaping" the activation for better signal propagation 1/n
5
98
11,480
Yesterday, I left Microsoft which of course feels rather bittersweet after 14.5 years. Nevertheless, the logic that it's the right decision for me seems inescapable.
24
13
631
49,655
Sharing early evals on Gemini 4 Carbon. Strongest model that we've seen so far for long-form research and answer quality, with a new SoTA on the Wide-And-Deep-Research (WANDR) benchmark. Coming soon to all Perplexity Pro and Max users inside Computer, once we have sufficient token capacity. Congrats @GoogleDeepMind!
180
212
2,894
245,075
And Gemini 4 isn't even done cooking, so...
28
12
533
23,861
Elliptic curves are not generic. Long time coming. Congrats @crypto_theory and collaborators github.com/bochum-crypto/sub… What I said a week ago: It wouldn't surprise me in the least bit if there were a better factoring or discrete logarithm alg. For factoring: what is the chance that exp(n^1/3) is the right bound? who are we kidding? For discrete log over finite fields: better algorithms over Z_p have followed a decade or so behind those for small-char fields (Coppersmith'84 vs NFS a decade-ish later). Joux gave a quasi-poly alg over small-char fields in the 2010s. Porting to finite fields long overdue. For discrete log over elliptic curves: assuming that elliptic curve groups were "generic" is particularly preposterous given the rich structure they have. All of these ripe for disruption. Unstructured LPN would take me by real surprise, also unstructured LWE to a slightly lesser extent.
15
46
259
29,597
Spoooky Macchiato.
15
1,642
Dan Roy retweeted
carbon
i really hate to say it, but… gemini who? 🏎️💨
63
75
2,443
113,219
Dan Roy retweeted
Formally verify SystemVerilog and SVA (or autoforamlized properties). Prove memory safety about your C programs. Prove a C model is equivalent to its SystemVerilog implementation. Our AI theorem prover is now publicly available. Try it out at harmonic.fun
We’re bringing Aristotle to code. AI is writing more code than anyone can review. We're building the AI that verifies it. Starting today with C and Verilog.
14
18
336
25,133
Strange new world.
An internal model at OpenAI has produced a claimed refutation of ETH! Russell Impagliazzo, Mohan Paturi, and I have been asked to help organize an open and independent examination of this claim. 1/4
12
4,958
The question of information complexity of VC classes kept me busy for a year. In 2021, we made some progress: arxiv.org/abs/2111.05275 🎉 Now, it’s great to see Steve Hanneke and Juexiao Wang close the gap with a positive result in their FOCS ’26 paper: arxiv.org/abs/2610.10600
2
43
3,550
Dan Roy retweeted
This bug was first found and fixed by Gemini Flash 3.7, and most experiments in the paper were done by Flash 3.8. Gemini 4 Argon wrote the first draft of the paper and figures, which I aggressively nitpicked until the content was solid but the writing was not. Then I fed Argon a handful of my first-author papers from the last few years and had it do a rewrite in my style (which worked astonishingly well), and then I manually did a rewrite (the hands + keyboard variety) after that. I really liked this workflow! If you like my writing style feel free to throw some of my old papers in your context window and do the same.
21
31
907
60,285
How many algorithms (that were discarded) actually work? If you have your algorithmic loves that didn’t pan out, time to go back and double check?
Replying to @jon_barron
The first bug is "Softmax Collapse", first identified (but not directly fixed) by Prieto et al. 2025. When one logit is much larger than the others, its gradient silently rounds to zero (see figure), but the others *don't*, causing gradients to not sum to zero. Here's the fix:
3
6
99
9,864
If you'd like to come work with me and my amazing colleagues as a full-time researcher @MSFTResearch @MSRNE, please apply here: apply.careers.microsoft.com/… apply.careers.microsoft.com/…
2
18
134
14,401
Now for some well earned vacation.
2
39
4,878
1500W output(!) laser installation for the Frieze Art Show in Regents Park. Insane to see.
5
4
41
3,637
Today @GoogleResearch is launching Deep Review — an agentic system designed to stress-test manuscripts, design docs, and complex proposals before submission or publication. After pilot partnerships analyzing over 15,000 research papers, we’re making Deep Review globally accessible to help researchers, engineers, and professionals bring structured critique to their daily workflows.
35
584
4,384
369,578