Technologist, Scientist Co-founder and CEO @Convergent_FROs Tweets do not represent employers

Boston
Adam Marblestone retweeted
Progress in AI verification is picking up pace -- by the end of the year, I expect to see early government trials of verification tech. Yet we're still a small field with a lot of work to do. I went on @80000Hours to chat with Tom Reed about the technologies we need to verify international deals on AI. 80000hours.org/podcast/episo…
I interviewed @tsmilton_amodo about the tech we'd need to verify a potential US-China deal on AI. We discuss Amodo's prototype for inference verification, as well as the myriad ways you could use power monitoring, zero knowledge proofs and/or unilateral surveillance to understand how an adversary is using compute. Though solving some kind of verification is central to many people's theories of victory, there are precious few people working on it currently. Tom is one such person! Listen to the episode on Youtube, Spotify or Apple Podcasts. You can also find more about Tom and Amodo's work at ai-verification.com/ 00:00:00 Using compute verification for an AI slowdown 00:06:08 Proving a datacentre is only running inference 00:13:22 Reading a GPU's workload from its power draw 00:23:35 What would it take to get verification deal-ready? 00:37:49 How realistic is verification? 00:46:07 Preparing for a rushed US-China deal 01:07:20 How good is AI at hardware design?
1
7
34
1,817
Adam Marblestone retweeted
This is a big deal. For containing agents. Formal verification mathematically proves software behaves how it’s supposed to. More reliable than testing for bugs. I hear Ant is using Claude to formally verify policies and decide what agents can access through Nvidia OpenShell.
New on our Frontier Red Team blog: using Claude to formally verify software at large scale. Formal verification can prove that code is free of certain bugs, but historically it has only been feasible for small codebases (or required a lot of expert time). With AI models, however, this is beginning to change. In collaboration with @theoremlabs, we used Claude to prove security properties in over one hundred real-world open-source libraries over the span of a few weeks. Read our research in full here: anthropic.com/research/forma…
1
3
22
1,565
Adam Marblestone retweeted
New on our Frontier Red Team blog: using Claude to formally verify software at large scale. Formal verification can prove that code is free of certain bugs, but historically it has only been feasible for small codebases (or required a lot of expert time). With AI models, however, this is beginning to change. In collaboration with @theoremlabs, we used Claude to prove security properties in over one hundred real-world open-source libraries over the span of a few weeks. Read our research in full here: anthropic.com/research/forma…
636
1,054
9,642
1,976,756
Adam Marblestone retweeted
Check out our new model for creating realistic motion in a virtual rat during RL! I think of this as providing the "brainstem and spinal cord" for NeuroAI researchers who want to simulate realistic neuroscience experiments. Congrats to @aidan_sirbu for getting this out!
1/14) Virtual animals are a long-standing goal in neuro-AI, but they should actually behave like real animals. We present SCAMPER: a virtual rat for RL studies that moves naturally during both exploration, and goal-directed behavior. Project page: aidansirbu.com/SCAMPER-site/
3
9
70
6,203
Adam Marblestone retweeted
Ever needed to know what proteins are actually present on the surface of what cells? Wondered where to look? The @deliverome team has put together an open atlas of the accessible human surfaceome. Interactive viewer, publication and code below 👇
Five major databases of human surface proteins agree on only 188 of them. So we had Claude read the literature instead. Today @deliverome is releasing an open atlas of the accessible human surfaceome, with claims traced directly to quotes from their source 🎯
6
27
2,934
Adam Marblestone retweeted
Dad! I'm in the Economist!
4
3
62
1,897
Adam Marblestone retweeted
“Cellular scaling laws in the mammalian brain” by Fei Chen & Evan Macosko is out in Cell! It dovetails with many of the neuro ideas I’m always pushing, but in the context of transcriptomics and psych. Thanks Fei & Evan for lots of great conversations while they were working on this! @insitubiology cell.com/cell/fulltext/S0092…
2
14
122
10,819
Adam Marblestone retweeted
Big if true
Protein immunogenicity is a major driver of drug failure in the clinic, a problem especially important in the age of generative AI when we can design de novo medicines with desired function. Meet 🐐MESSI: a generative method for deimmunizing proteins with discrete diffusion. We reduce predicted MHC-II epitopes and experimentally validate retained or improved function in luciferases, PD-1 binders and uricases—an enzyme family used in FDA-approved therapies.💊 Watch the story below: 1/n 🧵
2
6
47
5,900
Adam Marblestone retweeted
A major step towards organ cryopreservation! 🧊 A new preprint reports functional recovery of human-scale pig kidneys after vitrification and storage at −150°C for up to a year. The kidneys showed vascular, metabolic and excretory function, and produced urine after transplantation. Huge progress towards making organ banking (and ultimately human biostasis) a reality! 🚀
Functional recovery of vitrified and nanowarmed human-scale pig kidneys biorxiv.org/content/10.64898…
10
35
231
28,389
Adam Marblestone retweeted
1/ We discovered something totally unexpected about the neural structure of consciousness that overturns decades of thinking on its biological basis and brings us significantly closer to the recipe for generating conscious awareness. New preprint: biorxiv.org/content/10.64898… (led by @HesseJanis, with @FrankLanfranchi, @_conor_mcgrory, @Yuelin_Shi, and @EngelTatiana)
388
1,691
11,313
2,173,269
🇬🇧
What would it take to fund ambitious science beyond the lab or startup? This autumn, we’re bringing people across the UK together to explore new models, including Focused Research Organizations (FROs). No prior knowledge needed. Join us, and bring a curious friend.
1
19
1,628
Adam Marblestone retweeted
🧮Really excited about this work by colleagues at @BasisOrg about formal verification of software 🧮
For a while now, @kirancodes has been excitedly telling everyone at @BasisOrg who would listen about a crazy idea she's been pursuing. Not everyone thought it was possible, but it's starting to work. See basis.ai/blog/ship-your-inte… TL;DR: The bottleneck in verifying the world's software is shifting from theorem proving to specifications and semantics. We now have a way to verify semantics that can scale across all programming languages. The basic idea: To verify that a program is correct, you need the program, a specification you want to prove, and a semantics that defines what programs and specs mean. Most programming languages (Python, Ruby, Lua…) have no formal semantics, because semantics are painful to write for complex languages. You can ask an LLM to write a semantics for you, but it'll probably have mistakes. But (i) programming languages do have interpreters/compilers, which ultimately are compiled down to machine code, and (ii) some instruction sets do have formal semantics. RISC-V has an official formal model. So, crazy idea: Step 1: Compile your interpreter (e.g. Python's) down to RISC-V. Now its behaviour is formally defined. It's exact, but unreadable: thousands of machine instructions. Step 2: Ask your LLM to write a semantics for your language. Step 3: Ask the LLM to prove, in @leanprover, that its semantics agrees with the compiled interpreter on every possible program. If the semantics is wrong, the proof gets stuck, and the LLM goes back to fix it. Step 4: If the proof goes through, you have a semantics you don't need to trust, and you can verify programs in a language that never had one, with guarantees that reach the binary that actually runs. Kiran has now done this end to end for a simple WHILE language, and we're scaling it up to Lua and OCaml, with Python as the north star.
1
2
509
Adam Marblestone retweeted
The back of the Navier-Stokes milestone shirt is the last line of the chain-of-thought from the solution:
840
484
11,023
1,027,424
Adam Marblestone retweeted
Exciting to see the momentum that @eric_is_weird and @janellehmtam have built. Incubating this work was one of the earliest bets we made @RenPhilanthropy.
I'm looking for technical scouts to find the world's best researchers whose dreams don't fit into academic lab- or venture capital-shaped boxes It is, first and foremost, an ideas job. Flexible on work arrangement. Technical vision must be first-rate. freaktakes.com/p/help-wanted…
1
5
40
3,527
Adam Marblestone retweeted
Leo the first proof assistant dev to be invited to the white house???? damn plbros we're really moving up in life huh? makes me tear up a lil
6
9
69
7,374
Adam Marblestone retweeted
.@AGamick repping FROs at Science: A New Golden Age summit! 🎉
“The @NSF is an engine of scientific discovery and innovation. It is an envy of the world.” @banksianr
1
1
14
1,054
Adam Marblestone retweeted
Longterm high quality performance of a BCI. Not glamorous. But essential. Great to read this!
Performance or longevity. For years, it seemed like the field of BCI would have to choose between the two. Our accumulating preclinical data suggests otherwise: four years of stable neural recording and decoding in large animal models, with steady spike SNR and no electrode array migration. Read the full announcement here: paradromics.com/news/paradro…
6
10
2,509
Adam Marblestone retweeted
Grateful for the founding partners of the NSF X-Labs Consortium! Together, @AsteraInstitute; @ginkgo; Tom Secunda at the @secundafund, @SloanFoundation, and other national philanthropic partners; and @MattCimaglia with @OccamFoundry and the @FLQuantumCenter will help NSF X-Labs launch a new generation of independent research organizations accelerating the pace of scientific discovery. nsf.gov/news/nsf-lays-founda…
4
35
101
22,884
Adam Marblestone retweeted
FRO mafia coming in hot @Ben_Reinhardt @AGamick
2
2
18
1,609
Adam Marblestone retweeted
Figma CEO @zoink on what the world could look like in 2036: "It's 2036. I think we'll have 10K logical qubit quantum computers. We'll have a Mars colony, or the start of one. We'll have BCI working, we'll have a human connectome." "The way we experience the world will feel very similar. And if you choose to experience the world very differently, it could also be very different, but that's opt-in." @figma
3
2
62
16,659