10k (Potts model) designed sequences for 3 proteins with labels from growth-based assay.
16-38% of sequences functional even at low sequence identity. Makes for a great benchmark of zero-shot fitness prediction methods in their ability to rank diverse sequences.
Breaking News: Anthropic said it halted potential plots by scientists who used its A.I. models to do research that could have helped develop biological weapons. nyti.ms/3V3epAE
Great experiment and a great dataset: it shows that Claude can competently use the open-source tools that practitioners would use in a binder design campaign. but most of the magic is in the tools themselves and telling it which tools to use and how (the prompt)
Designing a binder is an easier process than designing a drug, but it’s a useful proxy. The typical success rate in the field today is between 10% and 15%.
Between 22% and 35% of Claude's designs bound successfully, depending on the setup. Some of its strongest designs bound several times more tightly than the best published de novo binder.
if I knew I was competing on behalf of Team Human against the AIs, I would have increased our compute budget by 50X to match the amount used by Claude. and optimised more for hits rather than aiming for an informative benchmark set. Blog post coming soon on those 15PGDH results
1 more thing, because I don't want to be taken out-of-context by the AI haters: I use Claude every day and I remember what it was like trying to get open-source software to run in the pre-agent era: it was hell. So I'm eternally grateful for how much these tools speed up science
Great experiment and a great dataset: it shows that Claude can competently use the open-source tools that practitioners would use in a binder design campaign. but most of the magic is in the tools themselves and telling it which tools to use and how (the prompt)
Designing a binder is an easier process than designing a drug, but it’s a useful proxy. The typical success rate in the field today is between 10% and 15%.
Between 22% and 35% of Claude's designs bound successfully, depending on the setup. Some of its strongest designs bound several times more tightly than the best published de novo binder.
Interesting that the ESMfold2 paper shows that it still needs MSAs to match the performance of the models that came out more than a year ago (AF3 & Protenix). Still great to see progress towards MSA-free structure prediction. [results on FoldBench monomer prediction]
Across other categories (Ab, PPI, ligand, DNA, RNA, peptide), results are mixed, with ESMF2 in single sequence mode beating the older models that use MSAs in some categories and not in others.
3/11
Not because it was always the goal, but because the incentives push them there.
And those incentives are hard to ignore.
Therapeutics dominate the biggest exits.
From 2009–2023, Pear VC analyzed the top 50 life sciences startups with exits >$2.7B:
92% therapeutics (46/50)
6% diagnostics (3/50)
2% tools companies (1/50)
We've been working on protein design with hallucination, and it turns out there's some nice optimisation theory behind this approach, beautifully explained by my colleague Magnus here:
magnusross.github.io/posts/r…
next insilico is next wednesday! 🧠💊💾🍳
speakers include: Ruxandra Teslo (Renaissance Philanthropy), Raina Thomas (Google DeepMind), Thomas Löhr (Bind Research), and Dominykas Lukauskis (Ternary Therapeutics)!!
hosted at Fifty Years HQ 🇬🇧
luma.com/2daur0ny
NEW: today OpenBind ‘comes out of stealth’ so to speak with their first data dump of ~900 novel protein-ligand structures - most with paired affinities
This represents a meaningful %-age increase in all of humanities P-L data in the PDB collected in the last 50 years
More👇