A clarification: “Intelligence Index” refers here to a weighted average of the following benchmarks: GDPval, SciCode, Tau3-Banking, AA-Omniscience-Public, IFBench, SO Quality, AA-LCR v1.1, GPQA Diamond, AA-Omniscience-Public (Non-Hallucination), Terminal-Bench v2.1, BrowseComp+, and DeepSearchQA (DSQA)
@ 30.
This is not the same as Artificial Analysis’s Intelligence Index.
We have renamed Intelligence Index to Model Quality, GDPval AA v2 to GDPval, and AA-Omniscience to AA-Omniscience-Public in our announcement blog post to avoid confusion.