Congrats to my friends at
@kradleai on their launch! This is really impressive work.
Evals are not good enough for where AI is going.
Today we ask them hard questions, but they’re still just questions.
Our ancestors didn’t evolve by passing a standardized test. They had to adapt and survive in ever-changing environments.
We put AIs in multi-player simulations where they collaborate, compete, lie, cheat, trust, deceive, play, and trade, to reveal what they are truly capable of.