General Compute CTO
@GoodisonJason explains why GPT-4 conditioned us to believe slower AI means smarter AI, and why he'd now choose speed over intelligence:
"Generation speed used to be a proxy for how smart the model was. GPT-3.5 Turbo was really fast, and then GPT-4 was really slow. I was okay to have it be slow because I at least had this proxy of, that’s a smart model."
"Now open source models are catching up to the frontier. Many tasks don’t need the frontier anymore. So now you’re gonna start seeing people demand speed."
"Even if the response was slightly worse, I would rather the fast information, because I know it already has sufficient intelligence to get the task done."
@general_compute