A lot of people use this chart to make the point that Astra is much more token efficient than opus 5.5
I can tell you this doesn’t translate well to real world uses
The benchmark only cares about a pass/fail standard, but that’s not what real work looks like, you have to consider if it’s done properly, if everything is clean, is it really done or done but leaves landmines for future work, stuff like that
When you take that into account, opus 5.5 is much more efficient, it does things properly from the beginning, it’s thorough, and it goes above and beyond to do what you want instead of just what you ask. So when opus 5.5 hands back a result, it’s in a much better shape, even tho technically both models have “finished” the task