"Reframing problems instead of stubbornly hacking through them" --> the inability to do this seems to be a genuine pitfall of current models.
"opus-5.5 is a coding superintelligence on par with world class experts and bad code is a user's skill issue at this point" is an increasingly popular take being echoed around. so, what are we still doing here?
i've been coding through various robotics ML projects for the past ~3 years. everything ranging from throwaway r&d codebases during early conceptualization to stable and optimized codebases during later productionization. i'm by admittedly by no means a "world class expert" in coding, and since gpt-4 was released just as i was getting interned in what is my first full-time engineering job, i've consistently leveraged the capabilities of these models and evolved alongside them every step of the way from the humble days of gpt-4 to the undeniably cracked opus-5.5 and on.
now the interesting question that comes to mind is that since i was born too late to independently develop deep practical expertise in any engineering subfield that i can then capitalize on to confidently supervise and steer those models, what do i even contribute to any of my AI-assisted projects? am i really just a middle-manager between upstream management and downstream coding agents? well, i don't think so, or at least not yet.
while modern agents definitely don't lack engineering know-how and a versatile technical skillset, i've always found, and do continue to find, that they do lack the kinds of natural commonsense that we humans take for granted. models remain unbelievably shortsighted, inefficient, and autistically oblivious to various unverbalized expectations around outcomes. despite superhuman coding skills, even the legendary opus-5.5 finds it impossible to hold back from diving head-on into unsustainably hacky solutions, paranoid defensive coding patterns, confused design choices with utter disregard to obvious long-term trade-offs, and above all, painfully bad taste decisions around high-level project directions. i am yet to take my hands off the steering wheel and not find myself frustratingly interrupting to re-steer soon after.
the thing about this particular set of cognitive blindspots and shortcomings that i find especially unique is how orthogonal they seem to be relative to all other predictable improvements in capability. since the early days of gpt-4, i don't find it to be the case that models have improved much on minimalism-by-default, on reframing problems instead of stubbornly hacking through them, or on effectively leveraging theory of mind to satisfy general expectations in regards to writing style be it code, documentation, or anything involving external readers. the degree to which i find myself putting in constant effort to verbalize obvious human intuitions into explicit and persistent notes and skills to auto-steer agents away from their alien (not the intelligent kind) basins leaves me disillusioned with their independent judgement to this day.
i think our reward functions are incentivizing the wrong priorities when attempting long-running agentic work. i think our modeling algorithms are failing to reliably internalize fundamental human biases, such as the deep desire for efficiency in all aspects of life (aka "working smarter, not harder"). i think the capacity to generate beautiful original ideas and reason about next steps at a high level remains largely underoptimized across the current frontier. i think we don't yet have AGI in the sense that we can expect from it the basic level of sane, well-calibrated intuitions we'd expect from a competent junior engineer, let alone a senior domain expert, despite obviously superhuman technical knowledge and skills.
tl;dr: don't leave the driver's seat just yet. impressive lane assist and auto-parking is where we're currently at.