What makes me nervous about using coding agents to design complex systems:
When designing new types of complex systems, you typically do not know ahead of time which combination of ideas will work. It is an iterative process where you hypothesize and test many ideas, often via prototype implementations. The difficulty of implementing an idea is a strong indication that it would be fragile in practice. Even when easy to implement, the act of implementing an idea makes you aware of the corner cases that you didn’t anticipate (I am not that smart).
By taking away the implementation burden, coding agents also take away a key learning signal. The result could be fragile systems that break in ways you didn’t see coming.