LangChain CEO Harrison Chase says his company spends ~30% of engineering salaries on coding tools (and Chase now only codes by messaging an agent from Slack):
"I think we spend probably roughly 30% of our engineering salary on coding tools. It's actually gone down the last two months, while the number of tokens that we've used has actually gone up. And we've done this by doing three steps.
First is basically just visibility. We tracked all of our coding agent usage to LangSmith, so we could tell who was spending how much, what they were spending it on. We could do analytics over that.
Second, is just basic cost controls. We set a budget, and if you hit the budget, you can talk to our VP of engineering and he'll almost always increase it, but it's just a safeguard against agents being used incorrectly or going in a bad loop.
Then third, we control the harness. We actually built our own in-house cloud coding agent, Open SWE is what we call it. It's actually the only way I code anymore, because I'm in Slack all the time, so I just message it from Slack and it kicks off.”