Built for long-horizon agents. Monitor agents against your own criteria. Search and investigate patterns at scale. Benchmark improvements and regressions before rollout. judgmentlabs.ai

Its a beautiful day for a scoop 🧡

Agent trace telemetry is one of the most critical parts of the RSI loop. Back when I did an RSI loop on Cline to make it automagically improve the harness over a 17 hour long running agent run I found that parsing good signals and iterating on it with the analyser agent could fix an agent response and rerun to hill climb agentic evals. Until it reaches the models peak possible score without some tricky reward hacking. This is just one part, now imagine if the agent failures at the peak become filtered to become proper post training signals and trajectories of growth, wouldn't that be amazing? Now lets go one step further, if you are an enterprise with tons of confidential data that AI just messes up because its too much context to get it all right at once what do you do? You take a smaller model and get agent telemetry and post train models and get higher perf. The future is a world of smaller post trained models curtailed to specific enterprise use cases working in tandem with behemoth trillion dollar models as agent orchestrators but it all has to start somewhere.

Super proud of the team, it's been a grind in the weeks and months leading up to our public launch!! Excited to see what folks build w/ @JudgmentLabs

excited to share what ive been working on this past few months! Judgment Labs is now open for general access ‼️ it's been an insane journey building at the frontier of AI agents. ignore the orange suit at the start (that aint me, trust 😭)

A year and a half in the making with a wonderful team. Excited for you guys to see what we have been building!

@andrew_li03 knows the dark arts of having to read traces. a lot of them.

Designed a new website for @JudgmentLabs! Check it out judgmentlabs.ai :)

awesome launch lfg!

Check us out!

I reached out to @JSCamyre in February after one of the Judgment engineers happened to like one of my linkedin posts I believed back then that companies would need a dedicated platform to handle the scale of data that agents would produce Try out what I’ve been a part of for the past 8 months

The @JudgmentLabs free ice cream truck is back in SF. Tue, Wed, Thu this week. Go get some 🍦 Thank you to our partners! Today, we're serving @typesafeai jev jam, @modal À La Modal, @ExaAILabs EXA-presso.

Back in January, @carloagostinel2 introduced me to @alexshander03, @JSCamyre, and @andrew_li03. From the first conversation I knew this team was onto something special. 10 months in and it’s been an incredible journey helping customers build evals across all kinds of agents. This team works harder than any group I’ve been part of, and I’m incredibly proud of what we’ve built. 🧡 Now we’re live for general availability. Give the platform a try: judgmentlabs.ai/

This is an incredible milestone for the team. We’ve doubled headcount the past year and are growing at a historic rate across all fronts. If your team is building agents and want to improve them through production data, you can try our platform at judgmentlabs.ai. And if you’re interested in building the infrastructure for the agent world, send me a dm. We’d love to chat

Working on data and evals at Together, I spent a lot of time reading through AI traces. That gave me a real appreciation for how much this data tells us about how AI works, where it fails, and how to improve it. As long-horizon agents take on more work, the data they generate will far outpace what people can make sense of by hand. We’re building Judgment to help teams store, process, and analyze that data at scale. Excited to keep building the data infrastructure for a world powered by AI agents.

happy customer!

finally GA! Is been great working together