Real-time Issue Detection for AI Agents. We're hiring: raindrop.ai/careers

Announcing our Series A and Raindrop Simulations.
Today, we are announcing our Series A and a new product: @raindrop_ai Simulations. We've now raised $50m from @CRV and @lightspeedvp to protect the world from agent failures, big and small.
4
6
28
8,806
Raindrop retweeted
try it now: raindrop.ai/reports imagine you reduce a compaction threshold, add a new tool, or change the prompt. when you merge the PR, you might not see an immediate increase of overall problems. but that doesn't mean nothing is going wrong.
1
2
18
1,168
Raindrop retweeted
This is great - when shipping agent/prompting changes at high velocity, sometimes it's tough to remember to go back and check the results of every minor tweak... Raindrop making it easy to keep up
today, we're excited to announce change reports. @raindrop_ai watches every PR and sends you slack dm's on how your agent changes actually performed in production
2
3
15
1,740
Raindrop retweeted
today, we're excited to announce change reports. @raindrop_ai watches every PR and sends you slack dm's on how your agent changes actually performed in production
24
28
167
23,676
Raindrop retweeted
. @sh_reya and I are launching our new book Evals for AI Engineers Nov 12th at @DanOlsen’s @LeanProdMeetup! You can join IRL in Mountain View or on Zoom. Our sponsor @raindrop_ai is providing free copies that we will sign for you if you come in person. Here's the sign up link events.ticketleap.com/ticket…
19
17
281
11,427
ICYMI: the first episode of High Taste Testers from @latentspacepod dropped last week. Raindrop co-founder @benhylak joined @davis7 @dexhorthy @allisonology @altryne and @swyx to discuss OpenAI DevDay, the latest models and personal assistants, and how to test a new model on your own data before you switch. raindrop.ai/resources/high-t…
4
12
1,398
Congrats to the incredible team at @tolanworld 🙌
Last year we launched Tolan, inspired by a vision of AI that sees you and believes in you, not one that books restaurant reservations for you. Your Tolan shows up for you at 3am when you’re alone with your newborn. On your commute when you’re anxious about the day ahead. When you just finished a new show and none of your friends have watched it yet. The people who love Tolan are parents. Caregivers. Moms in Dallas and Dads in Atlanta. People who aren’t trying to optimize and be more productive, but who simply want to feel seen and supported in their aspirations. This month more than 250k people will spend time with their Tolan. Those users have exchanged billions of messages across more than 70m conversations over the last year. Today, we're announcing $30m in additional capital from @mignano and @usv, with @khoslaventures and @rabois doubling down, bringing our total capital raised to $60m. To celebrate, we made a short film celebrating some of the ways that Tolans show up :)
12
726
Congrats to the winners of the #SFTechWeek Harness Engineering & Model Wrangling Hackathon. Truly impressive work across the board, and especially from team MongoMation's @AliAmjad52114 and Zubair Zafar, who instrumented their agent with Raindrop to build a self-improvement loop. Shoutout to runners-up @jvboid and James Bian. Thanks to @cerebral_valley and @MongoDB for hosting, and Raindrop's very own @JacksonFerrigno for judging.
1
3
12
637
An agent's actions don't reveal its intent. After OpenAI reported that chain-of-thought monitoring could have caught rogue agent behavior earlier, we built an escape room that gave agents opportunities to break the rules. Here's what we learned: raindrop.ai/blog/escape-room… Research by @yunchi_ai @rsdgpt @ManavJShah_ @benhylak
1
10
687
Headlines often describe agents taking unexpected or unauthorized actions as “going rogue.” But rogue suggests rebelliousness. What Anthropic describes is almost the opposite: agents so committed to their assigned goals that they went past their operators’ constraints and expectations. Read more: raindrop.ai/blog/what-anthro…
1
4
430
Security engineers and security enthusiasts: if you're going to be at the @BSidesNYC conference check out the session from our founding security engineer @leifdreizler: "Feeling the heat from Malicious Packages? Cooloff with Cooldowns"
1
6
485
"What will my change change?" Our CTO and co-founder @benhylak joined @HamelHusain to share more on testing agents with Raindrop Simulations. Watch the full video: raindrop.ai/resources/how-to…
1
5
15
2,058
RT @HamelHusain: Recently had the chance to interview @benhylak on how he is thinking about simulations in our AI Evals Course 😁 Simulatio…
1
71
Our Co-Founder and CTO @benhylak sat down with @ashebytes outside our SF HQ in North Beach to talk about agent failures, why we built Raindrop, and what makes an alert worth your attention. Watch the full conversation: raindrop.ai/resources/rogue-… A few highlights ⬇️
11
3
19
1,556
Finding failures worth your attention. "Defining good versus bad is way trickier than you think."
1
64
We're hiring. "One of our philosophies is that enjoying the people you work with is one of the best ways to get leverage over hard work." raindrop.ai/careers/
58
Replying to @benhylak @ashebytes
Finding failures worth your attention. "Defining good versus bad is way trickier than you think."
1
56
We're hiring. "One of our philosophies is that enjoying the people you work with is one of the best ways to get leverage over hard work." raindrop.ai/careers/
44