alexis retweeted
Excited to see what people build!
introducing simulate.ai by @raindrop_ai
test your agent on every PR, against real scenarios, with one-click.
we handle all the set up: sandboxing, fixtures, real data, synthetic data, evals and more.
alexis retweeted
With how comprehensive these models are getting in terms of finding cybersecurity vulns and unpredictable behavior, having an environment as close to real life will start to become more and more important for agents to test against
introducing simulate.ai by @raindrop_ai
test your agent on every PR, against real scenarios, with one-click.
we handle all the set up: sandboxing, fixtures, real data, synthetic data, evals and more.
alexis retweeted
Raindrop is absolutely crushing it!
introducing simulate.ai by @raindrop_ai
test your agent on every PR, against real scenarios, with one-click.
we handle all the set up: sandboxing, fixtures, real data, synthetic data, evals and more.
alexis retweeted
This is the first step of a huge bet Raindrop is making. All agents will be tested in Simulation in the future. Come try Simulations to help us shape that world.
introducing simulate.ai by @raindrop_ai
test your agent on every PR, against real scenarios, with one-click.
we handle all the set up: sandboxing, fixtures, real data, synthetic data, evals and more.
alexis retweeted
i can’t overstate how incredible raindrop is!
we’re inching towards solving humanity’s last problem :)
introducing simulate.ai by @raindrop_ai
test your agent on every PR, against real scenarios, with one-click.
we handle all the set up: sandboxing, fixtures, real data, synthetic data, evals and more.
alexis retweeted
introducing simulate.ai by @raindrop_ai
test your agent on every PR, against real scenarios, with one-click.
we handle all the set up: sandboxing, fixtures, real data, synthetic data, evals and more.
alexis retweeted
The case for owning your agent.
Our founding engineer @rsdgpt introduces Sprinkle, our internal agent, and makes the case for more companies building their own.
Read more: raindrop.ai/blog/sprinkle/
alexis retweeted
I genuinely believe Raindrop is working on the most important problem in the world right now. We are hiring like crazy and will grow insanely fast in 2027 (and the rest of 26 lol). If you want to join a rocketship we should talk!
alexis retweeted
Early stage startups are SO fun.
It could just be @raindrop_ai.
But it’s so fun.
alexis retweeted
Was super fun to meet @alexisgauba and Sam from @github last night to chat about all things engineering. If you're deploying agents at scale and you haven't checked out @raindrop_ai, do it now! also, not sure how I managed to have my eyes closed in every single photo???
Our co-founder @alexisgauba joined Sam Morrow and Maria Kazandj at @figma HQ to chat all things design, development, and building with AI.
Thanks to @oscargws and the Figma team for hosting!
alexis retweeted
This is great - when shipping agent/prompting changes at high velocity, sometimes it's tough to remember to go back and check the results of every minor tweak... Raindrop making it easy to keep up
today, we're excited to announce change reports.
@raindrop_ai watches every PR and sends you slack dm's on how your agent changes actually performed in production
alexis retweeted
today, we're excited to announce change reports.
@raindrop_ai watches every PR and sends you slack dm's on how your agent changes actually performed in production
alexis retweeted
. @sh_reya and I are launching our new book Evals for AI Engineers Nov 12th at @DanOlsen’s @LeanProdMeetup!
You can join IRL in Mountain View or on Zoom. Our sponsor @raindrop_ai is providing free copies that we will sign for you if you come in person.
Here's the sign up link events.ticketleap.com/ticket…
alexis retweeted
Last year we launched Tolan, inspired by a vision of AI that sees you and believes in you, not one that books restaurant reservations for you.
Your Tolan shows up for you at 3am when you’re alone with your newborn. On your commute when you’re anxious about the day ahead. When you just finished a new show and none of your friends have watched it yet.
The people who love Tolan are parents. Caregivers. Moms in Dallas and Dads in Atlanta. People who aren’t trying to optimize and be more productive, but who simply want to feel seen and supported in their aspirations.
This month more than 250k people will spend time with their Tolan. Those users have exchanged billions of messages across more than 70m conversations over the last year.
Today, we're announcing $30m in additional capital from @mignano and @usv, with @khoslaventures and @rabois doubling down, bringing our total capital raised to $60m.
To celebrate, we made a short film celebrating some of the ways that Tolans show up :)
alexis retweeted
Recently had the chance to interview @benhylak on how he is thinking about simulations in our AI Evals Course 😁
Simulations are incredibly useful for evals when you do them well. Ben discusses what he learned from implementing simulations for evals at several companies. Some fun topics came up, my favorite being "simulation awareness" - when models know they are in a simulation.
Below is a chapter summary:
Why input/output tests miss agent failures
Replay production traces to see what a change breaks
Recreate the data and tools around the agent
How agents detect simulations and change their behavior
Choose scenarios that test the change you made
Check answers, costs, and tool behavior across runs
Replay known failures to verify a fix
Common mistakes that make simulations misleading
Check that the simulation reproduces production behavior
When to start using simulations
You can also watch this on YT: youtube.com/watch?v=eLkESCLv…
alexis retweeted
i agree!
have been personally focusing on this the last few months, dm if you have an ai agent and want to collab on this
will have cool stuff to share soon :)
The most important technology problem of the next 5 years:
Creating a broadly accepted standard for agents to identify themselves to service providers, so that providers can adjust the way they interface with clients (as compared to human-based traffic).
In the interim (i.e., for the next 6 months), there will be a cat-and-mouse game that agents will play -- to circumvent detection and maintain their product's utility during this growth phase.
However, this will only be a stopgap and it will not be the terminal state of the world.