Jason Stiltner (@JasonLStiltner) header
Jason Stiltner (@JasonLStiltner) profile picture

Staff AI engineer. Production agents, evals, and making AI systems earn trust. I publish what fails, what changes, and what survives. Build. Learn. Recurse.

Nashville, TN
Joined May 2012
I ran one LLM judge 5 times on each of 1.106 agent trajectories. Only 20 cases produced mixed verdicts. In that configuration, majority voting added cost without improving accuracy. Before adding another judge call, measure whether there’s any variance to recover.
1
1
19
Stop calling your flowchart an agent. Most “AI agents” out there are just prompt chains wearing a trench coat. Let’s talk about what separates real agents from glorified macros. 🧵
1
30
Jason Stiltner retweeted
I don’t even believe myself when I say “this won’t take me long”
15
213
6
1,362
Norwegians are the best trolls.
Jason Stiltner retweeted
So I just misspelled the name of someone named Jason as "Json".
70
126
27
977
Jason Stiltner retweeted
Just received verbal govt approval for The Boring Company to build an underground NY-Phil-Balt-DC Hyperloop. NY-DC in 29 mins.
5,407
50,388
12,556
151,269
Jason Stiltner retweeted
Tesla Semi truck unveil set for September. Team has done an amazing job. Seriously next level.
1,404
11,031
1,612
40,334
Jason Stiltner retweeted
Pull requests: - 3 files have changed > 25 comments in conversation - 40 files have changed > LGTM!
12
545
37
1,046
Jason Stiltner retweeted
Positive emotions like compassion and loving kindness engender in us a deep sense of peace and serenity, and benefits others as well.
268
10,161
328
21,333
Jason Stiltner retweeted
Be a kind and compassionate person. This is the inner beauty that is a key factor to making a better world.
519
23,254
965
39,219
Jason Stiltner retweeted
Recipe for radical improvement: 1 Hang around people better than you 2 Regularly ask for constructive criticism 3 Implement advice & repeat
6
43
79
Jason Stiltner retweeted
When you gotta rollback a bunch of commits and you lose all the features you’ve developed
17
2,005
77
2,955
.@NashSoftware launching a Data Science Program in early 2017! #datascience #analytics #nashville #dataengineering https://nitter.gq/t.co/1aFtXnW7Ax
Jason Stiltner retweeted
Jill Stein Just Promised To Pardon Snowden, Appoint Him To Cabinet If Elected zerohedge.com/news/2016-07-1…
7
52
10
59
Replying to @singularityhub
There are always constants, too, especially over short time intervals. Like physics on deep blue waters.
Jason Stiltner retweeted
"Fundamentals of design patterns" topic tonight at @ggdnashville. Brought to you by @Groups360. 🍷📲
4
1
12
Jason Stiltner retweeted
Slock.it UG commits to “The DAO” - blog.slock.it/slock-it-ug-co…
2
20
19
Jason Stiltner retweeted
Next time a politician says they care about students, think about how many payments you have left. Then this: nitter.gq/mims/status/7250744207…
267
7,187
1
7,314
Jason Stiltner retweeted
Daohub.org gets a facelift, full scope of The DAO is revealed - blog.slock.it/daohub-org-get…
31
29
Jason Stiltner retweeted
chat bot irony: 40yr old nerds can dust off their 15-20 year old IRC bot code and everyone will be amazed at the innovation and...oh nm lmao
1
2