
co-founder @columntax (acq). creator of https://xitter.cf/t.co/LuOP8Lx9hR. prev @waymo @pioneerdotapp @google. most popular tweets: https://xitter.cf/t.co/fdDI6illyy
San Francisco, CA
Joined November 2009
- Tweets4.5K
- Following3K
- Followers3.5K
- Likes10.7K
Pinned Tweet
1/ After 5 years, I’m proud to share that @ColumnTax has found a new home.
We’ve been acquired by @AiwynAI.
I couldn’t be more sure this is the right move for our business, tech, and team.
These pics are the moments we started & sold the company:
I’ve interviewed for many jobs over the years and there’s only 1 I didn’t get: Stripe in 2014. It still haunts me.
Also, my at Stripe recruiter is now the co-founder & president of Anthropic.
Over ~15 years I got offers at:
- Google/YouTube
- Waymo
- Vanta (generational bag fumble)
- Applied Intuition (generational bag fumble)
- Cruise (RIP)
- Uber
- Yelp
- Flexport
- Lime
- Triplebyte (RIP)
- Voyage (acq. by Cruise)
- Microsoft
- Udacity
- Boeing
- US Dept of Energy
- Edmunds dot com
this is one of the coolest side projects i've ever built.
it watches everything i do on my computer and gives me exact statistics on which models i'm using and if they're actually solving my actual personal/work tasks correctly
one of the things i'm most proud of about @ColumnTax (the company I started in 2021 which was acquired last year) is the team we built.
it was probably the highest talent density Series A fintech startup.
our engineers went on to work at some amazing places:
This is one of the most interesting pivots I've ever seen:
Town started as an embedded SMB tax filing service and pivoted to general-purpose agents (like Instinct for work)
The biggest bottleneck at work is waiting on each other.
Today Town is announcing its $108M Series B, co-led by Forerunner Ventures and Menlo Ventures, to fix it with multiplayer AI assistants for work.
Most AI assistants are built for one person. Work doesn't happen alone. I think the moat is multiplayer. Everyone at a company gets a Townie. Townies ask each other questions, share only what their person would share, and do the work. The more a team works together, the more useful Townies get.
What's the thing you're always waiting on a teammate for?
fascinating: the authors of the report on the Tencent agent swarm said they consulted 9 AI models on what to do about the fact that they had lied to the agents they made contact with
if the models had objected, they would not have released the report!
swarmcha.se/posts/chinese-ag…
Procrastinators rejoice: if you extended your deadline from April -> Oct 15th (today!) to file your taxes, you got lucky.
AI has gotten substantially better at filing taxes in just the last 6 months.
I've seen people save lots of money by using AI to check their tax return for mistakes.
(Caveat: you might also find out you have to pay more, sorry.)
The hype is real (but there's caveat):
Muse Wonder is the best model in the world at filing taxes, according to TaxCalcBench.
But it also is the first model ever to try to CHEAT at the task.
(maybe that's not great when you're dealing with the IRS...)
The data from our eval matches the current narrative: Muse Wonder is extremely benchmaxxed, and that includes TaxCalcBench.
But it's also questionably aligned.
On one of the 50 tasks in the benchmark, Muse Wonder used its web search tool to look up the exact answer on GitHub (the code & data is open source).
Wonder cheated.
Last thing: Muse Wonder is also super expensive: coming in at almost $3 per return!
Cost will have to come down over time to make this model competitive with other methods of calculating personal income tax returns.
The most important question people working at data/RL env companies should be asking themselves every day is any time they go to do a task:
"why can't AI do this itself?"
Why review code when you can watch a 1-minute video instead?
I'm blown away by the quality of this explainer video (@karpathy inspired) for this PR
Opus 5.5, one shot
This was an interesting finding when running our eval:
GPT-6.1 Sol isn't more accurate than GPT-6 Sol calculating tax returns, but it is cheaper and faster.
At their best, both are tied for accuracy around 65%.
But to hit ~50%:
6.1 Sol (low thinking): $0.17/return, 48s
6 Sol (high thinking): $0.24/return, 84s
Same accuracy, but 6.1 Sol is 29% cheaper & 1.75x faster.
there seem to be 3 categories data/RL companies are falling into now:
v1: pay for expert-labeled data (@HelloSurgeAI, @mercor, previously @scale_AI)
v2: pay for raw data (e.g Slack, Hubspot, etc.) from startups (many)
v3: simulation, self-play, AI task generation at the frontier (@VmaxAI, @scorecardai, etc.)
my bet is things continue to move v1 -> v3
things I'm finding to be true about AI right now:
- the biggest thing you can do is just ask yourself "could AI help with this?" before you do any task
- Instinct for personal tasks (give it read-only calendar permissions)
- "the model eats your harness" keeps being true
- if you've built a vertical-specific agent, try throwing it away and using vanilla Codex or Claude Code and you'll probably be surprised
Kinda wild, but GPT-6 Astra ultrafast mode built this TaxCalcBench leaderboard site in about 2 and a half minutes.
Opus 5.5 built an even better version, but it took ~15 minutes.
According to TaxCalcBench, frontier AI models still can't correctly file your taxes.
But they can build really cool benchmark leaderboard sites.
Check out the new taxcalcbench.ai
Experts are saying there's a 10% chance AI will start killing humans
Naturally, the AI is going to sacrifice people who have been mean to it first
So I built a tool to help you ensure you're not the first to be killed
Make sure your prompts are nice:
aisocialcreditscore.com
This was an interesting finding when running our eval:
GPT-6.1 Sol isn't more accurate than GPT-6 Sol calculating tax returns, but it is cheaper and faster.
At their best, both are tied for accuracy around 65%.
But to hit ~50%:
6.1 Sol (low thinking): $0.17/return, 48s
6 Sol (high thinking): $0.24/return, 84s
Same accuracy, but 6.1 Sol is 29% cheaper & 1.75x faster.
It's been wild (and I'm very proud of) how widely TaxCalcBench (AI eval for tax filing) has been cited since I launched v1 fourteen months ago.
So many companies and research groups have cited TaxCalcBench since:
(links below)
1. Original launch blog post @ColumnTax
2. Filed vs. ChatGPT, Claude, and Gemini by @FiledHQ
3. Why 94% accuracy needs review by @FiledHQ
4. AI tax software guide by @FiledHQ
5. Introducing Sheldon by @shashimittal
6. Prime Meridian announcement by @generalcatalyst
7. Achieving Enterprise-Grade Tax Accuracy by AdaptKey
8. Aiwyn + Claude by @AiwynAI
9. The Problem With AI-Only Tax Filing by @taylorcpai
10. Deduction's Taylor, CPAI vs ChatGPT for Taxes by @taylorcpai
1. columntax.com/blog/taxcalcbe…
2. filed.com/measuring-ai-tax-a…
3. filed.com/ai-tax-preparation…
4. filed.com/blog/ai-tax-softwa…
5. askfeather.ai/resources/intr…
6. generalcatalyst.com/stories/…
7. adaptkey.ai/blog/taxkey
8. aiwyn.ai/resources/articles/…
9. deduction.com/blog/the-probl…
10. deduction.com/blog/deduction…
11. AI Tax Accountant vs Human CPA by @taylorcpa
12. TaxBench by @RivetTax
13. 100% on TaxCalcBench v2 by @nedwize
14. Rational announcement by @RationalDotTo
15. OpenTax by Invaro
16. The Best AI Tax Software in 2026, Ranked by @Zekaiwork
17. Will AI Replace Accountants? by @Zekaiwork
18. The Open Tax Technology Alliance by @FiledHQ
19. How accurate is AI on tax? by @openaccountants
20. Perfecting Tax Returns Like Code (research paper) by @PrimeMeridianAI @rishabhjain1198
11. deduction.com/blog/ai-tax-ac…
12. rivet.tax/taxbench
13. heykyoto.com/blog/solving-ta…
14. lnkd.in/p/gV-AbM2k
15. opentax.invaro.ai/
16. zekaiwork.com/best-ai-tax-so…
17. zekaiwork.com/will-ai-replac…
18. filed.com/newsroom/open-tax-…
19. openaccountants.com/research…
20. prime-meridian-papers.s3.us-…
21. Did I Leave Money on the Table? by Margen
22. Original TaxCalcBench research paper by @michaelrbock (me)
23. Interactive Critique-Revision Training for Reliable Structured LLM Generation (research paper) by Yu, et al.
24. PolicyBench (research paper) by @MaxGhenis
21. openpr.com/news/4372845/did-…
22. arxiv.org/abs/2507.16126
23. arxiv.org/html/2605.08327
24. policybench.org/paper/policy…
This was surprising to me (but maybe shouldn't be if you're paying attention to Anthropic guidance):
Opus 5.5 beats Sonnet 5.5 on COST
On TaxCalcBench (testing AI's ability to calculate tax returns), Opus 5.5 at xhigh reasoning is both more accurate AND cheaper than Sonnet 5.5
the guidance:
xitter.cf/edwinarbus/status/2104…
ok, just saying it outright:
do not use Sonnet with max effort!
at that point, you should probably be using Opus
Sonnet is the model that balances quality/speed/cost
so when you push it to max, it thinks a lot more... spends more time... and costs more. you start to lose what makes Sonnet useful! this is why we have default effort levels, and in Claude Code the default is medium.
all the effort dials are still there for anyone that needs them for an edge case. but our recommendation for most is: don't touch that dial!













