Pinned Tweet
An agent reads 10,000 documents overnight. If 1 page in 200 is wrong, thatās 50 bad decisions before anyone wakes up.
We're so excited to launch Unstructured Transform, our biggest update since we open-sourced Unstructured four years ago.
Top table score against three frontier models, the least invented text, and $0.015 a page.
That's a wrap on #GartnerSYM!! 𦩠Thanks to everyone who stopped by to show us their messiest docs.
Missed us? Book time with the team: unstructured.io/?modal=contaā¦
#AgenticAI
Send us your 25 worst pages and what your parser makes of them today. In 24 hours you get Transform's output side by side with yours. Free, and the output is yours to keep.
unstructured.io/hot-mess-tesā¦
Full benchmark and how Transform works: unstructured.io/blog/unstrucā¦
Unstructured retweeted
We may not be paying attention to it too much, but if you think about it, the entire š around us runs on documents. Speeding tickets, insurance claims, leases, lab results and so much more.
Most of them end up as PDFs, scans, faxes or a photo someone took on their phone, so getting reliable, structured data out of them at scale is still a real hassle.
Transform is our love letter to doing that better than "sending it to a frontier model"
Try it out :)
An agent reads 10,000 documents overnight. If 1 page in 200 is wrong, thatās 50 bad decisions before anyone wakes up.
We're so excited to launch Unstructured Transform, our biggest update since we open-sourced Unstructured four years ago.
Top table score against three frontier models, the least invented text, and $0.015 a page.
Unstructured retweeted
Weāre excited to launch Unstructured Transform, our document parser built for the docs agents struggle with most.
Frontier models are really good at reading a page now. But the documents our customers care about arenāt clean pages. Theyāre credit agreements with three levels of merged headers, insurance claims that have been scanned and re-scanned, lab panels, bills of materials, and 10-Ks with tables that spill across pages.
And when an agent is the one reading them, small mistakes get expensive fast (one number lands in the wrong column and a payment goes out wrong, with nobody in the loop to catch it).
So we tested Transform against GPT-6 Astra, Claude Opus 5.5 and Gemini 3.8 Flash on 224 pages of real business docs. Hereās how it stacks up:
#1 on tables: 0.896 (next best: 0.845)
Lowest hallucination rate: 5.0% (frontier models: 7.4 to 7.6%)
$0.015 a page, about 1/7 the cost of GPT-6 Astra
Weād love to see what youāre building with it!
unstructured.io/blog/unstrucā¦
#DocumentAI #AgenticAI #DocumentParsing #EnterpriseAI #Unstructured
An agent reads 10,000 documents overnight. If 1 page in 200 is wrong, thatās 50 bad decisions before anyone wakes up.
We're so excited to launch Unstructured Transform, our biggest update since we open-sourced Unstructured four years ago.
Top table score against three frontier models, the least invented text, and $0.015 a page.
Read the full breakdown š
unstructured.io/blog/unstrucā¦
"Mostly right" isn't good enough for an invoice.
GPT-5.6 Sol read 96.1% of fields correctly on 200 scanned invoices. Only 1% of invoices came back with zero errors. Unstructured Transform: 84%.
unstructured.io/blog/rag-neeā¦
Who you'll meet at Booth #1112 this week š Come say hi! We're here all week 𦩠#GartnerSYM
Good enough parsing was fine when a human read the answer. Now an agent acts on it.
@_Brian_Raymond on why the bar moved, and how to hold every parser to it š
The question I hear from engineering teams has changed, and I think it's the most important shift in the stack right now.
In 2024 it was "why would I need the extra tenth of a percent?" Their parser did a pretty good job transforming a file into JSON or markdown, the retriever found the chunk, and the generated response looked fine. Good enough was good enough.
In 2026 nobody asks me that. They ask whether we can tell them exactly where on the page a value came from and how sure we are, because an agent is going to act on it without a human in the loop.
The math behind that is simple. With multi-step agentic systems, errors at the context generation phase (when raw data is converted into JSON or markdown) compound downstream.
We ran an experiment to demonstrate this point: 200 scanned invoices through the same 25-step invoice-payment workflow, using three differing parsing engines.
Field accuracy looked close. Whole invoices were not close at all.
GPT 5.6 Sol only parsed 1% of invoices correctly, but most of these errors were invisible if you aren't an agent.
I wrote a short ebook on what changed over the past couple of years and what bar you should hold for your preprocessing engine, ours included.
RAG needed mediocre data. Agents need extraordinary data.
unstructured.io/blog/rag-neeā¦
We're all set up and ready to roll at @Gartner_inc IT Symposium! Come see us at Booth #1112.
#GartnerSYM #EnterpriseAI #AgenticAI #GenAI #Unstructured
Gartner IT Symposium is all about separating AI hype from reality. Our corner of reality is the messy files your agents run on. Find us at Booth #1112 all next week. 𦩠#GartnerSYM
96.1% field accuracy sounds shippable.
On 200 scanned invoices, that frontier model read 2 with zero errors. Transform: 99.4% on fields, 168 invoices clean. Tesseract: none.
Agents don't consume averages.
unstructured.io/blog/rag-neeā¦
RAG needed mediocre data. Agents need extraordinary data.
Our new ebook on why one misread field matters a lot more once an agent acts on it. Includes a 200-invoice, 25-step test.
š unstructured.io/blog/rag-neeā¦
Send us your ugliest pages. We mean it. š
Crooked scans. Coffee stains. Tables inside tables inside tables.
Bundle up 25 and take the Hot Mess Test. Weāll put Unstructured Transform to work on them and show you how it stacks up against your current parser, side by side.
Free. No setup. Results within 24 hours.
Bring on the mess. š
š unstructured.io/hot-mess-tesā¦
99% field accuracy sounds great. Until that 1% sends an entire form back for human review.
That's why field-level accuracy doesn't tell the whole story.
When evaluating document parsing, the question isn't just how many fields are correct. It's how many documents make it through without anyone needing to fix them.
We put that to the test with 40 forms. Here's what we found: unstructured.io/blog/how-to-ā¦
Every parser wins its own benchmark. We'd rather win yours. šÆ
That's the Hot Mess Test. Send us your 25 hardest documents: the torn scans, the coffee stains, the forty nested tables, the handwriting in the margins.
Unstructured Transform will likely get most of them right out of the box. Where it doesn't, our model team fine-tunes it directly on your files until it does šš
- You send it: PDFs, scans, or images. Nothing to set up.
- We run it, and tune where needed: your formats and edge cases, not a generic benchmark.
- You compare: same file, side by side with your current parser's output.
Free. No commitment. You keep the output either way.
Take the Hot Mess Test: unstructured.io/hot-mess-tesā¦
Two parsers can post nearly identical field accuracy and still be miles apart in practice.
Field accuracy counts fields. But a single wrong field is enough to send a whole form back for human review, so the number that matters is how many forms come back clean.
In our test of 40 forms, Transform returned 34 with zero errors. The frontier model returned about half, at roughly 7.5x the cost per page.
Cheaper to run, and more of your forms never touch a human.
Read more in our latest blog: unstructured.io/blog/how-to-ā¦
Field accuracy is the number everyone reports when they talk about parsing forms. It's also the one most likely to mislead you.
We ran 40 grant applications through Unstructured Transform and GPT-5.6 Sol. On field accuracy they looked almost identical: 99.5% against 98.7%. You'd call it a tie.
But field accuracy counts individual fields. A form can get 99% of its fields right and still have one wrong value sitting in it, which means the whole form still needs a human to catch it.
So we measured what actually decides your human workload: how many whole forms came back with zero errors. Transform returned 34 of 40 clean while the frontier model got about half.
The more accurate system turned out to be the cheaper one too, at roughly 7.5x lower cost per page.
A wrong value that still looks plausible slips past review and ends up in a customer record or an automated decision, where it's far harder to catch and far more expensive to fix than it would have been on the page.
Read more in this week's blog: unstructured.io/blog/how-to-ā¦
A frontier model can match a parser field for field and STILL cost you more.
We saw it in our own test. On individual fields, GPT-5.6 Sol and Unstructured Transform came out about even. But GPT got more whole forms wrong, and it was several times more expensive per page. Across thousands of documents, that means a bigger bill and more forms for your team to fix.
We wrote about why, and what to check when you're putting a parser up against a frontier model: unstructured.io/blog/how-to-ā¦
#DocumentParsing #DocumentAI #DataEngineering #Unstructured
Last week we wrote about why better frontier models haven't made document processing go away. So this week we tested it, on forms.
If you're evaluating a parser, field accuracy is the first number most people look at, and it's also the most misleading. We ran 40 grant applications through Unstructured Transform and GPT-5.6 Sol. 99.5% vs 98.7%. Basically a tie.
But count the forms where every value is right and it's 34 out of 40 for Unstructured vs about 20 for GPT-5.6 Sol. At 10,000 forms, that's roughly 15% for a person to check vs ~50% while costing 7.5x more per page.
The mistakes are small, like a name with one letter wrong or a number in the wrong column. One wrong field means the whole form is wrong, but these are easy to miss because the answer still ālooksā right.
So when you test any vendor, score whole documents, not fields, and check what each one costs you per page. We wrote about this here: unstructured.io/blog/how-to-ā¦








