Never write another web scraper. Diffbot structures information from the web, so you don't have to.
The Future
Joined September 2009
- Tweets2.1K
- Following7.6K
- Followers8K
- Likes10.2K
Diffbot 🤖 retweeted
Ever wondered what your white name should have been? Introducing: whatismywhitename.com
Upload a picture of you, and let the puppy guess your name! Let's test out nominative determinism 🫡
(Immigrants who named themselves will correlate more highly. Give us feedback plz)
Our thanks to:
- @modal for their generous credits toward training this meme model
- @diffbot for the clean, diverse dataset!
- @leannch86920 for the training research!
- Everyone NOT named David (biggest & noisiest dataset ever)
Diffbot 🤖 retweeted
State of E-commerce Data Providers - Q4 2025
E-commerce runs on constant measurement: prices, promos, availability, seller changes, and "what the shelf actually looks like" across retailers and marketplaces.
The challenge is stable collection at scale, retries when sites break, anti-bot evasion, clean geo signals, and then turning messy HTML into usable structured data.
In preparation for the holiday season, we mapped the landscape of e-commerce data providers:
Competitive intel + digital shelf: @dataweavein, @Price2Spy, @bigdataNODE, @Profitero, @WiserInc
Marketplace intelligence + data: @junglescout, @H10Software, @datahawkco, @SellerSprite_EN
Trade, Supply Chain, Imports / Exports: @Trademo1, @ImportYeti, @datamyne
Scraper APIs & Extraction Platforms: @zytedata, @diffbot, @Stratalis, (AutoScraping handle?), @serpapi
Managed Data Extraction & Services: @groupBWT, @Data_Ox, @epctex, @MrScraper_
Retail Media & Ad Platforms: @Pacvue, @PerpetuaLabs, @Teikametrics
Network & runtime infra for e-com scraping: @playwrightweb, Puppeteer, @browserless
Diffbot 🤖 retweeted
YouTube, TikTok, Mastodon, & Threads are mostly there but need optimizing.
Diffbot goes incredibly far with articles & that’s also moving along well.
Reddit & Bluesky are readily available but I haven’t spent the time.
X is finished by the endpoint gets rate limited 😞
Diffbot 🤖 retweeted
San Diego developers, join us and our technical partners @neo4j, @Intuit, Eyepop.ai, @Replit , and @diffbot at our HackNight next week!
We're excited to join @neo4j , @Intuit, EyePop.ai, @Replit and @diffbot as technical partners for the upcoming Startup San Diego - FirstWave Innovator HackNight happening Wednesday, February 19th at the Intuit San Diego Campus.
This is going to be an epic night where 100+ developers will come together to create innovative solutions for five select startups.
🚀 Join as a developer for free or get tickets: lu.ma/4brcg3lz
Diffbot 🤖 retweeted
Diffbot launches open-source AI model that achieves 81% accuracy by querying a trillion-fact Knowledge Graph in real-time instead of relying on static training data 🧠📊
Read more: venturebeat.com/ai/diffbots-… #ArtificialIntelligence #Enterprise #MachineLearning @diffbot
Diffbot 🤖 retweeted
One of the most fun parts of #aitoolshacknight last week was seeing @davidpomerenke win best demo using @Get_Writer Framework!
In just a couple hours, he used @diffbot to scrape AI safety papers & built a web app in Writer Framework to visualize the data.
Way to go David! 🎉
Diffbot 🤖 retweeted
Soooo excited to finally get to be part of one of @itsajchan's legendary hack nights @github on Sept 10! 🎉
Join @Get_Writer, @diffbot, @neo4j, & @goteleport for an epic night of AI coding and fun!
Register: lu.ma/ozt7jtq5
Diffbot 🤖 retweeted
Hack Night @github is on September 10th and we've got some incredible speakers and awesome technology companies (@weaviate_io @neo4j @diffbot @goteleport and @Get_Writer!) bringing some of the hottest LLM and RAG tech to the industry. Don't miss out!
lu.ma/ozt7jtq5
Join me on Sept 10th at SF GitHub HQ. I'll be presenting a lighting talk on how I use @goteleport to access my local LLM home lab powered by my banana sized GPU. lu.ma/ozt7jtq5
Diffbot 🤖 retweeted
Join me on Sept 10th at SF GitHub HQ. I'll be presenting a lighting talk on how I use @goteleport to access my local LLM home lab powered by my banana sized GPU. lu.ma/ozt7jtq5
Diffbot 🤖 retweeted
Data Augmentation
I’m using @serpapi and having it called from LLM functions. It works great! Cost is going to be the only concern here. Probably going to cost ~0.6 USD per month per premium user.
Also planning on using @diffbot to do some extra scraping when necessary. I still don’t have a great idea of what tier I’ll need, but seems it’ll be around ~0.6 USD per month as well.
Diffbot 🤖 retweeted
We need a paradigm shift from a data first world to what I call a #KnowledgeFirst world where context is at the center. The LLMs are large databases of text. Organizations need to define their large database of context in the form of knowledge graphs which integrate with LLMs
This quoted post is unavailable.
Diffbot 🤖 retweeted
🤷♂️Diffbot Document Loader
This covers how to extract HTML documents from a list of URLs using the @diffbot extract API
Docs: python.langchain.com/en/late…
Diffbot 🤖 retweeted
Profiling $BDP partner @diffbot, a key #AI company
Its Knowledge Graph is the world's largest + is used to train #AI like #ChatGPT
Customers incl @Adobe @Microsoft
@eBay @Snapchat @NotionHQ
@diffbot has published data in $BDP Data Market 2.0
market.bigdataprotocol.com/a…
Diffbot 🤖 retweeted
Projects such as the State of #datajournalism Survey 2022 can only be done through collaboration. A big shout out to our partners @f_l_o_u_r_i_s_h, @gijn, @diffbot, @dataliteracycom, @AJMInstitute for all of their support in helping the community! datajournalism.com/survey/20… #ddj
Diffbot 🤖 retweeted
Great article on how Knowledge Graphs are being created at large scale by @diffbot. With an appearance of @heikopaulheim!
“Each of these factoids gets joined up with billions of others in a sprawling, interconnected network of facts...a knowledge graph.”
technologyreview.com/2020/09…
Diffbot 🤖 retweeted
Special offer for those at #Neurips2022 this week: Lifetime research access to the world's largest Knowledge Graph
Diffbot 🤖 retweeted
How can you track sanctions against Russia from at least 602 companies worldwide? With #AI naturally. @diffbot has built a live, automated feed of sanctions responses and also included a guide to do it yourself too. bit.ly/3OgZviJ #datajournalism
Diffbot 🤖 retweeted
If you haven't already, go check out the Natural Language API Demo Tool at @diffbot. It is going to take your SEO content skills to a new, unimaginable level.