Contra Labs (@contralabs) header
Contra Labs (@contralabs) profile picture

Creative intelligence.

New York, NY
Joined November 2025
Photo by Contra Labs (@contralabs)Photo by Contra Labs (@contralabs)Photo by Contra Labs (@contralabs)Photo by Contra Labs (@contralabs)Photo by Contra Labs (@contralabs)Photo by Contra Labs (@contralabs)Photo by Contra Labs (@contralabs)Photo by Contra Labs (@contralabs)Photo by Contra Labs (@contralabs)Photo by Contra Labs (@contralabs)
Contra Labs retweeted
ok some back story of why we built this benchmark: 1. i love design. designers can benefit so much from actually useful ai models. most models will get there within a few months. i want to know which model is best to use for design, that’s why we are creating a gallery so I (and you) can see myself (yourself) 2. i want to see models evaluated on realistic, complex design tasks, not just landing pages. in frontier design, we now have handful of web app/mobile app prompts, but we will expand to more types of product/non-product design 4. i don’t believe “taste” is such a mysterious thing that models cannot learn. we curated a list of rubrics based on practical design principles to use as evaluation criteria. our analysis found that these rubrics’ grading is highly correlated with expert preference on model outputs. we will do some post training experiments on these rubrics 5. ai models have so many slop patterns! our team curated a list of slop patterns (with some serious data analysis pipeline to back it up). models improve and slop patterns change, so we will keep iterating on these a really interesting part: we were able to identify some model specific slop patterns: claude likes to use right arrows ➡️ while gpt tends to use the super narrow top right arrow ↗️. stay tuned and we will share as we go! 6. i tried so many design skills and mcps but not sure which ones actually work. we will be working on this, and there’s gonna be some trajectory inspection involved if you have any topic you are interested in please lmk! design will look very different very soon. we do this for nothing but the love of design 💖
The AI industry has a benchmarking problem. We're letting random people on the internet decide which models are best even for capabilities like design... So we built something different. Introducing The Frontier Design Benchmark from @contralabs contralabs.com/frontierdesig…
4
12
2
84
3,619
Contra Labs retweeted
Yep. This is cool. Solid benchmark.
The AI industry has a benchmarking problem. We're letting random people on the internet decide which models are best even for capabilities like design... So we built something different. Introducing The Frontier Design Benchmark from @contralabs contralabs.com/frontierdesig…
4
4
26
2,201
Contra Labs retweeted
I’ve been a designer for almost 10 years, and honestly, AI has completely changed the way I approach creative work. But here's something I've realized: generating beautiful design is one thing. Making everything work together is a completely different skill. My process these days? I start with @claudeai to explore brand strategy, positioning, and messaging. Then I jump into @floraai to experiment with visual directions and creative concepts. From there, I bring everything into @framer and @Lovable to build quick, interactive prototypes. And this is my favorite part: watching the strategy, visuals, storytelling, and interactions dance together. Suddenly, we're not looking at a collection of pretty AI-generated images. We're looking at something that feels like a real brand, a real website, a real experience. Then comes the most important part: stepping back, questioning everything, testing ideas with clients, and deciding what actually works. That's where human creativity, taste, and creative direction make all the difference. And I think that's also how I recognize AI-only design. It can look incredibly polished, but sometimes there's no clear intention connecting the pieces. That's why I LOVE what @Contra Labs is doing with the new Frontier Design Benchmark. Their findings show that designers working with AI still outperform AI models working alone. AI gives us the freedom to explore a thousand directions. Our job as designers is to know which one is worth pursuing. contralabs.com/frontierdesig… – at Manhattan, NY
The AI industry has a benchmarking problem. We're letting random people on the internet decide which models are best even for capabilities like design... So we built something different. Introducing The Frontier Design Benchmark from @contralabs contralabs.com/frontierdesig…
18
27
3
293
20,533
Contra Labs retweeted
if we don’t have people with taste (designers) making, training, and deciding what gets used, we will be totally lost love to see @contra’s dedication to this
The AI industry has a benchmarking problem. We're letting random people on the internet decide which models are best even for capabilities like design... So we built something different. Introducing The Frontier Design Benchmark from @contralabs contralabs.com/frontierdesig…
3
6
151
9,095
Contra Labs retweeted
Breaking🚨: There is a new model "Gestalt" that is beating everything, including the human golden designs 👀
The AI industry has a benchmarking problem. We're letting random people on the internet decide which models are best even for capabilities like design... So we built something different. Introducing The Frontier Design Benchmark from @contralabs contralabs.com/frontierdesig…
Readers added context they thought people might want to know
This announcement comes from the creator of the referenced benchmark at Contra Labs. "Gestalt (stealth)" is an anonymous model included in their own leaderboard, with no independent verification or public details available. contralabs.com/frontierdesign contralabs.com/research/front…
1,457
239
134
2,708
650,649
Contra Labs retweeted
As models continue to hill climb on design outputs, human will continue to raise the ceiling. We wanted a better way to measure this that's not just crowdsourced opinions. We took real world, marketplace briefs and tested them against humans and models. Outputs were measured by real professional designer preference, a validated design critique rubric (grounded in how real designers, design), and AI slop detectors. The results are both visually appealing and mentally stimulating (check it out -> contralabs.com/frontierdesig…) The takeaway? Humans still beat models at the frontier (with a plot twist, see thread).
The AI industry has a benchmarking problem. We're letting random people on the internet decide which models are best even for capabilities like design... So we built something different. Introducing The Frontier Design Benchmark from @contralabs contralabs.com/frontierdesig…
2
7
29
6,015
Contra Labs retweeted
One of the biggest challenges in AI benchmarking is measuring what actually matters. Design is a perfect example. A model can generate a beautiful interface, but can it understand a real client brief and execute the vision? @contralabs is asking the right questions with its Frontier Design Benchmark. This is how AI capabilities should be evaluated.
🤝 Paid partnership
The AI industry has a benchmarking problem. We're letting random people on the internet decide which models are best even for capabilities like design... So we built something different. Introducing The Frontier Design Benchmark from @contralabs contralabs.com/frontierdesig…
14
56
1
85
17,023
I spot AI-made design by over-usage of eyebrow labels, subtext helpers, and gradients. @contra's benchmark found them on 93% of AI pages vs 11% of human ones. And I like them, so this isn't a dunk. But it's just an observation that is now backed by data. We need more design benchmarking, and this is a great start.
The AI industry has a benchmarking problem. We're letting random people on the internet decide which models are best even for capabilities like design... So we built something different. Introducing The Frontier Design Benchmark from @contralabs contralabs.com/frontierdesig…
9
6
87
6,032
Contra Labs retweeted
Frontier visual AI shouldn't require billions in compute and Internet-scale data. Our first model was trained from scratch by a small team, using a fraction of the resources typically required. Check out Contra Labs' evaluation against 8 leading image models for first results. 🍑
We compared @genpeachAI v1 Preview against 8 image models on 100 human-centered briefs, judged blind by 53 professional creatives. It won 71% of votes. The set: GPT-Image-2.5 Sunburst, Nano Banana 2, Muse Image, Recraft V4.1, Luma Uni-1, Flux 3, Ideogram 4.5 and Krea 2 Medium.
6
1
22
449
Contra Labs retweeted
Building frontier visual AI shouldn't require billions $ in compute and Internet-scale data. A year after leaving Meta, I’m excited to share the first independent evaluation by Contra Labs of what we've built at @genpeachAI. Our first foundation image model. Trained from scratch. Ranked top-1 on human-centered image generation across all axes! Outperformed the large frontier models. Small team. A fraction of the resources. More to come! 🚀 @contralabs eval report: contralabs.com/research/genp…
9
11
2
34
28,685
As startups are spending a lot more on storytelling and putting significant ad dollars behind campaigns I rarely see startups tracking 2 very important metrics: Brand lift: growth in awareness, perception, or intent resulting from marketing Brand mindshare: how prominently your startup comes to mind within a category @contralabs human creativity report looked at tools by post mindshare, which I really like as an ongoing metric to track.
18
3
21
2,069
Contra Labs retweeted
Hey X, this one is special, @contralabs looking for a Head of Creative to push the boundaries of what's possible. This is an opportunity to create things that have never been made before setting the bar for frontier AI capabilities. You will collaborate directly with me and our research team to create one-of-one digital experiences that demonstrate the true capabilities of frontier AI models. Location: SF or NY. Comp: $180K - $250K + equity DM me for job listing or if you have a referral! PS. you will help us make creative assets, sites and repots like the ones below
AI is making creativity more valuable than ever before and.. we have 3 years of data to prove it. Introducing the Creative Intelligence 2026 report from @contralabs. Full report: c87.to/creative-intelligence…
10
15
4
156
18,345
Contra Labs retweeted
hey x, its that time again @contralabs is hiring Researchers in SF/NY that are interested in making AI supercharge (not replace) creativity. You will collaborate on cutting edge projects directly with frontier labs and researchers that impact the tools and models creatives use every single day. If this is you, please DM or tag someone who could be interested!
hey x, @contralabs_ai is hiring Researchers in SF/NY that are interested in making AI better for creativity. You will collaborate directly with the frontier labs on cutting edge projects that directly impact the tools creatives use every single day tag someone who could be interested!
11
25
1
128
7,139
Contra Labs retweeted
Big things are happening at @contralabs , and now's a great time to get in early ✨ We're growing and looking for more Researchers + Strategic Projects Leads to join us in SF and NY. Come build with us!
14
12
81
5,039
Contra Labs retweeted
Amazing report by @contra
AI is making creativity more valuable than ever before and.. we have 3 years of data to prove it. Introducing the Creative Intelligence 2026 report from @contralabs. Full report: c87.to/creative-intelligence…
1
18
531
Higgsfield is now the fastest-growing skill freelancers get hired for. We are #1 on Contra’s Creative Intelligence 2026 list of the fastest-growing AI skills, with 25x growth from H1 2025 to H1 2026. My bet: within next 6 months, the most in-demand creative is the one who can take an idea all the way to a finished campaign. That’s why we built Higgsfield Katana, powered by Claude Motion. Give it a brief or your raw footage, and it hands back a finished edit, including the shots you never filmed. The next studio is one person with Higgsfield.
Introducing Higgsfield Katana, powered by Claude Motion. Our most powerful AI video editing tool, inside Claude. Upload a reference and create editable motion graphics, product launch videos, or aura-farming edits. Available now in Claude via Higgsfield MCP.
42
207
5
514
46,917
Contra Labs retweeted
There will only be two roles for designers. product people: make things you click on brand people: make things you swipe on
my thoughts on creative intelligence rn 👇
5
2
1
155
7,214
Contra Labs retweeted
I’ve been researching creators for many years now and the theme of the moment is FOMO: Am I using the right tools? Am I being left behind? There is *a lot* of coverage about new models and features, but very little work being done to make sense of what’s already here. I very much believe that the work of helping the community understand these tools is just as important as building them. So, major kudos to @contralabs for pioneering this research and sharing it for free. Most people will take this type of data for granted but these glimpses of what’s actually happening across tools/companies/models allow us to see the entire board and will inform very important decisions for those who are paying attention.
AI is making creativity more valuable than ever before and.. we have 3 years of data to prove it. Introducing the Creative Intelligence 2026 report from @contralabs. Full report: c87.to/creative-intelligence…
1
2
145
Contra Labs retweeted
Some lil thoughts on AI for the @contra report: It’s the golden age for creative ambition, if we want it to be. We can explore bigger ideas, across more mediums, quicker, with less friction. Speed gives us bandwidth. My hope is we use it to go wider, push ideas further, and make more interesting things together. ✌️
AI is making creativity more valuable than ever before and.. we have 3 years of data to prove it. Introducing the Creative Intelligence 2026 report from @contralabs. Full report: c87.to/creative-intelligence…
11
2
55
2,920
Contra Labs retweeted
my prediction: "brand engineer" becomes the most sought after creative role in 2026 shared a bit of my thinking as a part of @contra 's new Creative Intelligence report (dope website btw)
AI is making creativity more valuable than ever before and.. we have 3 years of data to prove it. Introducing the Creative Intelligence 2026 report from @contralabs. Full report: c87.to/creative-intelligence…
19
15
7
274
18,628