Software Developer @Google, Composing Android Automotive ex Dev-Rel #Android #MaterialDesign #JetpackCompose Opinions are my own. https://nitter.gq/t.co/FbzO31YSpW
Germany
Joined July 2012
- Tweets2.4K
- Following458
- Followers3.1K
- Likes9.5K
Gurupreet singh retweeted
What a day! I tested Gemini 4 Carbon on real work. 2 repos, 105 replanted bugs. Find and fix what you can.
It scores just behind Fable 5.2. The results:
- Fable 5.2 (max): 58 for $139.65
- Gemini 4 Carbon (high): 57.3 for $31.32
- Sonnet 5.5 (max): 51.3 for $154.03
- GPT-6 Astra (max): 45 for $33.03
- GPT-6.1 Sol (max): 44.3 for $5.88
- Gemini 4 Argon (high): 40.7 for $7.16
Google's own benchmarks looked super strong, but nobody could access the model. Turns out they didn't lie: +16.6 points over Argon, at less than a quarter of Fable 5.2's cost.
Nobody should be laughing at Google anymore.
(the next effort level drops soon in the thread 🧵)
Gurupreet singh retweeted
Sharing early evals on Gemini 4 Carbon. Strongest model that we've seen so far for long-form research and answer quality, with a new SoTA on the Wide-And-Deep-Research (WANDR) benchmark. Coming soon to all Perplexity Pro and Max users inside Computer, once we have sufficient token capacity. Congrats @GoogleDeepMind!
Gurupreet singh retweeted
Google's latest model (which is announced but not publicly available yet) just jumped into the lead. Everyone talks about Google dropping the ball. I keep saying over and over again, never count out Google.
Introducing Gemini 4 Carbon, it's a big jump over Argon which we released just 2 weeks ago.
Gemini 4 Carbon is SOTA on cyber, long horizon tasks, ranks #1 on Artificial Analysis V5, significantly improves on usability in domains like coding, and is more aligned.
Gurupreet singh retweeted
Genie 4 is pretty impressive. I find the visuals to be very realistic and high-quality. The ability to prompt anything into the world and have it just appear opens up all sorts of possibilities to steer a scene in whatever direction you want.
I found it really difficult to control the object on the screen, the monkey, the car, and the bi-plane all sort of ignored my attempts to steer them. There was also some temporal coherence issues where I'd turn around and face a different direction and then return to my original position and things would have changed. The Mustang, for instance, changed directions when I turned around. When it drove off later in the scene, it turned into a taxi... Little things like that change over time.
Visually, however, it's really impressive. (IMO)
Gurupreet singh retweeted
We got GTA Waymo before GTA 6
(this is fully interactive real-time video from Genie 4)
Gurupreet singh retweeted
Had early access to Genie 4 from @GoogleDeepMind.
This is a fully generated, interactive world from a single starting prompt (environment + character) 🤯
Feels like a massive step forward - you can now prompt to change the world and interact with it. With native audio!
Gurupreet singh retweeted
This is Genie 4, our most realistic and interactive world model yet. 🌐
Explore dynamic environments in real time to see how the scene responds, sounds, and how the people in it move, react, and speak.
Gurupreet singh retweeted
Gemini 4 Argon is underrated 😱.
When auditing the traces, we found that Pi Harness just ends the run whenever it hits a fallback (e.g. for security task) in 20% of the runs. We rerun Argon with Antigravity Harness, and now it beats Astra and sits right behind Opus 5.5. Congrats to the team @GoogleDeepMind and looking forward to the new ckpt.
Gurupreet singh retweeted
Congrats to @GoogleAI's Gemini 4 Argon for taking the top spot of our Humanity's Sixth Sense (HSS) benchmark with a score of 55.4%, edging out GPT-6-Astra at 53.6%. 🥇
HSS tests AI’s ability to reason beyond what’s visible, from hidden objects to predicting what happens next and understanding human behavior.
We took a closer look at performance across categories, and that’s where things get interesting. 👀🧵
Gurupreet singh retweeted
I have to admit, watched this a few times, especially to the end:) the creativity in the prompting and the model is awesome to see
Gurupreet singh retweeted
This is crazy! One of the best demos of Gemini 4 Argon, showing what it's capable of.
Gemini 4 Argon taught a robot to play cornhole just by watching a video.
Gurupreet singh retweeted
Wow Google has really impressed me, Gemini 4 I was expecting to be a benchmaxxed trash model but it actually competes with the current frontier like 6.1 sol, opus 5.5 etc… Good job on your hard work Google!
Gurupreet singh retweeted
Opus 5.5 vs Gemini 4 Argon
Same prompt.
Same task: build a cinematic 3D animation explaining how a Tesla-style electric motor works.
Which one do you think did better?
Gurupreet singh retweeted
Gemini 4 is HERE.
I've been testing it for about a week and Google is definitely BACK.
Here's a 3D Rube Goldberg machine:
Today we are rolling out Gemini 4 Argon globally in the Gemini API, to Pro + Ultra in Gemini App, and Ultra subs in Antigravity!
Argon is a huge step forward for Gemini, and a labor of love. This model has been battle tested by over 100,000 people at Google over the last month, with so much new innovation, ambition, and hard work baked into this release. The team has been heads down over the last 6 months working to make this possible across the stack (research, infra, safety, eng, etc).
We rolled the model out to cyber defenders as part of our fairwind program and early access customers over the last 2 weeks, it has been amazing to see and talk to folks who are now using this model daily. Seeing the models writing capability, raw knowledge and persistence for coding, paired with new features like 1M token output when the model needs to work more has gotten me even more excited about our path ahead.
This is just the start of the Gemini 4 era. As you saw with 3.5, 3.6, 3.7, and 3.8 Flash, our iteration speed with Gemini is fast : ) Now with Gemini 4 Argon to work from, I am cannot wait to see the progress continue, and most importantly see what this new model enables for the world.
This is such a special moment in the arc of technology, as millions of people everyday tackle problems they could never have thought possible before. Gemini 4 Argon was built to help you tackle the hardest problems. I have personally felt this spark with Argon and hope you do too. Onwards!!