
Research & Engineering @togethercompute; Ex @YandexResearch; Building Products; Sapere aude!
Dublin
Joined June 2020
- Tweets139
- Following438
- Followers190
- Likes1.4K
Better AI for global work starts with better training.
Deel’s Pangaea K1 model is trained on 43,500+ pages of expert knowledge and fine-tuned on @togethercompute.
The result: faster, more accurate answers for teams everywhere. Thanks for the partnership.
.@deel’s data science team went from setup to real rl experiments on together post-training in a couple of hours
they then ran up to five experiments at once on the same gpu capacity
more experiments per gpu means a much faster iteration loop
together.ai/post-training
Ivan Provilkov retweeted
RL with LLMs is very unstable when training and sampling policies differ. Standard fixes (matching numerics, importance sampling) work around the problem.
We find the root cause of this instability from first principles and propose a way to directly cancel it. Score Centering is competitive and compatible with existing approaches — while simple to implement!
🧵 [1/6]
Ivan Provilkov retweeted
We @togethercompute believe intelligence should be abundant, not expensive.
Today we announced our Series C funding of $800m @ $8.3B valuation, to continue to build the world's most efficient platform for generative AI.
Thanks @nikogallogly for telling our story in @nytimes!
shorturl.at/SooOP
🇪🇺eu/acc
After 2 years in existence, the first 4 points of the @euacc manifesto, which was crowdsourced by all of you, are now passed as laws
That means 1/3rd of eu/acc's points is complete:
✅ 1. Reduce regulatory burden for startups
✅ 2. Make skilled immigration easier, unskilled harder
✅ 3. Repeal the cookie law
✅ 4. European Inc: a single pan-EU business entity
Now for the next 8 objectives:
🔲 6. Tax discount during startup phase
🔲 7. Tax stock options when sold, not when exercised
🔲 8. Embrace AI and technology, don't fight it
🔲 9. Champion free speech, don't censor it
🔲 10. Reform bankruptcy laws to empower entrepreneurs
🔲 11. Make English the primary language of the European Union
🔲 12. Teach AI and tech in European schools and universities
Ivan Provilkov retweeted
Together Fine-tuning now supports tool calling, reasoning, and vision-language model fine-tuning. Train models up to 1T parameters with up to 6x higher throughput on MoE architectures.
Ivan Provilkov retweeted
2/ Together Evaluations is a unified framework for assessing LLM quality. Team can:
• compare open models to OpenAI/Anthropic/Google
• make better decisions on prompting vs. fine-tuning
• track quality improvements over time
read more: together.ai/blog/together-ev…
Ivan Provilkov retweeted
I used to think Sapiens was a great book. Sweeping, provocative, the kind of book that makes you feel like you finally understand the big picture of human history. It's on every CEO's bookshelf, assigned in universities, praised as a masterwork of synthesis. Yuval Noah Harari is treated as one of the serious thinkers of our time.
But something nagged at me. Some passages felt off. Claims that human rights are just figments of our collective imagination, not real things, just stories we tell ourselves. That nations, laws, money, justice, doesn't exist outside our heads. That meaning itself is a delusion we've invented to cope. That we're far more powerful than ever before but not happier. That hunter-gatherers had it better because they had no dishes to wash, no carpets to vacuum, no nappies to change, no bills to pay.
That sounded depressing to me, but was perhaps just the realistic scientific worldview? What it meant to see the world clearly, without comforting illusions.
Then I read The Beginning of Infinity by @DavidDeutschOxf. Deutsch has a concept he calls 'bad philosophy.' Not philosophy that's merely false, but philosophy that actively prevents the growth of knowledge. Ideas that close doors rather than open them. That makes problems seem unsolvable by design.
After soaking in Deutsch's framework (it's dense, a bit like digesting a delicious whale), it becomes clear: Harari's books are riddled with bad philosophy. They're smuggling nihilism in under the guise of scientific objectivity. Some examples:
On meaning: "Human life has absolutely no meaning. Humans are the outcome of blind evolutionary processes that operate without goal or purpose... any meaning that people inscribe to their lives is just a delusion."
On human rights: "There are no gods in the universe, no nations, no money, no human rights, no laws, and no justice outside the common imagination of human beings."
On free will: "Humans are now hackable animals. The idea that humans have this soul or spirit and they have free will, that's over."
On progress: "We thought we were saving time; instead we revved up the treadmill of life to ten times its former speed." The Agricultural Revolution? "History's biggest fraud." We didn't domesticate wheat, "it domesticated us."
On our cosmic significance: "If planet Earth were to blow up tomorrow morning, the universe would probably keep going about its business as usual. Human subjectivity would not be missed."
On the future: "Those who fail in the struggle against irrelevance would constitute a new 'useless class.'" Homo sapiens will likely "disappear in a century or two."
This is bad philosophy. It tells us our problems are cosmically insignificant, our solutions are illusions, and that progress is neither desirable nor within our control. It's also perfect nonsense. No one would ever go back to being hunter-gatherers. Would you rather worry about your kid spending too much time on Roblox, or face the 50% chance she won't reach puberty?
And our so-called "fictions"? They ended slavery. They gave women equal rights. They solved hunger. They eradicated smallpox. They turned sand into computer chips. They got us to the moon, and hopefully soon, to Mars and beyond. These "fictions" are already reshaping the universe, and over time they may become the most potent force in it.
Now compare Deutsch:
"Humans, people and knowledge are not only objectively significant: they are by far the most significant phenomena in nature."
"Feeling insignificant because the universe is large has exactly the same logic as feeling inadequate for not being a cow."
"Problems are soluble, and each particular evil is a problem that can be solved."
"We are only just scratching the surface, and shall never be doing anything else. If unlimited progress really is going to happen, not only are we now at almost the very beginning of it, we always shall be."
Where Harari sees a species of deluded apes stumbling toward obsolescence, Deutsch sees universal explainers, the only entities we know of capable of creating explanatory knowledge, solving problems, and potentially seeding the universe with intelligence.
The difference isn't academic. Ideas shape action. If you believe life is meaningless, progress is a trap, and humans are hackable animals with no free will, how does that affect what you build? What you fight for? What you teach your children?
Harari's books sell because they flatter a fashionable pessimism. They let readers feel sophisticated for seeing through the "delusions" everyone else lives by. That smug cynicism is corrosive. And it's everywhere: in schools, in media, in bestselling books. More than half of young adults now say they feel little to no purpose or meaning in life. This is what happens when you teach an entire generation bad philosophy. Less progress, less health, less wealth. Less flourishing. And ultimately, a higher chance that civilization and consciousness go extinct.
Fortunately, there's another equally well-written, but much truer, account of homo sapiens, appropriately titled 'The Beginning of Infinity'. And this one smuggles no despair in by the backdoor. But let's give Harari credit where it's due. He is right about one thing: if planet Earth blew up tomorrow, we wouldn't be missed. Because there'd be no one left to miss us, just a careless universe, blindly obeying physical laws. We are the only ones who can miss, but we're not going to. We're going to aim, hit, and keep going.
Full credit for the amazing meme to @Ben__Jeff
Ivan Provilkov retweeted
No verifiers? No problem. 🤝
The Together Research team is excited to introduce RARO — a new paradigm that unlocks scalable reasoning.
By teaching LLMs to reason through adversarial games, we're seeing promising results where standard RL fails.
Check it out now and let us know if you're interested in trying RARO to train reasoning models: forms.gle/Rrrs52MZHJZVuHo49
Ivan Provilkov retweeted
excited to be partnering with amazing folks @togethercompute, @zainhas and @provilkov to bring dynamic agent simulations to together evals.
Together AI 🤝@CollinearAI
Introducing TraitMix, Collinear’s simulation product empowering teams to generate persona-driven AI agent interactions.
🔌Plug these interactions into your workflows and evaluate their effectiveness with Together Evals. Details: bit.ly/43GHJhR
Ivan Provilkov retweeted
🚀Now you can fine-tune LLM's from the @huggingface hub using @togethercompute!🔥
• Public + private repos
• CausalLMs <100B params
• Push tuned models back to the Hub
Smaller, open models + smart fine-tuning > bigger closed ones.
Link below👇
Ivan Provilkov retweeted
🚨 Stop shipping LLMs blind.
Together Evaluations is here — fast, flexible, LLM-as-a-judge-based benchmarking to:
✅ Compare model outputs
✅ Score responses against your own criteria
✅ Classify outputs into custom labels — from safety to sentiment
Run our early preview today with any serverless model — more support coming soon.
Learn more (links below!)
Ivan Provilkov retweeted
Announcing DeepSWE 🤖: our fully open-sourced, SOTA software engineering agent trained purely with RL on top of Qwen3-32B. DeepSWE achieves 59% on SWEBench-Verified with test-time scaling (and 42.2% Pass@1), topping the SWEBench leaderboard for open-weight models.
Built in collaboration with the @Agentica_ team.
💪 DeepSWE is trained with rLLM, Agentica’s modular RL post-training framework for agents. rLLM makes it easy to build, train, and deploy RL-tuned agents on real-world workloads — from software engineering to web navigation and beyond.
🤗 As always, we’re open-sourcing everything: not just the model, but the training code (rLLM), dataset (R2EGym), and training recipe for full reproducibility.
🔥 Train DeepSWE yourself. Extend it. Build your own local agents. No secrets, no barriers.
DeepSWE and rLLM mark our major shift: from training language reasoners to building language agents that can truly learn from experience.
We believe the future of AI lies in experience-driven learning — and we’re here to democratize it.
Welcome to the era of experience. 🌍
Ivan Provilkov retweeted
.@togethercompute is building 2 gigawatts of AI factories (~100,000 GPUs) in the EU over the next 4 years with the first phase live in H2 '2025.
AI compute is at <1% saturation relative to our 2035 forecast and we are starting early to build a large-scale sustainable AI cloud in the US and abroad with global partnerships.
European companies can reserve this capacity today: together.ai/gpu-clusters
Our blog:
together.ai/blog/together-ai…
Data Center Dynamics Coverage:
datacenterdynamics.com/en/ne…
Ivan Provilkov retweeted
🛠️ Your AI models shouldn’t be static—they should evolve with your users.
Introducing Together Fine-Tuning with Direct Preference Optimization & Continued Training: build custom models that continuously adapt.
Details below 👇
Ivan Provilkov retweeted
Welcome to ZuGrama!!!
A 6-week residency in Kerala where builders, learners, and dreamers come together to create the future. 🏡
Themes & Tracks:
⚖️Governance : Jan6 - Jan 12
🚚Impact & Public goods : Jan 13 - Jan 19
⚕️Longevity : Jan 20 - Jan 26
(Biotech , Desci)
💻Deeptech Jan 27 - Feb 2
🤖AI : Feb 3 - Feb 9
💸Cryptography Feb10 - Feb16
⏰ Applications close in just 5 days!
So hurry up those are still on the sidelines
🔗 zugrama.org/
If you had 6 weeks to innovate on a problem, what would you build? 🛠️
Reply us in the comments below ⬇️
The best idea is in for a surprise 🎁
🌴✨ Cultural Amalgamation Meets Tech Innovation!
For 6 weeks, Kerala’s serene beauty 🌊 will host the brightest minds in tech:
👩🎓 Students: Build, innovate, & learn.
💼 Professionals: Brainstorm, connect with founders, & launch impactful projects.
A blend of tradition & tech awaits.
Join us at #ZuGrama! 🚀
#Kerala #AI #DeSci #CryptoCommunity #Biotech #longevity #Governance
Also do check with communities in your region to know more about us. Thanks to their support to help spread the word on Innovation & technology.
@FoundershipHQ @blockchainedind @pune_dao @Web3_kerala @Web3Panjab @0xRabble @hyderabaddao @Lucknow_DAO @Web3Chennai @web3meetups @Web3Assam @ActualOnexyz
Appreciate some 🫶 by sharing it in your network & circles.
Ivan Provilkov retweeted
THE TECHNO-OPTIMIST MANIFESTO part 1
“You live in a deranged age — more deranged than usual, because despite great scientific and technological advances, man has not the faintest idea of who he is or what he is doing.”
— Walker Percy
“Our species is 300,000 years old. For the first 290,000 years, we were foragers, subsisting in a way that’s still observable among the Bushmen of the Kalahari and the Sentinelese of the Andaman Islands. Even after Homo Sapiens embraced agriculture, progress was painfully slow. A person born in Sumer in 4,000BC would find the resources, work, and technology available in England at the time of the Norman Conquest or in the Aztec Empire at the time of Columbus quite familiar. Then, beginning in the 18th Century, many people’s standard of living skyrocketed. What brought about this dramatic improvement, and why?”
— Marian Tupy
“There’s a way to do it better. Find it.”
— Thomas Edison
Lies
We are being lied to.
We are told that technology takes our jobs, reduces our wages, increases inequality, threatens our health, ruins the environment, degrades our society, corrupts our children, impairs our humanity, threatens our future, and is ever on the verge of ruining everything.
We are told to be angry, bitter, and resentful about technology.
We are told to be pessimistic.
The myth of Prometheus – in various updated forms like Frankenstein, Oppenheimer, and Terminator – haunts our nightmares.
We are told to denounce our birthright – our intelligence, our control over nature, our ability to build a better world.
We are told to be miserable about the future.
Ivan Provilkov retweeted
Committing for a Novel Prize. Thread.
The reality is the following: you invest money for web3 project to do some fun and $$$$.
But there is something more that just to make money. It is to solve a big. Really big pain of almost 40% worldwide population
Thread >>
Ivan Provilkov retweeted
Exciting news! Today we launch @suggesty_ai, an AI keyboard for iOS. Now you can fix your grammar and get message drafts in seconds. Of course, it's powered by GPT-3.
Would you like to try? Like & RT!

























