
@ucberkeley @novaskyai | prev @thrivecapital
SF, CA
Joined June 2022
- Tweets298
- Following1.3K
- Followers609
- Likes3.8K
Dev Patel retweeted
1/8 Excited to announce the release of SkyRL v0.5.0!
Some highlights:
- Support for Beam-1.0, DeepSeek-V4.1-Flash, Qwen3.8-Flash-Next
- Score centering for stable RL with 4-bit rollouts
- 1M-token context training for GLM-5.3-Flash + optimizer offload to disk
- A native On-Policy Distillation (OPD) trainer
- Better VLM training: sequence packing, context parallelism and images in agentic RL
Blog: blog.skyrl.ai/blog/skyrl-v0-…
Details in 🧵
Dev Patel retweeted
Excited to announce Day-0 support for Inkling 2 Small from @thinkymachines on SkyRL!
We’ve validated full MXFP8, BF16 and LoRA RL with @vllm_project and Megatron.
Really excited about the customizability results and to see how the OSS community uses Inkling2!
Inkling 2 Small’s weights are now available for download on HuggingFace under an Apache 2.0 license.
Make Inkling your own!
huggingface.co/thinkingmachi…
Super excited to share this work from our AWS FDE team! 🚀
With AgentCore RL Toolkit (ART) + SkyRL (@NovaSkyAI), a 9B SWE-Grep agent beats Claude Sonnet 5 on line F1 across two code-retrieval benchmarks after 30 RL steps.
See it in action. 👇 1/6
Dev Patel retweeted
Lots of great topics. This covers
- SkyRL at Mercor
- What’s new in SkyRL
- 1M-context training
- Token-in token-out
- Ray Sandboxes
- Harbor
- Terminal-Bench
We're hosting an RL / data / SkyRL meetup with @mercor and @harborframework next Thursday in SF. Come join us!
luma.com/rl-data
Dev Patel retweeted
Super excited to share some of the work I’ve been doing on supporting 1M token context training on SkyRL for GLM 5.3 Flash, 64x higher than the out of the box Megatron baseline! 🚀
This work was done in collaboration with the amazing folks at @LilaSciences! 🤩
Getting there took key algorithmic and systems optimizations in four main areas:
1) DeepSeek Sparse Attention: run DSA on a sparse kernel; chunk and shard its quadratic indexer.
2) Activation recompute and offloading: recompute activations in backward and offload saved inputs to CPU.
3) Context parallelism: split each sequence across GPUs, with new CP support for KDA and a fix for DSA.
4) Avoiding unnecessary precision upcasts: keep FP32 copies out of memory and off the network.
For more details on our implementations and our results, check out our full technical blog here: blog.skyrl.ai/blog/1m-contex…!
This work benefited from the contributions of many people along the way. Big thanks to @pcmoritz, @erictang000, @sumanthrh, @CyrusHakha, @richliaw from @anyscalecompute and Keith Truongcao, Tushar Khot, Vivek Subramanian, Semih Kara from Lila Sciences for all the help and guidance!
Dev Patel retweeted
Choosing the right AI model is an operating decision.
Today, we’re sharing our first set of benchmarks drawn from work across the 75+ accounting and IT services firms that make up Thrive Holdings.
We believe the field needs more benchmarks tied to economically valuable work, so builders can understand where models are useful in real-world environments.
We use these tests to help us compare model configurations and choose which models our systems run on, with the goal of delivering better service to our customers.
We’ll add to the benchmarks as we build new products and expand to additional industries.
evals.thriveholdings.com/
Dev Patel retweeted
Meet Scout 1.0, our first AI model built for investigating production incidents.
Scout matches frontier-model investigation quality at a fraction of the cost, which makes it practical to investigate more issues, earlier.
We trained Scout on realistic simulations built from real-world incidents and production telemetry, using reinforcement learning to reward accurate root causes backed by evidence.
Learn more and sign up for the preview: bit.ly/3TJknGO
Dev Patel retweeted
Announcing the beta release of the Pi API. We’ve partnered with companies across diverse industries to adapt our models to their robots and applications, from harvesting strawberries to assembling servers. Now we’re opening access to more teams.
Dev Patel retweeted
We were able to fine tune an open weight model (Qwen3.5-9B) on proprietary internal data at @coinbase, and it out performed frontier models, at much lower cost and speed, for a specialized task (fraud prevention in this case).
I think we'll see more of this pattern inside companies. The frontier models are amazing generalists. But increasingly you'll see specialist models out perform on more narrow tasks, either working on teams, or by themselves.
We're making it easy to fine tune models internally for our employees. We even have a skill for it in our internal harness that makes it easy to spin these up and start training them:
"/fine-tune-and-serve-llm I want to fine-tune Qwen for payments risk review. help me get started"
I imagine we'll have some backend services that could be replaced entirely by this new architecture.
Dev Patel retweeted
Read more about our experiment using SkyRL here: afterquery.com/blog/improvin…
To learn more about our tasks and reward design, reach out to us at [email protected]
Dev Patel retweeted
Not all coding data is created equal.
Using only 500 tasks from @AfterQuery's SWE agent dataset, our internal post-training team was able to improve Qwen3.8-27B-Medium by 11.3 points in only 15 steps of GRPO.
Read more about our training experiment in the blog post linked in the comments.
Dev Patel retweeted
Wanted to share a method for information discovery with Codex App I've been using for the past 4 months that has brough me a lot of value, that is not talked about much docs.google.com/document/d/1…
Dev Patel retweeted
Babe, wake up, there are polynomial improvements to 3SUM and ASPS, disproving a bunch of conjectures.
arxiv.org/abs/2610.06783
Dev Patel retweeted
And that’s the story! Along the way, we’ve upstreamed several OSS contributions that you can find in SkyRL.
If you’re interested in learning more, read the full write up here: trajectory.ai/field-notes/en…
Here's to many more expeditions 🧭
Dev Patel retweeted
SkyRL v0.4.0 enables large scale RL training with features like top-p sampler replay, R3, and FP8 RL on new models like GLM 5.3 Flash from @Zai_org!
Excited to announce the release of SkyRL v0.4.0!
Some highlights:
- Support for GLM 5.3 Flash, GLM 5.3, and Kimi K2.7
- Top-P sampler replay and optimized R3 data transfer
- Full FP8/MXFP8 RL
- Sharded P2P weight transfer
Blog: blog.skyrl.ai/blog/skyrl-v0-…
Details in 🧵
Dev Patel retweeted
Excited to announce the release of SkyRL v0.4.0!
Some highlights:
- Support for GLM 5.3 Flash, GLM 5.3, and Kimi K2.7
- Top-P sampler replay and optimized R3 data transfer
- Full FP8/MXFP8 RL
- Sharded P2P weight transfer
Blog: blog.skyrl.ai/blog/skyrl-v0-…
Details in 🧵
post-training infrastructure is hard. there's many pitfalls possible + you're often working under limited gpu constraints. it's critical to find and resolve stability issues with minimal compute.
@trajectorylabs just enabled frontier-scale post training for the glm 5.3 family, including a 29.4x speedup in adapter sync time. we came up with some great tricks to make this exploration efficient!
shout out to the incredible @hersh_godse and @j316chuck for leading this work, and to @avigyabasnet and skyrl team for their collaboration! our changes are upstreamed to skyrl. if you have gpus, go try it out!
Had a lot of fun working on low-rank adapter initializations at @trajectorylabs with @j316chuck ! Initializing the adapter with the top-k SVD components has been known to benefit SFT (PiSSA, 2024), and we show now that it also helps improve downstream RL training (credit to @johnschulman2's Lora Without Regret blog for first suggesting this idea).
Encourage you all to go check out our blog, we worked hard to make some clear visuals to show why initializations matter. And you can run our experiments for yourself through SkyRL. Shoutout to @erictang000 and the @NovaSkyAI team for their support with merging this code in!
There's a lot of directions left to try, LoRA-GA seems promising, and for alignment, there might be something interesting with selecting directions orthogonal to those important for alignment. Would love to hear people's thoughts down below!
Dev Patel retweeted
Today, we're announcing @thatch_ai raised a $108M Series C at a $1B valuation from @thegp, @IndexVentures, @generalcatalyst, @a16z.
The idea we're betting on: healthcare serves whoever controls the dollar. For 80 years that's been the employer. We think it should be you.
Employers typically choose one health plan for everyone. We think there's a better model: give people a health budget and let them choose the insurance and care that fits their life. That is the idea behind Thatch.
ARR has grown nearly 7x in the last twelve months, and more than 5,000 employers now use Thatch. None of this happens without our team, or without the employers who believe that their people know what their families need better than they ever could.
We're building a healthcare system people love by changing how we fund it.
Today, we’re announcing that Forus has raised a $150M Series C at a $3B valuation to build the AI network for medicine.
The round was led by @BainCapVC with participation from @ThriveCapital, @generalcatalyst, @Accel, @Redpoint @BoxGroup, @pearvc, @AvraCap, @humancapital, @neo, @vast_ventures, and @svangel
Forus supports millions of people across all 50 states and is already used by providers to treat patients in 85% of U.S. residential ZIP codes. 9 of the top 15 global biopharma companies work with us, alongside many fast-growing biotechs.
Our goal is to put Forus in every doctor’s office in the country and accelerate the medicine pipeline from discovery to treatment.
The opportunity ahead of us is much larger than what we can take on today. We aren’t constrained by capital or customer demand. We are constrained by the talent and capacity of our team.
We’re hiring exceptional engineers and operators in New York to help us take it on. Come build with us.
🤖 Made with AI


























