Tensors and neural networks in Python with strong hardware acceleration. PyTorch is an open source project at the Linux Foundation. #PyTorchFoundation

Joined September 2016
PyTorch Foundation welcomes its 2026 cohort of 24 ambassadors, representing communities from Nigeria and Burkina Faso to Singapore, India, Romania, Spain, the United Kingdom, and the United States. Each ambassador brings a unique perspective, technical background, and connection to their local community. Together, they are creating more opportunities for people to discover open source AI, develop practical skills, and contribute to the technologies shaping its future. Meet our 2026 ambassadors: Adesina Lekan Samuel (@limitless__100), Soumana Dama, Ronnie Atuhaire, Farah Abdou, Abraham Imani (@imanibahati0), Simanga Comfort Mchunu, Mark Gatere (@gatere_mark), Alpha Romer Cooma, Tsai Li Ming (@tsailiming), Mu Xiaohui, Wang Zhipeng, Sumantro Mukherjee (@BytesOfBinary), Parichay Das, Sudhir Dharanendraiah, Costin-Alexandru Deonise, Ricardo Noriega (@rickynds), Matthew Cossins, Johnny Kozman, Ali Tavallaie (@AliTavallaie), Amr Osama Abdellatif, Özge Çinko, Aditya Mehra, Ali Gowani, Samaresh Kumar Singh. We look forward to seeing what the 2026 PyTorch Foundation Ambassadors will teach, organize, create, and contribute in the year ahead. Read the announcement: pytorch.org/blog/meet-the-20…
2
3
3
24
3,718
The TorchTitan team landed massive improvements in the past year without losing its minimal, extensible ethos. Enhancements include support for SOTA models, dramatic improvements of out-the-box performance at scale, RL support, and new communication features. Read our latest blog to learn more and to get started: pytorch.org/blog/torchtitan-…
10
11
2
121
15,674
We welcome LightSeek Foundation @lightseekorg as a Silver Member of PyTorch Foundation. Its membership deepens LightSeek Foundation’s commitment to building open inference infrastructure with the community. LightSeek Foundation’s TokenSpeed and SMG are PyTorch Ecosystem projects. Read the announcement: pytorch.org/blog/pytorch-fou…
LightSeek Foundation has joined the @PyTorch Foundation as a Silver Member. TokenSpeed and SMG are both PyTorch Ecosystem projects. This membership deepens our commitment to building open inference infrastructure with the community. As our president @zhyncs42 shared: “Efficient inference is essential to making AI accessible at global scale, and we believe the infrastructure behind it must be open.” We look forward to working with the PyTorch community to improve performance, lower costs, and make AI more accessible. Read the announcement: pytorch.org/blog/pytorch-fou…
3
3
1
38
7,342
Congratulations to the 2026 PyTorch Contributor Award winners, recognized today at #PyTorchCon 2026 for their innovation, collaboration, and impact across all PyTorch Foundation projects including PyTorch, vLLM, DeepSpeed, Ray, Helion, and Safetensors. Outstanding Ambassador: Jiho Kim Newcomer: Jiangyun Zhu (@jiangyun_zhu), Johannes Lennart Zeiser Knowledge Enhancer: Abdulsalam Yazid Bande (@abdulsalambande), Suman Debnath (@_sumand) Bug Buster: Guilherme Vieira Leobas, Vishal Goyal Review Powerhouse: Wentao Ye Catalyst: Jiahao Tan, Harry Mellor (@hmellor_) Innovator: Masahiro Tanaka, Elfie Guo, Xinan Lin Ecosystem Champion: Guangye Yu Superhero: Thomas Ortner Nominees: Chandra Mohan Singh Negi, Arun Bhandari, Masahiro Hiramori, Luka Govedič, Irakli Salia, Jiahao Chen, Kunshang Ji, Rohit Kumar Tiwari, Subin George, Xunzhuo Liu, and Aaron Gokaslan. Thank you to Cara Delia (@RedHat) and Chris Gottbrath (Gottbrath Technologies) for presenting the awards, and to Red Hat (@RedHat) for sponsoring them. And thank you to our 2026 Awards Committee: Chris Gottbrath (Gottbrath Technologies), Chris Hoge (@nvidia), Ashok Emani (@intel), Piotr Bialecki (@nvidia), Yashasvi Misra (@CloudNativeFdn), Sudhir Dharanendraiah (@RedHat), Zesheng Zong (@Huawei), Jiawei Li, and Kaichao You (@inferact).
11
1
123
15,714
Wednesday's Demo Theater at #PyTorchCon features 13 presentations on training, inference, hardware enablement, and agentic workflows. All sessions are in the Community Expo on the Concourse Level. 10:40–10:50 AM: Maen Suleiman (@awscloud) demos reinforcement learning on Trainium through TorchNeuron, the native PyTorch backend for AWS Trainium, with TorchTitan training, vLLM-Neuron generating rollouts, Monarch orchestrating, and TorchStore syncing weights. 10:55–11:05 AM: Ali Taha (@baseten) breaks down how Wan 2.2 generates a five-second video in under three seconds, a 53.6x improvement over baseline, using timestep distillation, custom kernel engineering, and four-bit quantization. 12:20–12:30 PM: Rain Jiang and Kevin Li (@verdacloud) demo WideEP for expert-parallel MoE inference on an NVIDIA NVL72 system, using a Rust-based frontend to run and monitor the workload. 12:35–12:45 PM: Tristan Webb (@dMatrix_AI) presents dmx-compressor, a PyTorch 2.0 based quantization framework that gives ML engineers numerical reference output to validate models running on ASIC hardware. 12:45–12:55 PM: Lin She (@clockworkio) demos surviving link and node failures in PyTorch training live, with LinkPass and TorchPass keeping the job running on the same training step. 1:00–1:10 PM: Ashok Emani and Qiacheng Li (@intel) show AI Playground Home Agent, which runs PyTorch AI workflows on an Intel AI PC and lets you use them from your phone. 1:15–1:25 PM: Zesheng Zong (@Huawei) presents CRCR (Cross-Repository CI Relay) for joint testing between PyTorch pull requests and accelerator backends, catching regressions at the PR phase. 1:30–1:40 PM: FNU Harsh and Sarah Ahmed (@LightningAI) demo an agent reproducing ML research on Lightning, showing where it succeeds autonomously and where it needs intervention. 1:45–1:55 PM: George Novack (@inferact) introduces TPU megakernels, with Kimi K3 megakernels running inside vLLM-TorchTPU. 2:00–2:10 PM: Jay Dawani (Lemurian Labs) examines why heterogeneous computing is so hard and what a hardware-agnostic stack has to get right. 2:15–2:25 PM: Minwook Ahn (@RebellionsAI) shares how extending PyTorch's device abstraction to support device-persistent tensors minimizes data movement between host and device. 2:30–2:40 PM: Jesse Treger (HPE) introduces OpenCLIC, an open inference communication framework for connectionless networks that is being integrated with vLLM. 3:55–4:05 PM: Mengjin Yan and Joshua Lee (@anyscalecompute) cover evolving Ray Core for post-training at scale, from scaling Ray's scheduling to 10,000-node clusters to moving PyTorch tensors directly between GPUs with Ray Direct Transport. View the Demo Theater schedule: events.linuxfoundation.org/p…
2
2
15
3,887
PyTorch retweeted
vLLM 🤝 TPU 🚀 Native PyTorch serving on TPUs is here! Built with @Google and @inferact, vLLM-TorchTPU brings familiar PyTorch tools to TPU inference, with prefix caching, speculative decoding, and disaggregated serving. 🛠️ Excited to keep building with the community!
Native PyTorch on TPUs is here—and TorchTPU is officially open source. Train and serve models using the tools you already know: @vllm_project, @sgl_project, @_llm_d_, TorchTitan, @huggingface, and @raydistributed. Learn more from #PyTorchConf2026 → goo.gle/4hWxEVH
5
25
3
205
18,930
FlyDSL, an open source Python kernel DSL, now plugs into PyTorch on @AMD MI350-series GPUs via torch.compile and eager mode. Up to 1.68x geomean scaled GEMM kernel speedups and up to 3.01x end-to-end #vLLM serving speedups. Read more: bit.ly/3W1zwUv
5
14
5
104
13,262
TorchTPU enables seamless out-of-the-box model execution and TPU migration while delivering industry-competitive inference and training performance through eager execution optimizations, torch.compile integration, & native hardware acceleration. Learn more on the PyTorch blog: pytorch.org/blog/introducing…
Native PyTorch on TPUs is here—and TorchTPU is officially open source. Train and serve models using the tools you already know: @vllm_project, @sgl_project, @_llm_d_, TorchTitan, @huggingface, and @raydistributed. Learn more from #PyTorchConf2026 → goo.gle/4hWxEVH
1
11
1
98
8,938
PyTorch retweeted
Nebius is proud to join the @PyTorch Foundation as a Platinum Member. Ryan Hanrui Wang (@hanrui_w), our SVP Applied AI, joins the Governing Board and Technical Advisory Council. Many teams on Nebius train and serve models with @PyTorch and @vllm_project, and we're a compute sponsor of vLLM, supporting its development, testing, and benchmarking. We look forward to working with the community on faster training, more efficient inference, and a shorter path from research to production! Read more: prnewswire.com/news-releases…
1
4
1
94
6,190
Yiwei Song (@CrusoeAI) shares the vision and progress behind Crusoe’s LLM post-training platform at #PyTorchCon 2026. The goal is to help customers customize open weights models for their business use cases to improve accuracy and reduce inference cost. Yiwei outlines the customization lifecycle: start with a strong base model, inject domain knowledge, align to tasks and preferences, make the model smaller and faster to serve, and deploy it in production. He presents Crusoe Managed RL as a Tinker API-compatible post-training platform, with customers deciding what to learn while Crusoe runs the GPUs. Watch the keynote livestream: events.linuxfoundation.org/p…
4
20
4,644
Rachad Alao (@cohere) examines how open science can support transparent and secure AI foundation model development at #PyTorchCon 2026. Rachad argues for publishing model architectures, training strategies, parameter choices, and evaluation methodologies, alongside an evidence-based risk framework, independent auditing, continuous monitoring, and dynamic safeguards. He discusses how PyTorch, TorchTitan, and @vllm_project support model development and inference optimization when models are open and accessible, and how access to internal representations enables research in retrieval, reasoning, and multilingual AI.
3
3
15
4,060
Zhipeng Wang (@Google) shares technical advances from the @DeepSpeedAI team for large-scale model training at #PyTorchCon 2026. Zhipeng highlights model-systems co-design and optimizations that enable DeepSpeed to deliver high performance across diverse model architectures, workloads, and accelerator platforms. Highlights include AutoSP for automatic sequence parallelism, Muon optimizer support, and AutoTP and AutoEP for Hugging Face models. He discusses the continued development of the DeepSpeed open source community and collaboration with model developers, hardware vendors, and AI infrastructure partners to expand adoption and enable emerging large-scale AI workloads.
1
2
21
6,299
Priya Nagpurkar (@IBM) shares how IBM and @RedHat contribute across the PyTorch ecosystem in “From Silicon to Models at Scale” at #PyTorchCon 2026. Priya highlights work bringing IBM Spyre to the PyTorch compiler and vLLM, how AI tools help scale model enablement to thousands of models, and a look ahead at next-generation Spyre hardware. She discusses Red Hat’s contributions to PyTorch and CI/CD infrastructure for out-of-tree accelerators, helping hardware backends keep pace with the community, alongside work with the llm-d community toward efficient distributed inference at scale.
2
4
20
3,852
Bill Jia (@GoogleCloud) and Zongwei Zhou (@Meta) introduce TorchTPU, a native PyTorch backend for Google TPUs, and agentic developer workflows at #PyTorchCon 2026. TorchTPU is an open source collaboration between Google and Meta, developed in close partnership with PyTorch core maintainers. It integrates with Hugging Face Transformers for modeling, TorchTitan for training, and vLLM and SGLang for serving. They demonstrate how long-horizon agentic workflows can migrate complex model workloads from GPUs to TPUs. They explore using agents for performance optimization, including quantization, custom kernel generation, and advanced sharding strategies. Watch the keynote livestream: events.linuxfoundation.org/p…
4
6
68
7,549
How can LLMs learn from what agents do? At #PyTorchCon 2026, Mazin Gilbert, Executive Director of @AgenticAIFdn, examines the relationship between models and agents. Mazin maps five layers of the agentic stack: hardware infrastructure, software infrastructure, intelligence, the agentic platform, and user applications. He places PyTorch at the intelligence layer and Agentic AI Foundation at the agentic platform layer. He proposes designing the stack in both directions: models support agents, while agent traces, evaluations, environments, and rewards feed back into how models are built. As an open research direction, Mazin describes turning agent evaluations into rewards for training in PyTorch, accounting for safety, task completion, precision, efficiency, and energy use. Watch the keynote livestream: events.linuxfoundation.org/p…
1
1
1
14
4,086
PyTorch Foundation Executive Director Mark Collier @sparkycollier opens Day 2 of #PyTorchCon 2026 with “Building What’s Next in Open Source AI.” Mark looks ahead to broader hardware participation, workloads moving across more environments, and training and customizing frontier models at greater scale. Returning to the vision of open source software to train and serve models on any chip, in any cloud, for any agent, he discusses how AI itself is beginning to change how these systems are built and improved, creating opportunities and challenges for the community. The morning explores agentic AI, workload fungibility, the evolution of inference hardware, scaling large-scale frontier models, contributor recognition, and open science. The focus is on the role open collaboration can play in expanding who can build, contribute, experiment, and shape the future of intelligence, so progress continues to come from many people, projects, and organizations. Watch the keynote livestream: events.linuxfoundation.org/p…
1
1
12
3,215
PyTorch retweeted
1st talk at @PyTorch: Paul Chang and Erik Schultheis on NVFP4 Training Tips and Tricks, 🗓️ Wed Oct 21 4:20 PM What they learned training dense LLMs on GB300 at 4-bit: hyperparameters, optimisers, and recipes Save it in the calendar: events.linuxfoundation.org/p…
1
6
2,221