⚡ ICYMI: Registration is OPEN for #pytorchdaychina 2026!
Don't miss this opportunity to connect with the open source AI community! Join us on December 12 in Beijing for a FREE, full-day event dedicated to the #pytorch ecosystem. 🎟️ Registration is required.
Save your seat!
PyTorch
PyTorch is an open-source deep learning library, originally developed by Meta Platforms and currently developed with support from the Linux Foundation. The successor to Torch, PyTorch provides a high-level API that builds upon optimised, low-level implementations of deep learning algorithms and architectures, such as the Transformer, or SGD. Notably, this API simplifies model training and inference to a few lines of code. PyTorch allows for automatic parallelization of training and, internally, implements CUDA bindings that speed training further by leveraging GPU resources. More on Wikipedia
-
PyTorch
@PyTorch
-
PyTorch
@PyTorch
As we welcome our 2026 PyTorch Foundation Ambassadors, get to know:
Ali Tavallaie (@AliTavallaie) · Armenia
Alpha Romer Coma · Philippines
Amr Osama Abdellatif · Egypt
Costin-Alexandru Deonise · Romania
“I believe using AI is like being given a fish; I want to teach people how to fish. PyTorch embodies the beauty of learning how to build and understand AI, and I’m excited to share that beauty with others.” - Ali Tavallaie
“I’m excited to build a Philippine ML community where architectures and ideas come first, and to bring the frontier of PyTorch to Manila through monthly in-person events.” - Alpha Romer Coma
“I am most looking forward to fostering a vibrant, collaborative AI community in the region and empowering the next wave of engineers to build cutting-edge systems on PyTorch.” - Amr Osama Abdellatif
“I believe the future of AI should be built in the open. I’m excited to contribute to the PyTorch community, share what I’ve learned, and help more people turn their ideas into real-world AI solutions.” - Costin-Alexandru Deonise -
PyTorch
@PyTorch
📣 Registration is NOW OPEN for #pytorchdaychina, taking place December 12 at the Alibaba Beijing Chaoyang Science and Technology Park. This is a free, full-day event. Registration is required. Save your seat now and join us for technical talks and interactive discussions exclusively for the #pytorch community >> www.lfopensource.cn/pytorch-day-china/register/
-
PyTorch reposted
Modular
@Modular
Chris Lattner’s #pytorchcon keynote is now on YouTube. @clattner_llvm covers running models across more hardware with Mojo and MAX, and building an open developer ecosystem with @Qualcomm_Dev and @PyTorch.
www.youtube.com/watch?v=2XXf_iL1WhA -
PyTorch
@PyTorch
Watch all the #pytorchcon North America 2026 sessions!
PyTorch Conference North America 2026 brought 3,500+ attendees to San Jose on October 20–21 for two days focused on accelerating open intelligence and exploring the impact of PyTorch Foundation projects like PyTorch, @vllm_project, @DeepSpeedAI, @raydistributed, Helion, and Safetensors.
View our playlist featuring 146 sessions from keynotes to technical deep dives spanning core framework development, model training, inference, applications, kernel engineering, responsible AI, and more.
Watch and share the videos with anyone who might be interested: www.youtube.com/playlist?list=PLVqjs87Mef-UThis media couldn't be displayed. See it on the original post. -
PyTorch
@PyTorch
Fast kernels, without the tuning wait: Helion's new compile-time heuristics automatically choose high-performance configurations, with no autotuning required.
On H100 benchmarks, they beat handwritten Triton kernels for linear-attention forward passes by 18% and vLLM's handwritten CUDA reduction kernels by 27%.
Read the complete technical breakdown to learn more: pytorch.org/blog/fast-by-default-compile-time-heuristics-… -
PyTorch
@PyTorch
Ron Kahn of @nvidia, Andrey Velichkevich of @Apple, Vara Bonthu of @awscloud, Ekin Karabulut of @nvidia, & Manabu McCloskey of @awscloud discuss powering the next era of cloud native AI with an open community at #kubecon + #cloudnativecon today, citing @kubeflow's @CloudNativeFdn graduation with shout outs to PyTorch Foundation projects - @PyTorch and @DeepSpeedAI. The importance of working across foundations is vital for a thriving ecosystem.
-
PyTorch reposted
CNCF
@CloudNativeFdn
Live from the KubeCon + CloudNativeCon keynote stage: @kubeflow is now a CNCF Graduated project!
From distributed training with PyTorch and Spark Operator to the new Agents Working Group and Semantic Operator, Kubeflow bridges data, AI, and Kubernetes without vendor lock-in.
Explore the ecosystem: www.kubeflow.org
#kubecon #cloudnativecon -
PyTorch
@PyTorch
With help from AI coding agents, SGLang was integrated with @IBM Spyre in under a week using a 1,500-line plugin. Reusing existing PyTorch Spyre support and SGLang extension points delivered roughly 3.6x the throughput of the reference torch-spyre implementation.
Performance matched vLLM across Granite 3.3 8B and Gemma 4 26B A4B workloads, with RadixCache prefix sharing working out of the box without hardware-specific changes. This shows how open source AI standards and modular architectures allow developers to bring new silicon online quickly and expand hardware choice across the stack.
Read the full technical breakdown: pytorch.org/blog/integrating-sglang-into-spyre-in-under-a…
@gal_bloch @RaghuGanti @mudhakar @alxnails -
PyTorch
@PyTorch
Thanks to PyTorch and TorchTitan, the Domyn Team successfully scaled up the training of a 1 trillion parameter MoE on Jupiter, a shared EuroHPC supercomputer, in the context of the European Frontier AI Grand Challenge
Per-GPU throughput on 384 GH200 GPUs per replica rose from 90 to ~1,300 tokens/s
Learn about all the details and the upstream contribution on PyTorch and TorchTitan: pytorch.org/blog/training-a-1t-parameter-moe-on-eu-public…
@domynai -
PyTorch
@PyTorch
You don't measure an open source ecosystem in GitHub stars. You measure it by who still shows up on the day Beijing gets its first snow.
On Nov 7, Ascend for PyTorch Meetup brought maintainers from across the stack — PyTorch core and TorchNPU, @vllm_project and vLLM-Omni, MiniCPM / OpenBMB, LLaMA-Factory, PenguinHarness, FlagOS — together with more than a hundred developers in Beijing for a full day of talks, roundtables and hands-on work.
Morning: multi-backend integration, TorchNPU distributed training, vLLM-Omni inference, MiniCPM on-device models, FlagOS operators, Agent tooling.
Afternoon: an AI Infra roundtable, a contribution workshop walking through PR review to merge, an Agent build session — and 30+ community tasks opened on site.
At #pytorchcon China this September, the Foundation shared what that energy is turning into: more than 250 organizations across China now contribute to Foundation projects including vLLM; Chinese developers now rank among the leading contributor groups on vLLM; and Chinese open-weight models went from 2% to 45% of OpenRouter token traffic between late 2024 and April 2026.
Enthusiasm is the starting point. Upstream commits are the proof.
That's why a vendor-neutral home matters: ANY MODEL · ANY CHIP · ANY CLOUD · ANY AGENT — so local energy feeds the global mainline instead of fragmenting into separate regional stacks.
We also want to recognize @Huawei for years of work growing this ecosystem. We're looking forward to more days like this, and to reaching even more developers who care this much.
To every maintainer and developer who gave up a cold, sleety Saturday for open source: thank you.
What should we build together next? Tell us in the comments. -
PyTorch
@PyTorch
🚀 Ready to explore what's next in open source AI? Join us at #pytorchdayjapan 2026 on December 10 in Tokyo! Register today! events.linuxfoundation.org/pytorch-day-japan/register/
5️⃣ reasons to attend:
- Explore AI innovations
- Learn from industry leaders
- Discover what's next in open source AI
- Get real-world insights
- Connect with the community -
PyTorch
@PyTorch
What can you test on one GPU before a big PyTorch training run? PyTorch core maintainer @ezyang (@Meta) explains in this clip from #pytorchcon North America 2026.
He describes how a fake process group lets developers stub out distributed communication and check for crashes and GPU out-of-memory errors. He also discusses using SPMD types to look for numerical bugs without running a full-scale distributed test.
In the full keynote, PyTorch core maintainer @albanDesmaison (@Meta) discusses hardware backend integration and testing. @ezyang also covers activation checkpointing with torch_remat and discusses FlexShard.
Watch the full keynote: youtu.be/EwZafo8QDDEThis media couldn't be displayed. See it on the original post. -
PyTorch
@PyTorch
At @AIatAMD @AMD AI DevDay in Austin @sparkycollier spoke to a room full of developers on how the PyTorch Foundation is powering training, inference, and agents as the open source center of gravity.
-
PyTorch
@PyTorch
ExecuTorch WebGPU, PyTorch models on the GPU, in the browser.
Running a PyTorch model in the browser has usually meant converting it to another framework's format first. With ExecuTorch's new WebGPU backend, you export once with torch.export, and the same .pte file runs in WebGPU browsers such as Chrome and Safari. Everything runs locally in the tab, so prompts, photos and audio never leave the device.
The backend already runs Llama 3.2, Qwen3, Gemma 3, SmolVLM, SAM 2, Depth Anything V2, D-FINE, Real-ESRGAN and Whisper, and supports LoRA and DiReFT fine-tuning on-device.
By Julian Ng-Thow-Hing (@hing3074), Siddartha Pothapragada, Stephen Jia, Digant Desai (@digant23), and Bilgin Cagatay (@BilginCatay).
Read the post: pytorch.org/blog/executorch-webgpu-pytorch-models-on-the-…
Try the models in the ExecuTorch WebGPU Playground: executorch.ai/playground -
PyTorch
@PyTorch
With AI models scaling fast, seamless orchestration is key. Live from #kubecon + #cloudnativecon @robertnishihara announces AI & cloud-native ecosystem KubeRay joins @CloudNativeFdn as the Kubernetes-native lifecycle management, autoscaling, scheduling, reliability, and observability for Ray workloads. KubeRay is the standard way to run @raydistributed on Kubernetes & is the foundation of the managed Ray offerings from major cloud providers. Collaboration between CNCF and PyTorch Foundation is helping bridge the gap between large-scale distributed AI training/inference and robust Kubernetes infrastructure.
-
PyTorch
@PyTorch
Great to see the open source community pushing inference performance forward on PyTorch:
A megakernel for Muse Spark Open on TPU v7 got 433 tok/s per user and up to 25.9K tok/s per chip on AgentX (1M context). All 62 layers of the 816B MoE run as one Pallas program on a single TPU v7 host, with SGLang on the TorchTPU PyTorch backend.
- 1.94x faster per token than our previous path
- DFlash2 speculative decoding: 2.0x per token
- fp8 KV, HiCache and session-aware eviction for long agent sessions
Read the full technical deep dive here: pytorch.org/blog/optimizing-muse-spark-open-on-tpu-v7-wit…
@radixark -
PyTorch reposted
Mark Collier 柯理怀
@sparkycollier
More @PyTorch foundation projects represented on stage for the Kubecon keynotes today: @robertnishihara the creator of @raydistributed talking about the close Ray integration with @kubernetesio including Kuberay the newest @CloudNativeFdn sandbox project
-
PyTorch reposted
Mark Collier 柯理怀
@sparkycollier
Kevin Cochrane of @Vultr at Kubecon talking about the importance of supporting open source foundations: @aaifcommunity @PyTorch @CloudNativeFdn and @openinfradev
-
PyTorch
@PyTorch
vLLM relies heavily on PyTorch, with frequent calls to LibTorch in its C++ backend. As a result, changes to LibTorch’s binary interface may require vLLM to be rebuilt and relinked, even when the APIs remain unchanged. What if we could update LibTorch without rebuilding vLLM? Enter: LibTorch Stable ABI
vLLM
@vllm_project
vLLM × PyTorch: with the LibTorch Stable ABI, new PyTorch releases no longer force a vLLM rebuild 📷 Users upgrade sooner, distributors rebuild less, devs test torch changes without recompiling vLLM. Read the migration story: vllm.ai/blog/2026-11-06-stable-abi-cuda
-
PyTorch reposted
Mark Collier 柯理怀
@sparkycollier
Great to hear from @ritazzhang at @CoreWeave at Kubecon about their open source contributions to @vllm_project , one of the fastest growing open source projects hosted by the @PyTorch Foundation
-
PyTorch
@PyTorch
Optimize kernels with a Python-based DSL and tile-centric primitives to automatically target Tensor Cores and other advanced GPU hardware features.
CUDA Tile can take direct PyTorch implementations that compute multiple terms separately, fuse them into one tiled kernel and keep that matrix in registers.
This blog shows how it enables you to write clear, readable, and highly performant kernels, including examples, docs, and sample code.
Read the full post:
developer.nvidia.com/blog/accelerating-mamba-2-with-high-… -
PyTorch
@PyTorch
Welcome to our 2026 PyTorch Foundation Ambassadors! Today we feature:
Abraham Imani Bahati @imanibahati0 · Democratic Republic of Congo
Adesina Lekan Samuel @limitless__100 · Nigeria
Aditya Mehra · USA
Ali Gowani · USA
“I’m excited to contribute to the PyTorch community, learn alongside researchers and developers from around the world, and help make open-source AI more accessible to developers and learners across Africa.” - Abraham Imani Bahati
“I cannot wait to bridge the gap in AI access by democratizing PyTorch and its broader ecosystem for underrepresented students and researchers across all levels!” - Adesina Lekan Samuel
“I’m excited to help more engineers move PyTorch from experiments to reliable production systems, through hands-on tutorials, community events, and mentoring new contributors.” - Aditya Mehra
“PyTorch has fundamentally transformed how we teach, research, and deploy artificial intelligence. I’m excited to advocate for the ecosystem and drive hands-on adoption of open-source frameworks that keep AI innovation accessible, collaborative, and responsible.” - Ali Gowani -
PyTorch
@PyTorch
How does Shopify outperform frontier AI models at a fraction of the cost? During #pytorchcon North America keynote, @cmazzaanthony of @ShopifyEng explained @Shopify's "Flywheel" a state-of-the-art continual learning loop built on top of @PyTorch and @vllm_project.
As enterprises scale generative AI, the bottleneck quickly shifts from building an initial model to maintaining and improving its performance in production. Shopify solves this by turning real-world failures into a self-improving engine.
Watch the full keynote video on YouTube to learn how this continuous learning loop operates in production: www.youtube.com/watch?v=2jOgIJRUFdgThis media couldn't be displayed. See it on the original post. -
PyTorch reposted
Red Hat Open
@redhatopen
PyTorch has evolved from a tool for data scientists into a critical infrastructure bridge for modern AI technology. AI Community Architect Steve Pousty sits down with @kernelcdub to explore the @PyTorch ecosystem. www.youtube.com/watch?v=fSFKLYIQLnk&t=1s
-
PyTorch
@PyTorch
This is your final opportunity to submit a session for #pytorchdaychina taking place in Beijing on December 12. Bring your ideas and experiences to a community of PyTorch developers, machine learning engineers, AI researchers, and open source AI leaders from across China and beyond.
⏰ SUBMIT YOUR PROPOSAL by Tuesday, November 10, at 23:59 China Standard Time >> www.lfopensource.cn/pytorch-day-china/program/call-for-pr… -
PyTorch
@PyTorch
"One thing that's special about the PyTorch Conference is that it really does focus on cutting-edge research and tools and trends that we see in AI."
Jana van Greunen, Director of Engineering, @Meta
At PyTorch Conference North America, our community gathered in person to accelerate open intelligence across the entire loop. From keynotes to technical deep dives, researchers, maintainers, and engineers came together to solve open bottlenecks and decide what comes next.
Read the full event recap: pytorch.org/blog/pytorch-conference-north-america-2026-ac…
Catch the community highlights and hear directly from attendees: www.youtube.com/watch?v=cQQc_mbmjPY -
PyTorch
@PyTorch
PyTorch Foundation, @CloudNativeFdn, and the @AgenticAIFdn are hosting an evening reception alongside NeurIPS in Sydney on December 8.
Meet researchers, engineers, and open source practitioners working across AI and cloud native infrastructure, and swap ideas over drinks and small bites.
The reception runs from 6 to 9 PM Sydney time on Tuesday, December 8, at Darling Pavilion, 1 Harbour St. Space is limited.
Find event details and registration at pytorch.org/event/cncf-pytorch-aaif-evening-reception/ -
PyTorch
@PyTorch
PyTorch operations can be performance optimized for MoE models applications.
MoE models replace a single dense feed-forward block with multiple expert networks. A naive implementation, however, can trigger excessive kernel launches. For example, the Hugging Face baseline implementation iterates over all experts in a Python loop, with each expert triggering separate kernel launches.
Grouped execution preserves the individual expert matrices but submits their work together, reducing launch and scheduling overhead. This blog from @nvidia uses biological foundation models as an example for efficient MoE training.
Read the full post:
developer.nvidia.com/blog/efficient-moe-training-for-biol… -
PyTorch
@PyTorch
🤖 Bringing Backpropagation to Real-Time Robot Inference with ExecuTorch!
events.linuxfoundation.org/pytorch-day-japan/program/sche…
Join Usamah Zaheer, PyTorch Ambassador and Machine Learning Engineer at Arm, during PyTorch Day Japan 2026. Explore the intersection of robotics, edge AI, and PyTorch. See how research concepts can become practical, deployable systems!
Register by November 11 and save ¥3,000. events.linuxfoundation.org/pytorch-day-japan/register/ -
PyTorch
@PyTorch
Submit your proposal for PyTorch Day China 2026 before Tuesday, November 10, at 23:59 China Standard Time.
Propose a session presentation or lightning talk on model training and post-training, efficient inference and deployment, PyTorch Core and hardware acceleration, Physical AI, or PyTorch ecosystem tools and applications.
Share your work with PyTorch developers, machine learning engineers, AI researchers, and open source AI leaders in Beijing on December 12.
Read more: pytorch.org/blog/call-for-proposals-pytorch-day-china-2026/ -
PyTorch
@PyTorch
What is driving the unprecedented acceleration in AI? @sparkycollier summed it up in one word: OPEN during his PyTorch Conference North America 2026 keynote.
At the center of this movement is the PyTorch Foundation serving as the home for the open source intelligence layer developers use for training, optimizing, serving, and running models on any chip in any cloud for any agent.
Watch Mark's full keynote that sets the stage for the whole event: www.youtube.com/watch?v=n33zCp1dUCE
+ follow along with us as we share all of the recordings from #pytorchcon over the next few weeks -
PyTorch
@PyTorch
Bring your questions about PyTorch 2.15 to our live Q&A TOMORROW, November 5, at 11 AM PT.
Tristan Rice (@rice_fry), Natalia Gimelshein, Huy Do, and Jane Xu (@janeyx99) (@Meta), with moderator Chris Gottbrath (Gottbrath Tech), will share an overview of the release and answer community questions about PyTorch and the new capabilities in the release.
PyTorch 2.15 makes the rewritten NCCL backend the default, adds one-sided transports with a NIXL backend, and gives FSDP2 and pipelining finer memory and communication control. The release also brings faster 4-bit (NVFP4) LLM decoding on NVIDIA Blackwell GPUs, FP8 and faster decode on Apple Silicon, and broader platform support.
Register: pytorch.org/event/pytorch-2-15-release-live-qa/ -
PyTorch
@PyTorch
#pytorchdaychina 2026 comes to Beijing on December 12, and the call for proposals is OPEN!
We're accepting proposals for session presentations and Lightning Talks across the full spectrum of open source AI, PyTorch, and AI/ML.
Submit by Tuesday, November 10, at 23:59 China Standard Time >> www.lfopensource.cn/pytorch-day-china/program/call-for-pr… -
PyTorch
@PyTorch
🌏 From Learners to Contributors: Growing the PyTorch Ecosystem through PyTorchKR
events.linuxfoundation.org/pytorch-day-japan/program/sche…
Join Junghwan Park from PyTorchKR & Jiho Kim, PyTorch Foundation Ambassador, during PyTorch Day Japan 2026 to discover how eight years of community building have helped developers, researchers, and students become open source contributors.
Register by November 11 and save ¥3,000. events.linuxfoundation.org/pytorch-day-japan/register/ -
PyTorch
@PyTorch
This blog post from @nvidia is intended to develop a clearer way of reasoning about performance optimization for PyTorch models and other representations.
It explores questions such as: What makes one compiled engine better than another? Why can individually promising decisions fail end to end? How should accuracy constrain performance optimization?
It introduces the Global Performance Tuner, a feature for automatic performance tuning released in TensorRT 11.1, and explores these questions through an intuitive example and a mathematical framework.
Read the full blog post here: developer.nvidia.com/blog/scaling-nvidia-tensorrt-perform… -
PyTorch
@PyTorch
At the recent KVCache Meetup Korea, co-hosted by PyTorchKR and XCENA, speakers from XCENA, SK hynix, FuriosaAI, and LMCache dove deep into the architectural trade-offs powering large language model serving.
Talks spanned CXL memory pooling with Maru, roofline analysis of GPU compute and HBM bandwidth during prefill and decode, batch scheduling on RNGD, and process-isolated cache serving with LMCache MP Mode.
Real-world optimization requires collaboration across every tier of the stack, from accelerators and memory architectures to runtime engines. Thank you to PyTorch Foundation Ambassador Junghwan Park, co-host XCENA, and sponsor @tensormesh for bringing this local developer community together.
Catch the full event recap here: pytorch.org/blog/kvcache-meetup-korea-2026-event-recap/ -
PyTorch
@PyTorch
Bring your questions about PyTorch 2.15 to our live Q&A this Thursday, November 5, at 11 AM PT.
Tristan Rice (@rice_fry), Natalia Gimelshein, Huy Do, and Jane Xu (@janeyx99) (all @Meta), with moderator Chris Gottbrath (Gottbrath Tech), will share an overview of the release and answer community questions about PyTorch and the new capabilities in the release.
PyTorch 2.15 makes the rewritten NCCL backend the default, adds one-sided transports with a NIXL backend, and gives FSDP2 and pipelining finer memory and communication control. The release also brings faster 4-bit (NVFP4) LLM decoding on NVIDIA Blackwell GPUs, FP8 and faster decode on Apple Silicon, and broader platform support.
Register: pytorch.org/event/pytorch-2-15-release-live-qa/ -
PyTorch
@PyTorch
Today, PyTorch Foundation project, Ray is announcing the Special Interest Group (SIG) for Ray on Accelerators.
Ray already supports more than a dozen accelerator types, from NVIDIA and AMD GPUs to TPUs and Trainium. The SIG brings hardware vendors, cloud providers, and the Ray community together around a vendor-neutral roadmap focused on:
· Development and testing infrastructure on real hardware
· Hardware-aware scheduling that understands topology
· Direct device-to-device transport with Ray Direct Transport
Join us on the Ray Slack channel, at community meetings, or on GitHub.
Learn more here: pytorch.org/blog/announcing-the-special-interest-group-si…
@raydistributed -
PyTorch
@PyTorch
Validate your real-world PyTorch skills with the PyTorch Certified Associate (PTCA) program.
Designed for early-stage practitioners, PTCA helps you demonstrate foundational ability across model design, training, and deployment while building credibility across the open source AI ecosystem.
Learn more and enroll here: training.linuxfoundation.org/certification/pytorch-certif… -
PyTorch
@PyTorch
We ❤️ our ambassadors. The ambassador meetup at #pytorchcon North America was a good time to connect and make plans for the year ahead.
PyTorch Foundation Ambassadors help grow our projects (PyTorch, vLLM, DeepSpeed, Ray, Helion, & Safetensors) around the world by organizing events, creating educational content, mentoring new users, and contributing to the open source ecosystem.
Meet all of your PyTorch Foundation ambassadors: pytorch.org/programs/ambassadors/This media couldn't be displayed. See it on the original post. -
PyTorch
@PyTorch
🚀 Unlock frontier-level AI training performance with DeepSpeed!
events.linuxfoundation.org/pytorch-day-japan/program/sche…
Join Masahiro Tanaka of DeepSpeed at PyTorch Day Japan 2026 as he presents “DeepSpeed at the Frontier: Community-Driven Optimizations for State-of-the-Art Training Performance,” exploring the latest innovations advancing the performance and scalability of distributed AI training.
Register by November 11 and save ¥3,000. events.linuxfoundation.org/pytorch-day-japan/register/ -
PyTorch
@PyTorch
PyTorch 2.15 is here, with 3,117 commits from 583 contributors and updates across distributed training, NVGEMM, Apple Silicon, and accelerator platform support.
The release makes the rewritten NCCL backend the default and adds one-sided transports with a NIXL backend. FSDP2 and pipelining gain finer memory and communication control. It also brings faster 4-bit (NVFP4) LLM decoding on NVIDIA Blackwell GPUs, FP8 and faster decode on Apple Silicon, and broader platform support.
On Thursday, November 5, at 11 AM PST, join Tristan Rice (@rice_fry), Natalia Gimelshein, Huy Do, and Jane Xu (@janeyx99) (@Meta) for a live PyTorch 2.15 Q&A, moderated by Chris Gottbrath (Gottbrath Tech). The speakers will share an overview of the release and answer community questions about PyTorch and the new capabilities in this release.
🔗 Read the release blog and register for the live Q&A: pytorch.org/blog/pytorch-2-15-release-blog/ -
PyTorch
@PyTorch
On Oct 19 at PyTorch Conference North America 2026 in San Jose, attendees spent a full day in our instructor-led PyTorch Associate Training preparing for the PyTorch Certified Associate (PTCA) exam. Here’s what they had to say:
💬 “From basics to advanced, the instructors did a nice job of explaining.”
💬 “Everything was hands-on... with powerful GPUs.”
💬 “I used to think of PyTorch as training models, but it was so much more: benchmarking and profiling.”
💬 “Made me confident for the exam.”
💬 “Absolutely recommend to friends.”
Thank you to our teaching staff from @NVIDIAAI: Allison Ding, Krishna Kalyan, Lakshay Garg, Santosh Bahir, Ian Wang, and Faradawn Yang.
Learn more about getting certified: training.linuxfoundation.org/certification/pytorch-certif…
Check out what the attendees had to say here: www.youtube.com/watch?v=Wc32V8obgpE
#pytorchcon -
PyTorch
@PyTorch
Faster streaming speech recognition on @Arm edge devices: see how ExecuTorch, SME2, FP16 and QC8W balance accuracy and latency—delivering up to 2.12× faster processing on Pixel 11.
Read our latest blog: pytorch.org/blog/optimizing-streaming-speech-recognition-…
✍ Josiah Davis, Kshitij Sisodia -
PyTorch
@PyTorch
Join the @DeepSpeedAI team for virtual office hours on October 27!
At last week’s PyTorch Conference, the DeepSpeed team shared the project’s latest progress during the PyTorch Foundation keynote and a technical session. They highlighted advances including AutoEP (expert parallelism), AutoTP (tensor parallelism), AutoSP (sequence parallelism), and Ray-based pipeline parallelism, with benchmarks showing that DeepSpeed matches or outperforms other state-of-the-art frameworks on the workloads evaluated.
These virtual office hours will offer a deeper dive into the features and benchmark results presented at the conference, along with a discussion of DeepSpeed’s proposed Q4 roadmap.
Interested in learning more, asking the team questions, or contributing to these projects? Join the conversation and share your ideas for what DeepSpeed should prioritize next. Everyone is welcome!
📅 Tuesday, October 27
🕘 9 AM PT / 12 PM ET
🔗 Join: zoom-lfx.platform.linuxfoundation.org/meeting/93902569995… -
PyTorch
@PyTorch
Thanks for joining us at PyTorch Conference @alanzhuly and @Qualcomm!
Alan Zhu
@alanzhuly
We brought two things to @PyTorch Conference.
At the @Qualcomm booth, we demoed GenieX, the open-source Gen AI runtime my team builds, running @liquidai's LFM-VL on @Innodisk_Corp's Dragonwing IQ9. It watched a live camera feed and described what it saw, all on the device.
Multimodal is the workload moving on-device in production. Small VLMs are good enough now for most of what a camera needs to understand, and you don't pay per frame or wait on the network.
We also ran a hands-on workshop with @awscloud : fine-tune on SageMaker, then run the model locally with GenieX. Most questions were some version of "how do I get my own model running on my own hardware?" That's sovereign AI at developer scale, and it's exactly what GenieX is for. -
PyTorch
@PyTorch
Learn more on the PyTorch Foundation blog! pytorch.org/blog/bringing-executorch-to-arm-cortex-m-cpus/
Executorch: Open-source ondevice AI from @pytorch
@Executorch
This is how we bring AI inference to microcontrollers, without the complexity of switching frameworks. The new @Executorch Cortex-M backend uses @Arm CMSIS-NN to accelerate @PyTorch models on Arm Cortex-M CPUs. Take a look at the report here: developer.arm.com/community/arm-community-blogs/b/ai-blog…
-
PyTorch
@PyTorch
Smaller & specialized models are becoming dramatically more capable and new approaches to continual learning are enabling AI systems to improve from real-world experience after deployment. Jonathan Bryce, Executive Director of Cloud & Infrastructure at @linuxfoundation @CloudNativeFdn shares about how we're moving from bigger models to better systems during @AgenticAIFdn #agntcon + #mcpcon keynote.
The future of AI will depend not on any single model, but on an open set of technologies for building, optimizing, serving and continuously improving intelligence. The @PyTorch Foundation in bringing those technologies together, creating an open foundation that gives developers the freedom to build with any model, on any chip and across any cloud. -
PyTorch reposted
Agentic AI Foundation
@AgenticAIFdn
Bigger models? Cool. Better systems? Even better.
Jonathan Bryce of the @LinuxFoundation hit the AGNTCon + MCPCon NA keynote stage to talk about accelerating open intelligence beyond model scaling.
Day 2 is LIVE. Tune in: www.youtube.com/live/eB9I4Ixx2wc?cbrd=1&ucbcb=1 -
PyTorch
@PyTorch
Most AI developers use PyTorch to build their models. And this week @AmazonScience announced a new PyTorch backend for AWS Trainium chips - TorchNeuron. Learn more about the science behind it.
Amazon Science
@AmazonScience
TorchNeuron is now open source. Our new @PyTorch backend translates code into operations executable on AWS Trainium with minimal or no code changes. Learn how the team used AI agents and hundreds of thousands of models to validate it: www.amazon.science/blog/the-science-behind-torchneuron-am…
-
PyTorch
@PyTorch
Great to see @intel and @AMD collaborate to simplify AI development on x86 CPUs using PyTorch 🔥
Intel Devs
@inteldevs
Intel and AMD are working together to simplify AI development on x86.
By bringing @PyTorch CPU optimizations together through oneDNN, we’re creating a more consistent software path for developers across Intel and AMD processors.
Learn more: www.intel.com/content/www/us/en/newsroom/news/data-center… -
PyTorch
@PyTorch
Huge news! Also read more about TorchTPU on the PyTorch blog: pytorch.org/blog/introducing-torchtpu/
Google Cloud Tech
@GoogleCloudTech
Big day for the @PyTorch ecosystem at #pytorchconf2026 🚀
We’re officially open-sourcing TorchTPU—enabling native, hardware-accelerated PyTorch execution across Cloud TPUs and custom infrastructure.
Here’s everything we launched to supercharge your training & inference workloads 🧵👇
goo.gle/4Bl0zdG -
PyTorch
@PyTorch
Powered by PyTorch 🔌
Intel Devs
@inteldevs
Your AI workflows shouldn't be tied to your desk. With AI Playground Home Agent and Slack/Telegram, you can launch @PyTorch-powered image generation and content creation from your phone while the compute stays local on your Intel-powered AI PC.
See it in action at PyTorch Conference or: www.youtube.com/watch?v=YDhlrOLoKRA -
PyTorch
@PyTorch
Thanks for joining us at #pytorchcon @CloudNativeFdn!
CNCF
@CloudNativeFdn
The collaboration between deep learning teams and cloud native engineers doesn't stop when the expo floor closes. We're wrapping up two great days at @PyTorch Conference North America and taking these shared insights straight into KubeCon + CloudNativeCon.
Register for KubeCon + CloudNativeCon North America: events.linuxfoundation.org/kubecon-cloudnativecon-north-a… -
PyTorch
@PyTorch
Openness Is AI’s Future. And PyTorch is leading the way.
Techstrong.ai
@Techstrongai
PyTorch sits at the heart of AI development and is increasingly the software layer through which hardware vendors compete for workloads, and this year's conference showed that plainly, with Google's TorchTPU and Amazon's TorchNeuron adding native backends that port existing PyTorch work onto their own accelerators.
Behind the common modeling interface, though, the kernels, compilers and low-level system software are still fragmented, and with more than 600,000 GitHub projects and roughly 150 pull requests a day, success is straining the maintainers as much as it is propelling the ecosystem.
Read the full report on the state of PyTorch and the case that its open future is already here: techstrong.ai/articles/the-state-of-pytorch-2026/
#pytorch #ai #opensource #machinelearning #llm -
PyTorch
@PyTorch
#pytorchcon North America 2026 brought 3,500+ attendees to San Jose to accelerate open intelligence.
The PyTorch Foundation welcomed nine new members, including @Nebius, @Nscale, and @Shopify as Platinum members, deepening its role as the intelligence layer for open source AI development.
“Open systems learn faster when more people, projects, and organizations are working together, creating compounding gains,” said @sparkycollier, Executive Director of the PyTorch Foundation. “Open source ecosystems let breakthroughs travel between organizations instead of staying locked inside one company.”
@Google and @Meta introduced TorchTPU for native PyTorch execution on Google TPUs. @awscloud announced TorchNeuron for AWS Trainium. TorchTitan expanded model support, improved training performance, and introduced reinforcement learning through TitanRL.
The program featured more than 100 sessions and 144 poster sessions, alongside Day 0 training and workshops. In the Community Expo, attendees connected with sponsors, exhibitors, and core maintainers through booth conversations, demonstrations, and Meet the Developers.
The 2026 PyTorch Contributor Awards recognized innovation, collaboration, and impact across PyTorch, @vllm_project, @DeepSpeedAI, Ray, Helion, and Safetensors.
Explore the announcements, keynotes, technical updates, contributor recognition, and community highlights in our recap.
Thank you to the contributors, maintainers, speakers, trainers, program chairs and committee, sponsors, and attendees who made #pytorchcon possible.
Read the recap: pytorch.org/blog/pytorch-conference-north-america-2026-ac…
Stay tuned for session slides and recordings, and save the date: PyTorch Conference returns to San Jose, October 6–7, 2027! -
PyTorch
@PyTorch
PyTorch Foundation welcomes its 2026 cohort of 24 ambassadors, representing communities from Nigeria and Burkina Faso to Singapore, India, Romania, Spain, the United Kingdom, and the United States.
Each ambassador brings a unique perspective, technical background, and connection to their local community. Together, they are creating more opportunities for people to discover open source AI, develop practical skills, and contribute to the technologies shaping its future.
Meet our 2026 ambassadors:
Adesina Lekan Samuel (@limitless__100), Soumana Dama, Ronnie Atuhaire, Farah Abdou, Abraham Imani (@imanibahati0), Simanga Comfort Mchunu, Mark Gatere (@gatere_mark), Alpha Romer Cooma, Tsai Li Ming (@tsailiming), Mu Xiaohui, Wang Zhipeng, Sumantro Mukherjee (@BytesOfBinary), Parichay Das, Sudhir Dharanendraiah, Costin-Alexandru Deonise, Ricardo Noriega (@rickynds), Matthew Cossins, Johnny Kozman, Ali Tavallaie (@AliTavallaie), Amr Osama Abdellatif, Özge Çinko, Aditya Mehra, Ali Gowani, Samaresh Kumar Singh.
We look forward to seeing what the 2026 PyTorch Foundation Ambassadors will teach, organize, create, and contribute in the year ahead.
Read the announcement: pytorch.org/blog/meet-the-2026-pytorch-foundation-ambassa… -
PyTorch
@PyTorch
The TorchTitan team landed massive improvements in the past year without losing its minimal, extensible ethos. Enhancements include support for SOTA models, dramatic improvements of out-the-box performance at scale, RL support, and new communication features.
Read our latest blog to learn more and to get started: pytorch.org/blog/torchtitan-update-new-sota-models-perfor… -
PyTorch
@PyTorch
We welcome LightSeek Foundation @lightseekorg as a Silver Member of PyTorch Foundation.
Its membership deepens LightSeek Foundation’s commitment to building open inference infrastructure with the community. LightSeek Foundation’s TokenSpeed and SMG are PyTorch Ecosystem projects.
Read the announcement: pytorch.org/blog/pytorch-foundation-welcomes-nine-new-mem…
LightSeek Foundation
@lightseekorg
LightSeek Foundation has joined the @PyTorch Foundation as a Silver Member.
TokenSpeed and SMG are both PyTorch Ecosystem projects. This membership deepens our commitment to building open inference infrastructure with the community.
As our president @zhyncs42 shared: “Efficient inference is essential to making AI accessible at global scale, and we believe the infrastructure behind it must be open.”
We look forward to working with the PyTorch community to improve performance, lower costs, and make AI more accessible.
Read the announcement: pytorch.org/blog/pytorch-foundation-welcomes-nine-new-mem… -
PyTorch
@PyTorch
Congratulations to the 2026 PyTorch Contributor Award winners, recognized today at #pytorchcon 2026 for their innovation, collaboration, and impact across all PyTorch Foundation projects including PyTorch, vLLM, DeepSpeed, Ray, Helion, and Safetensors.
Outstanding Ambassador: Jiho Kim
Newcomer: Jiangyun Zhu (@jiangyun_zhu), Johannes Lennart Zeiser
Knowledge Enhancer: Abdulsalam Yazid Bande (@abdulsalambande), Suman Debnath (@_sumand)
Bug Buster: Guilherme Vieira Leobas, Vishal Goyal
Review Powerhouse: Wentao Ye
Catalyst: Jiahao Tan, Harry Mellor (@hmellor_)
Innovator: Masahiro Tanaka, Elfie Guo, Xinan Lin
Ecosystem Champion: Guangye Yu
Superhero: Thomas Ortner
Nominees: Chandra Mohan Singh Negi, Arun Bhandari, Masahiro Hiramori, Luka Govedič, Irakli Salia, Jiahao Chen, Kunshang Ji, Rohit Kumar Tiwari, Subin George, Xunzhuo Liu, and Aaron Gokaslan.
Thank you to Cara Delia (@RedHat) and Chris Gottbrath (Gottbrath Technologies) for presenting the awards, and to Red Hat (@RedHat) for sponsoring them.
And thank you to our 2026 Awards Committee: Chris Gottbrath (Gottbrath Technologies), Chris Hoge (@nvidia), Ashok Emani (@intel), Piotr Bialecki (@nvidia), Yashasvi Misra (@CloudNativeFdn), Sudhir Dharanendraiah (@RedHat), Zesheng Zong (@Huawei), Jiawei Li, and Kaichao You (@inferact). -
PyTorch
@PyTorch
Wednesday's Demo Theater at #pytorchcon features 13 presentations on training, inference, hardware enablement, and agentic workflows. All sessions are in the Community Expo on the Concourse Level.
10:40–10:50 AM: Maen Suleiman (@awscloud) demos reinforcement learning on Trainium through TorchNeuron, the native PyTorch backend for AWS Trainium, with TorchTitan training, vLLM-Neuron generating rollouts, Monarch orchestrating, and TorchStore syncing weights.
10:55–11:05 AM: Ali Taha (@baseten) breaks down how Wan 2.2 generates a five-second video in under three seconds, a 53.6x improvement over baseline, using timestep distillation, custom kernel engineering, and four-bit quantization.
12:20–12:30 PM: Rain Jiang and Kevin Li (@verdacloud) demo WideEP for expert-parallel MoE inference on an NVIDIA NVL72 system, using a Rust-based frontend to run and monitor the workload.
12:35–12:45 PM: Tristan Webb (@dMatrix_AI) presents dmx-compressor, a PyTorch 2.0 based quantization framework that gives ML engineers numerical reference output to validate models running on ASIC hardware.
12:45–12:55 PM: Lin She (@clockworkio) demos surviving link and node failures in PyTorch training live, with LinkPass and TorchPass keeping the job running on the same training step.
1:00–1:10 PM: Ashok Emani and Qiacheng Li (@intel) show AI Playground Home Agent, which runs PyTorch AI workflows on an Intel AI PC and lets you use them from your phone.
1:15–1:25 PM: Zesheng Zong (@Huawei) presents CRCR (Cross-Repository CI Relay) for joint testing between PyTorch pull requests and accelerator backends, catching regressions at the PR phase.
1:30–1:40 PM: FNU Harsh and Sarah Ahmed (@LightningAI) demo an agent reproducing ML research on Lightning, showing where it succeeds autonomously and where it needs intervention.
1:45–1:55 PM: George Novack (@inferact) introduces TPU megakernels, with Kimi K3 megakernels running inside vLLM-TorchTPU.
2:00–2:10 PM: Jay Dawani (Lemurian Labs) examines why heterogeneous computing is so hard and what a hardware-agnostic stack has to get right.
2:15–2:25 PM: Minwook Ahn (@RebellionsAI) shares how extending PyTorch's device abstraction to support device-persistent tensors minimizes data movement between host and device.
2:30–2:40 PM: Jesse Treger (HPE) introduces OpenCLIC, an open inference communication framework for connectionless networks that is being integrated with vLLM.
3:55–4:05 PM: Mengjin Yan and Joshua Lee (@anyscalecompute) cover evolving Ray Core for post-training at scale, from scaling Ray's scheduling to 10,000-node clusters to moving PyTorch tensors directly between GPUs with Ray Direct Transport.
View the Demo Theater schedule: events.linuxfoundation.org/pytorch-conference-north-ameri… -
PyTorch reposted
vLLM
@vllm_project
vLLM 🤝 TPU
🚀 Native PyTorch serving on TPUs is here! Built with @Google and @inferact, vLLM-TorchTPU brings familiar PyTorch tools to TPU inference, with prefix caching, speculative decoding, and disaggregated serving.
🛠️ Excited to keep building with the community!
Google Cloud
@googlecloud
Native PyTorch on TPUs is here—and TorchTPU is officially open source.
Train and serve models using the tools you already know: @vllm_project, @sgl_project, @_llm_d_, TorchTitan, @huggingface, and @raydistributed.
Learn more from #pytorchconf2026 → goo.gle/4hWxEVH -
PyTorch
@PyTorch
FlyDSL, an open source Python kernel DSL, now plugs into PyTorch on @AMD MI350-series GPUs via torch.compile and eager mode.
Up to 1.68x geomean scaled GEMM kernel speedups and up to 3.01x end-to-end #vllm serving speedups.
Read more: pytorch.org/blog/accelerating-pytorch-on-amd-gpus-with-fl… -
PyTorch
@PyTorch
TorchTPU enables seamless out-of-the-box model execution and TPU migration while delivering industry-competitive inference and training performance through eager execution optimizations, torch.compile integration, & native hardware acceleration.
Learn more on the PyTorch blog: pytorch.org/blog/introducing-torchtpu/
Google Cloud
@googlecloud
Native PyTorch on TPUs is here—and TorchTPU is officially open source.
Train and serve models using the tools you already know: @vllm_project, @sgl_project, @_llm_d_, TorchTitan, @huggingface, and @raydistributed.
Learn more from #pytorchconf2026 → goo.gle/4hWxEVH -
PyTorch reposted
Nebius
@nebiusai
Nebius is proud to join the @PyTorch Foundation as a Platinum Member.
Ryan Hanrui Wang (@hanrui_w), our SVP Applied AI, joins the Governing Board and Technical Advisory Council.
Many teams on Nebius train and serve models with @PyTorch and @vllm_project, and we're a compute sponsor of vLLM, supporting its development, testing, and benchmarking.
We look forward to working with the community on faster training, more efficient inference, and a shorter path from research to production!
Read more: www.prnewswire.com/news-releases/pytorch-foundation-welco… -
PyTorch
@PyTorch
Yiwei Song (@CrusoeAI) shares the vision and progress behind Crusoe’s LLM post-training platform at #pytorchcon 2026.
The goal is to help customers customize open weights models for their business use cases to improve accuracy and reduce inference cost.
Yiwei outlines the customization lifecycle: start with a strong base model, inject domain knowledge, align to tasks and preferences, make the model smaller and faster to serve, and deploy it in production.
He presents Crusoe Managed RL as a Tinker API-compatible post-training platform, with customers deciding what to learn while Crusoe runs the GPUs.
Watch the keynote livestream: events.linuxfoundation.org/pytorch-conference-north-ameri… -
PyTorch
@PyTorch
Rachad Alao (@cohere) examines how open science can support transparent and secure AI foundation model development at #pytorchcon 2026.
Rachad argues for publishing model architectures, training strategies, parameter choices, and evaluation methodologies, alongside an evidence-based risk framework, independent auditing, continuous monitoring, and dynamic safeguards.
He discusses how PyTorch, TorchTitan, and @vllm_project support model development and inference optimization when models are open and accessible, and how access to internal representations enables research in retrieval, reasoning, and multilingual AI. -
PyTorch
@PyTorch
Zhipeng Wang (@Google) shares technical advances from the @DeepSpeedAI team for large-scale model training at #pytorchcon 2026.
Zhipeng highlights model-systems co-design and optimizations that enable DeepSpeed to deliver high performance across diverse model architectures, workloads, and accelerator platforms. Highlights include AutoSP for automatic sequence parallelism, Muon optimizer support, and AutoTP and AutoEP for Hugging Face models.
He discusses the continued development of the DeepSpeed open source community and collaboration with model developers, hardware vendors, and AI infrastructure partners to expand adoption and enable emerging large-scale AI workloads. -
PyTorch
@PyTorch
Priya Nagpurkar (@IBM) shares how IBM and @RedHat contribute across the PyTorch ecosystem in “From Silicon to Models at Scale” at #pytorchcon 2026.
Priya highlights work bringing IBM Spyre to the PyTorch compiler and vLLM, how AI tools help scale model enablement to thousands of models, and a look ahead at next-generation Spyre hardware.
She discusses Red Hat’s contributions to PyTorch and CI/CD infrastructure for out-of-tree accelerators, helping hardware backends keep pace with the community, alongside work with the llm-d community toward efficient distributed inference at scale.
PyTorch
@PyTorch
Check out our IBM Spyre blog trilogy for more:
Extending Inductor for the IBM Spyre Accelerator pytorch.org/blog/extending-inductor-for-the-ibm-spyre-acc…
Building Spyre as a Native PyTorch Device pytorch.org/blog/building-spyre-as-a-native-pytorch-device/
From KTIR to SpyreCode: An MLIR Dataflow Backend for IBM Spyre pytorch.org/blog/from-ktir-to-spyrecode-an-mlir-dataflow-… -
PyTorch
@PyTorch
Bill Jia (@GoogleCloud) and Zongwei Zhou (@Meta) introduce TorchTPU, a native PyTorch backend for Google TPUs, and agentic developer workflows at #pytorchcon 2026.
TorchTPU is an open source collaboration between Google and Meta, developed in close partnership with PyTorch core maintainers. It integrates with Hugging Face Transformers for modeling, TorchTitan for training, and vLLM and SGLang for serving.
They demonstrate how long-horizon agentic workflows can migrate complex model workloads from GPUs to TPUs. They explore using agents for performance optimization, including quantization, custom kernel generation, and advanced sharding strategies.
Watch the keynote livestream: events.linuxfoundation.org/pytorch-conference-north-ameri…
PyTorch
@PyTorch
Read our latest blog introducing TorchTPU to learn more: pytorch.org/blog/introducing-torchtpu/
-
PyTorch
@PyTorch
How can LLMs learn from what agents do? At #pytorchcon 2026, Mazin Gilbert, Executive Director of @AgenticAIFdn, examines the relationship between models and agents.
Mazin maps five layers of the agentic stack: hardware infrastructure, software infrastructure, intelligence, the agentic platform, and user applications. He places PyTorch at the intelligence layer and Agentic AI Foundation at the agentic platform layer.
He proposes designing the stack in both directions: models support agents, while agent traces, evaluations, environments, and rewards feed back into how models are built.
As an open research direction, Mazin describes turning agent evaluations into rewards for training in PyTorch, accounting for safety, task completion, precision, efficiency, and energy use.
Watch the keynote livestream: events.linuxfoundation.org/pytorch-conference-north-ameri… -
PyTorch
@PyTorch
PyTorch Foundation Executive Director Mark Collier @sparkycollier opens Day 2 of #pytorchcon 2026 with “Building What’s Next in Open Source AI.”
Mark looks ahead to broader hardware participation, workloads moving across more environments, and training and customizing frontier models at greater scale. Returning to the vision of open source software to train and serve models on any chip, in any cloud, for any agent, he discusses how AI itself is beginning to change how these systems are built and improved, creating opportunities and challenges for the community.
The morning explores agentic AI, workload fungibility, the evolution of inference hardware, scaling large-scale frontier models, contributor recognition, and open science. The focus is on the role open collaboration can play in expanding who can build, contribute, experiment, and shape the future of intelligence, so progress continues to come from many people, projects, and organizations.
Watch the keynote livestream: events.linuxfoundation.org/pytorch-conference-north-ameri… -
PyTorch reposted
Verda
@verdacloud
1st talk at @PyTorch: Paul Chang and Erik Schultheis on NVFP4 Training Tips and Tricks,
🗓️ Wed Oct 21 4:20 PM
What they learned training dense LLMs on GB300 at 4-bit: hyperparameters, optimisers, and recipes
Save it in the calendar: events.linuxfoundation.org/pytorch-conference-north-ameri… -
PyTorch reposted
Zesheng
@Zesheng_Zong
Whether you're pushing LLM training & serving onto NPUs ⚙️, keeping accelerators in sync with PyTorch's release cycle , taming dynamic shapes in torch.compile , or exploring ultra-low-precision training.
This agenda of #pytorchcon has you covered 👇 See you in San Jose! #pytorch -
PyTorch
@PyTorch
Great in-person sync for the PyTorch TAC Accelerator Integration Working Group on Day 1 of #pytorchcon!
We walked through our recent deliverables:
Accelerator Integration Guide
torch.accelerator API
Additional Compute Platform Pages
Ongoing work in flight:
Unit Test Refactoring
Cross Repository CI Relay (CRCR)
Also aligned on short & long-term priorities. The group will keep focusing on backend generality, stability, and release-related work ahead. -
PyTorch
@PyTorch
Unwind after Day 1 at the Flare Party & Poster Presentations tonight at #pytorchcon, 6–7:30 PM in the Community Expo (Concourse Level).
Explore research, projects, and ideas from the PyTorch community on display, with presenters on hand to discuss their work and answer questions.
Good food (sliders, biryani, churros, etc.), cold drinks, even better conversations.
Then bring your squad (or join one on the spot) for Pub Trivia from 6:30–7:15 PM in the Demo Theater. No niche tech knowledge required, and the winning team takes home prizes.
View the Poster Presentation Schedule: events.linuxfoundation.org/pytorch-conference-north-ameri… -
PyTorch
@PyTorch
Today's Demo Theater at #pytorchcon features 14 sponsor presentations on training, inference, compilers, and deployment. Here's what's still ahead this afternoon:
2:00–2:10 PM: IBM presents Spyre’s integration with PyTorch and vLLM, alongside insurance claim processing and document intelligence demos.
2:15–2:25 PM: Datadog examines job-centric observability for Ray training failures.
2:30–2:40 PM: Modal demonstrates low-latency inference and LLM post-training through live Street Fighter III gameplay.
3:55–4:05 PM: Arm connects natural language requests to physical hardware using PyTorch, ExecuTorch, vLLM, and Arm Device Connect.
4:10–4:20 PM: Red Hat tests quantization and speculative decoding under load to examine performance, cost, and quality trade-offs.
All sessions are in the Community Expo on the Concourse Level.
View the Demo Theater schedule: events.linuxfoundation.org/pytorch-conference-north-ameri… -
PyTorch
@PyTorch
Stop by the PyTorch Foundation booth in the Community Expo and tell us what you're building. Ask about PyTorch, vLLM, DeepSpeed, Ray, Helion, or Safetensors, or share what you're seeing across the open source AI stack. #pytorchcon
We're here today and tomorrow. Plus, check out the gear store, with merch for all Foundation projects.
PyTorch
@PyTorch
📸 Scenes from the community expo
-
PyTorch
@PyTorch
How does a PyTorch workload become something an AI accelerator can actually execute?
In our latest blog, the @IBM Spyre team explores the open source compiler technology connecting PyTorch to IBM's Spyre accelerator, including how KTIR and the Dataflow Scheduler translate PyTorch Inductor’s decisions around work distribution, memory placement, and tiling into dataflow pipelines that coordinate computation and data movement on Spyre.
Read more: pytorch.org/blog/from-ktir-to-spyrecode-an-mlir-dataflow-… -
PyTorch
@PyTorch
Ujval Kapasi (@nvidia) examines what agentic workloads need from the PyTorch stack in “PyTorch Performance for Agents on Vera Rubin” at #pytorchcon 2026.
A single request can trigger long chains of reasoning, tool calls, code execution, data movement, and distributed inference, introducing new bottlenecks and optimization opportunities.
Using Vera Rubin as a case study, he explores hardware and software co-design across CPUs, GPUs, memory, and networking. The keynote covers software optimizations and work across PyTorch, Triton, and vLLM on Vera Rubin. -
PyTorch
@PyTorch
Live from #pytorchcon 2026, Carlos Costa (@IBM, Abdullah Gharaibeh (@googlecloud), and Stephen Watt (@RedHat) present “Open Source Inference at Production Scale,” with a live @_llm_d_ demo underway.
-
PyTorch
@PyTorch
Simon Mo (@simon_mo_) of @inferact presents the state of @vllm_project at #pytorchcon 2026, highlighting optimizations in KV cache management and kernels across TPU, AMD, and NVIDIA hardware.
The work addresses performance and scalability challenges as LLMs grow in size, context length, and architectural complexity. -
PyTorch
@PyTorch
Jana van Greunen, Director of PyTorch Engineering at @Meta, discusses how Meta’s AI research and production workloads feed back into the open source ecosystem at #pytorchcon 2026.
She highlights Meta’s PyTorch-native stack, including Muse Spark Open and Muse Glimmer, alongside work with Helion, TorchTitan, and ExecuTorch. Jana also covers collaboration with hardware partners to expand PyTorch-native support for AI accelerators. -
PyTorch
@PyTorch
At #pytorchcon 2026, Sara Hooker @sarahookr (@adaption_ai) examines the limits of scaling larger models and the shift toward adaptive intelligence.
Sara discusses post-training, test-time scaling, adaptive compute, and hardware co-design as alternatives to simply scaling pretraining. She highlights AutoScientist examples spanning agent harness optimization, agent memory, and dataset creation.
Her keynote explores how making AI easier to adapt and customize could enable more people to build and own frontier AI.
2026 prediction? "You will build and own frontier AI" -
PyTorch
@PyTorch
Live from #pytorchcon 2026, Robert Hundt (@Amazon) introduces TorchNeuron, the native PyTorch backend for @awscloud Trainium.
Robert shows how TorchNeuron supports eager execution and torch.compile, letting developers train on Trainium using familiar PyTorch code and distributed training APIs.
He also covers how vLLM-Neuron uses torch.compile for serving, and how Neuron Explorer lets developers profile execution from PyTorch down to hardware instructions. @AmazonScience -
PyTorch
@PyTorch
Ray began with reinforcement learning. At #pytorchcon 2026, Ion Stoica @istoica05 (@UCBerkeley / @anyscalecompute traces its evolution into the distributed compute layer behind today’s RL frameworks.
In “Ray’s Evolution to Support AI Workloads,” Ion examines how data processing, training, serving, and post-training have grown in complexity and scale.
He highlights topology-aware scheduling for TPU pods and NVIDIA Blackwell GPUs, GPU-to-GPU transfers using NIXL, and native TorchFT integration.
Looking ahead, he outlines plans to rewrite major Ray components in Rust, integrate more closely with Kubernetes, and work with hardware providers to improve accelerator support. -
PyTorch
@PyTorch
Live from #pytorchcon 2026, Chris Lattner @clattner_llvm (@Qualcomm) shows how developers can extend PyTorch with MAX and Mojo.
Chris addresses the performance work developers repeat for each hardware backend, presenting MAX and Mojo as a shared foundation for running code across hardware from multiple vendors.
Mojo combines Pythonic code with the speed and low-level control of a systems language. MAX provides model authoring and a graph compiler that targets hardware from multiple vendors. -
PyTorch reposted
-
PyTorch
@PyTorch
Now: @Shopify’s continual learning loop with PyTorch and @vLLM_project takes the stage at #pytorchcon 2026 with Cody Mazza-Anthony @cmazzaanthony.
Using Buyer Profile as an example, Cody walks through how a calibrated judge flags low-scoring outputs in production. Critics diagnose each failure, and a replay with a critic hint is scored again by the judge. Accepted repairs expand and improve the training data.
Cody shows how a small specialist model can outperform a frontier model on this task, then turns to optimizing inference through prompt compression.
Watch the keynote livestream: events.linuxfoundation.org/pytorch-conference-north-ameri… -
PyTorch
@PyTorch
Alban Desmaison @albanDesmaison and Edward Yang @ezyang (@Meta) discuss simpler hardware integration and more reliable large-scale training with PyTorch at #pytorchcon 2026.
They cover torch.accelerator, backend testing, and tools to catch problems before expensive training runs, alongside torch_remat for activation checkpointing and FlexShard for separating storage sharding from compute sharding.
Watch the keynote livestream: events.linuxfoundation.org/pytorch-conference-north-ameri… -
PyTorch
@PyTorch
Mark Collier opens Day 1 keynotes at #pytorchcon 2026, exploring how shared advances across the AI stack help the community move faster together.
Live from San Jose, “Accelerating Open Intelligence Together” connects research, models, frameworks, infrastructure, hardware, and production, with a vision of open source software to train and serve any model, on any chip, in any cloud.
The Day 1 program puts those connections into practice, from continuous learning and new approaches to systems programming to distributed infrastructure, hardware integration, AI accelerator enablement, and production-scale inference.
The PyTorch Foundation also welcomes Nebius and Nscale as new Platinum members, bringing more clouds, more hardware, and more production experience to the community.
Up next, Shopify’s Cody Mazza-Anthony shows how production feeds back into how models improve.
Watch the keynote livestream:
events.linuxfoundation.org/pytorch-conference-north-ameri… -
PyTorch
@PyTorch
Welcome @nebiusai to the PyTorch Foundation as a Platinum Member. Nebius brings production-scale AI infrastructure and inference experience to PyTorch and @vllm_project. Ryan Wang @hanrui_w joins our Governing Board and TAC.
Read more: pytorch.org/blog/nebius-joins-the-pytorch-foundation-as-a… -
PyTorch
@PyTorch
We’re excited to welcome @nscale as a Platinum Member of the PyTorch Foundation. Nscale is a full-stack AI cloud platform, bringing together power, data centers, compute and software in one vertically integrated platform.
Nscale first came to the PyTorch Foundation's project ecosystem through @raydistributed, the open source framework for distributed computing and scaling AI workloads. Nick Jones, VP of Cloud Native Platform Engineering, joins the Governing Board, and Eyal Lantzman, VP of AI Services, joins the Technical Advisory Council.
Read the announcement: pytorch.org/blog/nscale-joins-the-pytorch-foundation-as-a… -
PyTorch
@PyTorch
#pytorchcon North America 2026 starts today in San Jose! Can't be here in person? Stream the keynotes live: events.linuxfoundation.org/pytorch-conference-north-ameri…
Over two days, the open source AI community comes together to accelerate open intelligence. Across PyTorch, vLLM, DeepSpeed, Ray, Helion, and Safetensors, the program covers the full AI stack, from bare metal infrastructure to applications and agent-based systems, through technical talks, hands-on workshops, and candid conversations.
Seven tracks run today and tomorrow, October 20–21: Applications, Core PyTorch, Inference, Introduction, Kernel Engineering, Responsible AI, and Training. -
PyTorch
@PyTorch
#pytorchcon North America begins TODAY in San Jose with the people building the open source AI stack, from PyTorch and vLLM to DeepSpeed, Ray, Helion, Safetensors, and beyond.
Not registered yet? There’s still time to join us:
events.linuxfoundation.org/pytorch-conference-north-ameri… -
PyTorch reposted
-
PyTorch
@PyTorch
When GPU memory fills up, @vllm_project offloads the KV cache to CPU or storage. @_llm_d_ tracks where every block lives, and sends each request to its cache. At PyTorch Conference North America, Bongwoo Bak from Moreh will present a poster on "Where the Blocks Live." You'll see when CPU is enough and when shared storage pays off.
Join us at #pytorchcon in San Jose, October 20-21: events.linuxfoundation.org/pytorch-conference-north-ameri…This media couldn't be displayed. See it on the original post. -
PyTorch
@PyTorch
#pytorchcon North America 2026 starts tomorrow in San Jose, bringing the open source AI community together to accelerate open intelligence.
Across PyTorch, @vllm_project, @DeepSpeedAI, @raydistributed, Helion, and Safetensors, our program explores the full AI stack, from bare metal infrastructure to applications and agent-based systems, through technical talks, hands-on workshops, and candid conversations.
Tomorrow and Wednesday, October 20–21, the program spans seven tracks: Applications, Core PyTorch, Inference, Introduction, Kernel Engineering, Responsible AI, and Training.
Keynote speakers include @sparkycollier (PyTorch Foundation); @cmazzaanthony (@Shopify); @albanDesmaison, Edward Yang, Jana van Greunen, and Zongwei Zhou (@Meta); @clattner_llvm (@Qualcomm); @istoica05 (@UCBerkeley / @anyscalecompute); Robert Hundt (@amazon); @sarahookr (@adaption_ai); @simon_mo_ (@inferact); Carlos Costa and Priya Nagpurkar (@IBM); Abdullah Gharaibeh and Bill Jia (@googlecloud); Stephen Watt (@RedHat); Ujval Kapasi (@nvidia); Mazin Gilbert (@AgenticAIFdn); Zhipeng Wang (@Google); Rachad Alao (@cohere); Yiwei Song (@CrusoeAI); and @marksaroufim (Core Automation).
Beyond the talks, exchange ideas in Birds of a Feather discussions, ask questions in Meet the Developers sessions, and watch sponsor presentations in the Demo Theater.
Tuesday offers more opportunities for conversation: discuss presenters’ work at the evening poster session, connect at the Women & Non-Binary in PyTorch Lunch, or meet Inference Engineering author Philip Kiely at his book signing.
Explore the program: events.linuxfoundation.org/pytorch-conference-north-ameri…
Join us at #pytorchcon tomorrow and Wednesday: events.linuxfoundation.org/pytorch-conference-north-ameri… -
PyTorch
@PyTorch
Happening today: The PyTorch Certified Associate Training
Hands-on lectures, Jupyter labs, and practical projects aligned with the PyTorch Certified Associate (PTCA) exam.
#pytorchcon -
PyTorch
@PyTorch
Featured on today's agenda: Powering the Enterprise - executive sessions and workshops with @RedHat, @nvidia and @IBM focused on scaling enterprise AI
#pytorchcon -
PyTorch
@PyTorch
Live from Jupyter Day - one of the co-located events at PyTorch Conference North America 2026 where data scientists, developers and researchers are coming together to discuss interactive computing and AI-assisted workflows.
#pytorchcon @ProjectJupyter -
PyTorch
@PyTorch
If you know PyTorch, you know Trainium. @awscloud is bringing multiple sessions to #pytorchcon in San Jose. AWS Trainium is an AI chip designed from the ground up for next generation deep learning AI training and inference, and now PyTorch runs natively on AWS Trainium --> zero code changes. Same APIs, same debugging, same ecosystem. Markus Adhiwiyogo of AWS, previews how the Neuron team is showing it all: training, profiling, RL, kernel development, and more. @AmazonScience
Join us at PyTorch Conference North America 2026: events.linuxfoundation.org/pytorch-conference-north-ameri…This media couldn't be displayed. See it on the original post. -
PyTorch
@PyTorch
Explore the sessions taking place today at LF AI & Data Summit 2026 where attendees are getting together to discuss open source technologies powering every stage of the AI lifecycle.
#pytorchcon @LFAIDataFdn -
PyTorch
@PyTorch
#pytorchcon North America starts TOMORROW! 🎉
Join us in San Jose for two days of open source AI ideas, code, connections, and serious PyTorch power.
Can’t make it in person? Sign up to watch the keynote livestream: events.linuxfoundation.org/pytorch-conference-north-ameri…
Still time to register: -
PyTorch
@PyTorch
Day 0 of PyTorch Conference North America 2026: From Academia to Adoption Workshop
8 academic projects. Short lightning talks. Hands-on mentoring - helping researchers build sustainable, community-driven open source software.
#pytorchcon -
PyTorch
@PyTorch
PyTorch runs natively on @awscloud Tranium with no code changes. AWS Tranium is @amazon's portfolio of AI chips designed for next-generation deep learning training and inference workloads. You can use it with the tools and workflows you are already familiar with. No new frameworks to learn. No code to change. During PyTorch Conference North America keynote, Robert Hundt, VP Distinguished Engineer, Annapurna Labs, Amazon will share the story and the capabilities AWS provided to meet performance and quality goals. @AmazonScience
#pytorchconThis media couldn't be displayed. See it on the original post. -
PyTorch reposted
Mark Collier 柯理怀
@sparkycollier
Accelerating open intelligence means an open ecosystem of companies, all investing engineering time upstream to improve critical open source software for inference: @vllm_project
Simon Mo
@simon_mo_
A story in 3 acts, last 3 days: AMD, NVIDIA, Google all contribute significant improvement to @vllm_project, measured with @SemiAnalysis_ standard benchmark on K3. Great work from @inferact team shepherding and leading many of the optimizations!!!
-
PyTorch
@PyTorch
Squeeze extra performance out of GPU kernels that are already autotuned to the limit by diving below the kernel level into compiler controls.
@nvidia CompileIQ and PyTorch Helion have united two distinct optimization layers into a single joint search space. While traditional autotuners search tile shapes, warps, and pipeline stages, ptxas compiler decisions like register allocation and fine-grained scheduling are typically left at default settings.
With CompileIQ’s Advanced Control Files (ACFs) integrated directly into Helion’s autotuner, developers can jointly evaluate kernel configurations and compiler controls, unlocking significant speedups on highly optimized production kernels without requiring deep compiler expertise.
Learn how to extract the last mile of performance: pytorch.org/blog/one-search-two-layers-compiler-controls-… -
PyTorch reposted
Amazon Science
@AmazonScience
Announcing TorchNeuron: @PyTorch code now runs natively on AWS Trainium chips with a single configuration change. No rewrite needed.
Open sourcing at #pytorchcon on Oct 20: www.aboutamazon.com/news/innovation-at-amazon/torchneuron… -
PyTorch reposted
Sara Hooker
@sarahookr
Will be at @PyTorch conference tomorrow.
looking forward to a great line-up of speakers. 🔥
adaption
@adaption_ai
The next generation of intelligent systems won't be defined by scale.
It will be defined by intelligence that learns from your work. Co-founder @sarahookr on what that takes, live at @PyTorch Conference on October 20. -
PyTorch
@PyTorch
More hardware choice for PyTorch developers: TorchNeuron registers @awscloud Trainium as a native device, built on the same extension points the community created to make PyTorch hardware-agnostic.
Open sourcing at PyTorch Conference on Oct. 20. pytorch.org/blog/introducing-torchneuron-native-pytorch-b… -
PyTorch
@PyTorch
Ravi Gupta, Shiksha Patel, and Rishi Madduri (@AMD) will present “Efficient Inference of Masked Diffusion Language Models on AMD XDNA2 NPU” at #pytorchcon North America 2026.
Their poster presents a power-efficient deployment of LLaDA-8B-Instruct on an AMD NPU. On a Ryzen AI MAX+ 395 APU at sequence length 128, the NPU vendor path ran at 504 ms per forward at 36 W, compared with 843 ms and 110 W for CPU INT4, making it 1.67x faster and 8.9x better on energy.
The poster will also cover the INT4 quantization and graph-partitioning pipeline, the CastAvx fix, and the runtime approach used for single-step prefill on the XDNA2 NPU.
Register for PyTorch Conference North America 2026: events.linuxfoundation.org/pytorch-conference-north-ameri… -
PyTorch
@PyTorch
Looking for sessions to catch at #pytorchcon North America 2026? Chris Hoge (@nvidia), co-chair of the PyTorch Ecosystem Working Group, highlights five talks for developers working on open source training and performance.
Hoge will co-present “Ecosystem Working Group: Unlocking Community Impact Through the PyTorch Landscape,” covering what the PyTorch Ecosystem Landscape is, how projects can apply for ecosystem status, and how lifecycle management works for Landscape projects.
He also highlights sessions featuring NVIDIA engineers on hiding expert parallel communication in Mixture-of-Experts training, parameterized dynamic-shaped CUDA graphs, building fused compute-communication kernels with PyTorch Symmetric Memory, and scaling PyTorch data loaders by a factor of 10.
Register for PyTorch Conference North America 2026: events.linuxfoundation.org/pytorch-conference-north-ameri…This media couldn't be displayed. See it on the original post. -
PyTorch
@PyTorch
How do you deliver full API parity across heterogeneous accelerators with zero additional overhead?
At PyTorch Conference North America 2026, Zesheng Zong (@Huawei), PyTorch Foundation Ambassador and Accelerator Integration Working Group Co-Chair, will share key technical updates on backend integration.
The community is adapting over 600,000 upstream test cases to be generic across all backends, providing a scalable path toward complete API parity. Alongside this effort, Cross-Repository CI Relay connects every PyTorch pull request directly to accelerator repositories, enabling real-time bidirectional testing, early regression detection, and a lower barrier to entry for out-of-tree hardware maintainers.
Join us in San Jose, California next week to see how these foundational updates simplify hardware enablement across the ecosystem: events.linuxfoundation.org/pytorch-conference-north-ameri…
#pytorchcon @Zesheng_Zong -
PyTorch
@PyTorch
ExecuTorch is now an official @ZephyrIoT external module, bringing PyTorch model deployment into Zephyr’s firmware build workflow.
Zephyr Project’s walkthrough covers setup and runs quantized MobileNetV2 on an Alif Ensemble E8 DevKit, with the convolutional graph on the Arm Ethos-U55 NPU and input quantization and output dequantization on the Cortex-M55 CPU.
Read more: www.zephyrproject.org/executorch-integrated-with-zephyr-r… -
PyTorch
@PyTorch
🤠 Hats off to our #pytorchcon North America diamond sponsors. Connect with the people building the future of machine learning in San Jose, CA on October 20-21. Learn more: events.linuxfoundation.org/pytorch-conference-north-america/
-
PyTorch
@PyTorch
Zephon’s TorchTitan integration preserves identical global batches when training resumes on a different GPU count.
In our latest blog’s 1B-parameter model test, training resumed from a 16-GPU checkpoint on 8, 32, and 64 GPUs, and the SHA-256 hash of every global batch matched the original run.
Zephon tokenizes, packs, shuffles, and mixes data inside the training job, avoiding a preprocessed copy of the corpus.
The data, tokenizer, seed, mixture, context length, and global batch size must stay unchanged when resuming. The lane count must divide evenly across data-parallel replicas, and each optimizer step’s batch must split evenly across lanes. Training losses can still differ because floating-point reduction order depends on GPU count.
✍️ @datologyai @josh_wills @MaxiBoether, Ties Robroek (@datologyai)
Read more: pytorch.org/blog/bringing-elastically-deterministic-data-… -
PyTorch
@PyTorch
Ray All the Way Down: A Heterogeneous, Elastic PyTorch Training Stack at LinkedIn
Join Tommy Li and Tao Huang from @LinkedIn at PyTorch Conference North America 2026 for their lightning talk, Ray All the Way Down, on October 20.
They will share how Ray coordinates CPU preprocessing and GPU training across LinkedIn's distributed pipelines, maintaining high performance, resilient scaling, and flexible data loading for reinforcement learning workflows.
Join the open source AI community in San Jose: events.linuxfoundation.org/pytorch-conference-north-ameri…
#pytorchcon -
PyTorch reposted
LightSeek Foundation
@lightseekorg
Day-0 support for Muse Spark Open on TokenSpeed.
190 output tokens/s per user on NVIDIA B300 — and that’s without speculative decoding.
Also supported on AMD Instinct MI355X.
👉 github.com/lightseekorg/tokenspeed
AI at Meta
@AIatMeta
Today we’re releasing Muse Spark Open, the most capable US open-weight model to date.
Built for coding and agentic work, it excels at long-horizon tasks, complex software engineering, and multi-step reasoning.
Key Model Specs:
→ 816B total / 42B active parameters
→ 1M token context window
→ Natively multimodal across text, image, video, audio -
PyTorch
@PyTorch
High 5️⃣ to our #pytorchcon North America gold sponsors. Top AI pioneers, researchers, and developers are gathering in San Jose, CA on October 20-21. Don't miss your chance to join! Learn more: events.linuxfoundation.org/pytorch-conference-north-america/
-
PyTorch
@PyTorch
If you know PyTorch, you know Trainium. @AWS is bringing multiple sessions to #pytorchcon in San Jose. AWS Trainium is an AI chip designed from the ground up for next generation deep learning AI training and inference, and now PyTorch runs natively on AWS Trainium --> zero code changes. Same APIs, same debugging, same ecosystem.
Markus Adhiwiyogo of AWS previews how the Neuron team is showing it all: training, profiling, RL, kernel development, and more.
Join us at PyTorch Conference North America 2026: events.linuxfoundation.org/pytorch-conference-north-ameri…This media couldn't be displayed. See it on the original post. -
PyTorch reposted
vLLM
@vllm_project
🎉 Day-0 support for Meta's open-weight Muse Spark Open is
live on vLLM, verified on NVIDIA and AMD GPUs as well as on TPUs!
816B parameters, 42B active per token, a 1M-token image, video and audio inputs, built for long-horizon agentic coding.
We’re excited to have worked with Meta Superintelligence Labs to bring Muse Spark Open to vLLM from day one as the most capable US open-weight model.
✨ 1M context for large, complex codebases
👀 Native image, video, audio & document understanding
⚡ BF16, NVFP4 & MXFP4 support
🚀 DSpark speculative decoding on both CUDA and ROCm
1/6 -
PyTorch reposted
Ana JS
@anajsana95
At our first #pytorchmadrid meetup, @SergioPaniego explored TRL + OpenEnv for agent post-training!
Made me think of @goose_oss from @AgenticAIFdn 👀 Open source agent harnesses can also play a role in RL training helping models learn from tool use 💡 -
PyTorch
@PyTorch
🎉 THANK YOU to our #pytorchcon North America platinum sponsors. Hands on workshops, deep technical talks, and a buzzing community expo land in San Jose, CA on October 20-21. Learn more: events.linuxfoundation.org/pytorch-conference-north-america/
-
PyTorch
@PyTorch
FIVE. DAYS. 🔥
200+ talks and posters. 400+ speakers. Thousands of open source AI builders. One very energized city.
#pytorchcon North America lands October 20-21 in San Jose, and there’s still time to get your pass:
events.linuxfoundation.org/pytorch-conference-north-ameri… -
PyTorch reposted
vLLM
@vllm_project
1/ 🚀 New on the vLLM blog: Finish RL Training Faster — Bitwise-Consistent, High-Performance, Agent-Driven
Same weights don't guarantee the same policy: inference optimizations can change the logprobs that training recomputes.
We make rollout and training bitwise identical while retaining high-performance inference paths. Here's how 🧵
vllm.ai/blog/2026-10-14-train-inference-consistency -
PyTorch
@PyTorch
Arm Cortex-M microcontrollers power everyday devices from wearables to industrial sensors and home appliances. Deploying a PyTorch model to these edge devices no longer requires leaving the PyTorch ecosystem.
Through the ExecuTorch Cortex-M backend, quantized models lower directly to Arm's CMSIS-NN kernels. Because target hardware parameters are known at compile time, operator selection, weight layout, and memory planning are resolved ahead of time, allowing the core runtime to fit in under 20 KiB of flash.
Learn more about this technical milestone, developed in collaboration with @Arm, here: pytorch.org/blog/bringing-executorch-to-arm-cortex-m-cpus/ -
PyTorch reposted
Sergio Paniego
@SergioPaniego
First @PyTorch Madrid meetup! On to many more!
madrid.pytorch.es
Ana JS
@anajsana95
At our first #pytorchmadrid meetup, @SergioPaniego explored TRL + OpenEnv for agent post-training!
Made me think of @goose_oss from @AgenticAIFdn 👀 Open source agent harnesses can also play a role in RL training helping models learn from tool use 💡 -
PyTorch
@PyTorch
PyTorch Conference North America 2026 program committee member Ricardo Aravena (@raravena80) (Nunchux AI) calls #pytorchcon a great place to connect with the people building the future of machine learning, learn practical ideas from the community, and bring fresh inspiration back to your work.
He’s looking forward to the conversations, new perspectives, and the chance to see what others are creating with PyTorch.
Register for next week’s PyTorch Conference North America 2026: events.linuxfoundation.org/pytorch-conference-north-ameri… -
PyTorch
@PyTorch
🚀 The PyTorch Day Japan 2026 SCHEDULE IS LIVE!
events.linuxfoundation.org/pytorch-day-japan/program/sche…
Ready to see what’s on the agenda? Explore a full day of technical talks, lightning talks, and community conversations covering the technologies shaping the future of open source AI. 🔥 Register by Nov. 11 and save ¥3,000! Get your pass for just ¥5,000. 💴 -
PyTorch
@PyTorch
🥂 Cheers to our #pytorchcon North America diamond sponsor Qualcomm. Come learn, connect, and shape what's next in AI in San Jose, CA on October 20-21. Learn more: events.linuxfoundation.org/pytorch-conference-north-america/
-
PyTorch
@PyTorch
Sponsor news from @NVIDIAAI: PyTorch Conference is where our engineers share the work — and this year, we have a lot to share.
12 talks and 25 poster sessions across numerous areas:
- Compiler & CUDA Graphs — dynamic shape support, MoE training, shape-stable control flow, formal methods with Inductor-TV
- Low-precision training & inference — FP4 quantization, FP8 multimodal training, FP8-RL, NVFP4 pretraining
- Distributed systems — fused compute-comms with Symmetric Memory, NCCL extensions, elastic expert parallelism in vLLM, resilient distributed with NCCL Shrink & Revoke
- Physical & agentic AI — building the World Action Model (WAM) with PyTorch, multi-teacher distillation for agentic models, closed-loop robotics evaluation
The developers behind this work will be presenting and taking questions. If you're attending, these are sessions worth prioritizing.
📅 Oct 20-21 | San Jose Convention Center
🔗Register events.linuxfoundation.org/pytorch-conference-north-ameri… -
PyTorch
@PyTorch
🎤 Meet @istoica05, @UCBerkeley Professor and @anyscalecompute Executive Chairman, taking the keynote stage at #pytorchcon North America.
Hear how Ray and Kubernetes are evolving together for the AI era.
📅 October 20-21
📍 San Jose, CA
Register:
events.linuxfoundation.org/pytorch-conference-north-ameri… -
PyTorch reposted
Ricardo Aravena
@raravena80
Join me at the @PyTorch Conference in San Jose next week Oct 20-21 events.linuxfoundation.org/pytorch-conference-north-ameri…. Use promo code PCINVITE to get 50% off your ticket!
-
PyTorch
@PyTorch
We ❤️ our #pytorchcon North America diamond sponsor Meta. Learn straight from the people advancing open source machine learning in San Jose, CA on October 20-21. Learn more: events.linuxfoundation.org/pytorch-conference-north-america/
-
PyTorch
@PyTorch
@IBMResearch and PyTorch continue to push the boundaries of AI infrastructure and open source innovation.
Join us at #pytorchcon 2026 for a keynote from @PriyaNagpurkar, VP of AI-native Systems Research at IBM, technical sessions covering vLLM and PyTorch performance, and interactive demos featuring the llm-d project and the IBM Spyre Accelerator.
Register: events.linuxfoundation.org/pytorch-conference-north-ameri…
View IBM's conference agenda, accepted publications, and related press: ibm.biz/pytorch2026 -
PyTorch
@PyTorch
When you run a model over a long context, the KV cache gets huge, so you have to throw some of it away. There are competing rules for choosing what to drop: keep the most recent tokens, keep the ones that get the most attention, and so on. The problem is that every method ships its rule welded to its own kernel. So if one method beats another, you can't tell whether the rule was smarter or the code was just faster.
At #pytorchcon North America, Huanran Wang of @AMD will present the poster: FlexBudget: Interchangeable KV Importance Signals under One Compiled FlexAttention Budget We hold the kernel and the memory budget fixed, and swap only the rule. Same code, same allowance, honest comparison. It's training-free, and it's all core PyTorch.
Join us in San Jose, October 20-21 to learn more: events.linuxfoundation.org/pytorch-conference-north-ameri…This media couldn't be displayed. See it on the original post. -
PyTorch
@PyTorch
🎤 Meet Abdullah Gharaibeh, Senior Staff Software Engineer at @googlecloud and a #pytorchcon North America keynote speaker.
Hear how open source infrastructure is helping inference meet production-scale demands.
📅 October 20-21
📍 San Jose
Register: events.linuxfoundation.org/pytorch-conference-north-ameri… -
PyTorch
@PyTorch
What does it take to support new AI hardware within PyTorch?
In our latest blog, contributors from @IBM share how they extended PyTorch Inductor for the IBM Spyre Accelerator, leveraging PyTorch's compiler to address challenges in data movement, memory management, and work distribution while optimizing for Spyre's unique architecture.
Read on for a look at how PyTorch's extensibility helps developers bring support for new hardware to the framework:
pytorch.org/blog/extending-inductor-for-the-ibm-spyre-acc… -
PyTorch
@PyTorch
Calling all academic researchers & early open source devs! Learn how to turn your promising research into lasting open source tools and showcase your project in our lightning talks!
Join us for the Day 0 "From Academia to Adoption" Workshop before PyTorch Conference North America.
Oct 19 | 9:00 AM – 12:00 PM
San Jose Convention Center (Room 211A)
Submit your project here: forms.gle/JZkE8cxiAMmfvosbA -
PyTorch
@PyTorch
Get more out of your AI infrastructure.
Carlos Costa, Distinguished Engineer at @IBMResearch and co-founder of the @_llm_d_ project will share some exciting news about llm-d: how the project changed the way the open source AI community scales inference at PyTorch Conference North America.
A little over a year after the project was founded, llm-d is reaching a new level of maturity, delivering state-of-the-art performance for generative serving, while also enabling the capabilities needed for day two operations, including multi-tenant quality of service, zero downtime operations, and all of that without sacrificing performance in production.
Join us in San Jose, October 20-21: events.linuxfoundation.org/pytorch-conference-north-ameri…This media couldn't be displayed. See it on the original post. -
PyTorch
@PyTorch
🎤 Meet Carlos Costa, Distinguished Engineer at @IBM and a #pytorchcon North America keynote speaker.
Join him for “Open Source Inference at Production Scale” and explore the infrastructure helping open AI models serve serious demand.
📅 October 20-21
📍 San Jose
Register: -
PyTorch
@PyTorch
Last call to sign up for the live in-person PyTorch Associate Training the day before PyTorch Conference North America in San Jose, CA where you'll learn how to build and optimize real-world models from scratch.
Included is a voucher ($250 value) to take the new PyTorch Certified Associate (PTCA) certification exam.
Sign up for this training at: events.linuxfoundation.org/pytorch-conference-north-ameri… #pytorchcon -
PyTorch
@PyTorch
🚨 Final days to join #opensourceaiweek!
Submit your Bay Area open source AI event by October 15. The week runs October 16-25, featuring flagship events #pytorchcon and #agntcon + #mcpcon North America in San Jose.
Learn more & add your event by Oct 15:
events.linuxfoundation.org/open-source-ai-week/ -
PyTorch reposted
Masahiro Hiramori
@mshrh3
See you at PyTorch Conference NA in San Jose, October 20–21!
Get 50% off tickets with code PCINVITE: events.linuxfoundation.org/pytorch-conference-north-ameri…
PyTorch
@PyTorch
PyTorch Ambassador and #pytorchcon North America 2026 program committee member Masahiro Hiramori (@mshrh3), @ME_JP_official, will be following work across on-device AI, efficient inference, voice agents, and machine learning compilers at this year’s conference.
He's also looking forward to exchanging ideas with other developers and seeing what the broader PyTorch community is building.
Register for PyTorch Conference North America 2026: events.linuxfoundation.org/pytorch-conference-north-ameri…This media couldn't be displayed. See it on the original post. -
PyTorch
@PyTorch
PyTorch Ambassador and #pytorchcon North America 2026 program committee member Masahiro Hiramori (@mshrh3), @ME_JP_official, will be following work across on-device AI, efficient inference, voice agents, and machine learning compilers at this year’s conference.
He's also looking forward to exchanging ideas with other developers and seeing what the broader PyTorch community is building.
Register for PyTorch Conference North America 2026: events.linuxfoundation.org/pytorch-conference-north-ameri…This media couldn't be displayed. See it on the original post. -
PyTorch
@PyTorch
The #pytorchcon North America countdown has hit double digits! 🔟
In 10 DAYS, 400+ speakers and 3,500+ attendees will meet in San Jose to talk training, inference, agents, kernels, open source AI, and everything in between.
Join us October 20-21:
events.linuxfoundation.org/pytorch-conference-north-ameri… -
PyTorch
@PyTorch
Running large Mixture-of-Experts models across pods creates two major challenges: expert dispatch and combine traffic, and moving the KV cache between prefill and decode.
At #pytorchcon North America 2026, Ravi Gupta, Rishi Madduri, and Shiksha Patel (@AMD) will present “MoRI + vLLM: Wide Expert Parallelism and RDMA KV-Cache Transfer for Disaggregated MoE Serving on AMD.”
The poster will show how bringing the MoRI communication stack into @vllm_project enables Wide Expert Parallelism across pods using RDMA and moves the KV cache for disaggregated prefill and decode on AMD Instinct GPUs.
They will also cover correctness and stability issues encountered when spanning pods and share vLLM benchmark results for long, high-concurrency workloads.
Register for PyTorch Conference North America 2026: events.linuxfoundation.org/pytorch-conference-north-ameri… -
PyTorch
@PyTorch
SGLang-Diffusion is a high-performance serving framework for diffusion models, designed for both large-scale offline generation and latency-sensitive real-time inference.
At PyTorch Conference North America 2026, Yihao Wang and Kevin Mi of @RadixArk will present the design of @sgl_project-Diffusion and the PyTorch-based inference optimizations behind it, including efficient request scheduling, memory management, batching strategies, and execution-path optimizations for diffusion pipelines.
Join us in San Jose, October 20-21: events.linuxfoundation.org/pytorch-conference-north-ameri… #pytorchconThis media couldn't be displayed. See it on the original post. -
PyTorch
@PyTorch
A round of applause for our #pytorchcon North America diamond sponsor Google. From bare metal infrastructure to agent based systems, it's all on the agenda in San Jose, CA on October 20-21. Learn more: events.linuxfoundation.org/pytorch-conference-north-america/
-
PyTorch
@PyTorch
Sponsor news from @CrusoeAI: We’ll be in San Jose for #pytorchcon North America Oct 20-21.
🎤 Talks on Triton, MoE fine-tuning + model customization
🤖 Booth demos + challenges
🍻 AI Infra Night with @dstackai, @sgl_project (@lmsysorg)
Learn more: events.linuxfoundation.org/pytorch-conference-north-america/
Register for AI Infra Night: 🔗 luma.com/6j69xyal
#pytorchfoundation -
PyTorch
@PyTorch
Connect with Madrid’s PyTorch community on October 14 to share real-world experiences and discuss technical questions.
PyTorch Meetups Madrid welcomes developers deploying models in production, AI researchers, people launching new projects, and anyone taking their first steps in machine learning.
The free meetup runs from 6:00–8:30 pm.
Madrid meetup series: pytorch.org/series/pytorch-meetups-madrid-spain/ -
PyTorch
@PyTorch
🎤 Meet @cmazzaanthony, Senior Staff ML Engineer at @Shopify and a #pytorchcon North America keynote speaker.
See how Shopify uses PyTorch and vLLM to continually evaluate, repair, and improve models while cutting cost and latency.
📅 October 20-21
📍 San Jose
Register: -
PyTorch
@PyTorch
High-Velocity GPU Kernel Authoring with CUTLASS Python
Join Guray Ozen from @nvidia at PyTorch Conference North America 2026, where he will present recent improvements to CUTLASS for Python.
CUTLASS for Python is the technology stack used to write speed-of-light kernels for the latest GPU generations, powering today's most critical AI workloads. In his presentation, Guray will introduce several new productivity features for developers and agents, including CuTe extensions, CUTLASS primitives, a task scheduler, compiler diagnostics, and static checks to help catch errors before launch.
Join us on October 20-21 in San Jose: events.linuxfoundation.org/pytorch-conference-north-ameri…
#pytorchcon -
PyTorch
@PyTorch
Sponsor news from @awsdevelopers: PyTorch now runs natively on AWS Trainium. See it live at PyTorch Conference NA (Oct 20-21, San Jose) where Robert Hundt, VP Distinguished Engineer at Amazon, will keynote, followed by a live demo from Maen Suleiman, Principal PM, AWS Neuron.
Keynote: events.linuxfoundation.org/pytorch-conference-north-ameri…
Demo: events.linuxfoundation.org/pytorch-conference-north-ameri…
#pytorchcon #aws #trainium #opensource #ai -
PyTorch
@PyTorch
Generative recommender systems reformulate personalization as sequence modeling over user behavior, and NVIDIA recsys-examples now provides an end-to-end HSTU inference workflow with Dynamo-Triton.
PyTorch AOTI compiles HSTU ranking models into native C++ artifacts, while FlexKV-backed KV caching stores reusable attention state to avoid recomputing long user histories.
On an @nvidia RTX PRO 6000 Blackwell Workstation Edition GPU, the eight-layer HSTU model achieved up to 5.93x lower latency at batch size 8 with a 100% GPU KV-cache hit rate compared to the same AOTI configuration without caching.
Read the full blog post: developer.nvidia.com/blog/deploying-an-hstu-generative-re… -
PyTorch
@PyTorch
Optimizing kernels can be time-consuming and require deep expert knowledge. KernelAgent is a multi-agent harness that can write and optimize kernels for you.
At #pytorchcon North America 2026, @KaimingCheng (@Meta) will present “KernelAgent: Hardware-Guided GPU Kernel Optimization via Multi-Agent Orchestration.”
The session will cover a hardware-guided optimization layer that integrates GPU hardware-performance signals into a closed-loop multi-agent workflow to guide optimization for Triton kernels. Across all 100 KernelBench L1 tasks evaluated, KernelAgent achieved a 2.02x speedup over kernels generated by earlier versions and an average 1.56x speedup compared with default torch.compile.
Register for PyTorch Conference North America 2026: events.linuxfoundation.org/pytorch-conference-north-ameri… -
PyTorch
@PyTorch
Agentic workloads generate long, expanding context across repeated model calls, tool execution, and parallel subagents. Much of this context remains stored in the KV cache while an agent waits on external tools or pending operations.
Efficient serving relies on preserving and reusing this PyTorch tensor state while maintaining sub-second latency targets across concurrent sessions.
Read our latest blog from @nvidia to learn how NVIDIA Dynamo integrates its router, inference engine, and KV-cache manager to deliver seamless end-to-end serving for agentic workloads: pytorch.org/blog/session-aware-agentic-inference-with-nvi… -
PyTorch
@PyTorch
Explore how @AMD is helping developers build and optimize #ai with ROCm across cloud and client environments. Visit their booth at #pytorchcon North America 2026 for hands-on labs, technical sessions, open-source AI innovation, and connecting directly with AMD engineers. Learn more: events.linuxfoundation.org/pytorch-conference-north-america/
-
PyTorch
@PyTorch
🎤 Meet Zongwei Zhou, Software Engineer at @Meta and a #pytorchcon North America keynote speaker.
Explore how TorchTPU and agent-driven development can make complex AI workloads portable and performant across hardware.
📅 October 20-21
📍 San Jose
Register: -
PyTorch
@PyTorch
Bridging the ExecuTorch Adoption Gap Through Developer Learning
Join Matt Cossins from @Arm at PyTorch Conference North America 2026 in San Jose, CA for a Birds of a Feather discussion session on ExecuTorch. Matt will be covering how to transition from ExecuTorch examples and tutorials to real-world applications, as well as discussing ways to make that learning journey easier.
Whether you are new to ExecuTorch, an experienced practitioner, or interested in creating ExecuTorch learning content, join the discussion to learn more.
Join us on October 20-21: events.linuxfoundation.org/pytorch-conference-north-ameri…
#pytorchcon -
PyTorch
@PyTorch
How can a single framework support an increasingly diverse range of AI hardware?
In a new PyTorch Foundation blog, contributors from @IBM share how Spyre was integrated using existing PyTorch abstractions for devices, streams, memory management, and compilation.
The result is a more seamless developer experience, a more robust Spyre runtime, and a PyTorch ecosystem that can support a broader range of hardware without requiring a separate framework for each device.
Learn more here: pytorch.org/blog/building-spyre-as-a-native-pytorch-device/ -
PyTorch
@PyTorch
Involved in the AI ecosystem? There's something for everyone at PyTorch Conference North America.
Steve Pousty of @RedHat explains why you should attend from the new intro track added this year to poster sessions, booths, and colocated events.
Steve is giving a talk on the use of PyTorch and PyTorch-based libraries from the ecosystem to do remote sensing for satellite imagery.
Join us in San Jose, October 20-21: events.linuxfoundation.org/pytorch-conference-north-ameri…
#pytorchconThis media couldn't be displayed. See it on the original post.
PyTorch
@PyTorch
#pytorchcon Day 0 event: PyTorch, Powering the Enterprise with @RedHat, @NVIDIA, and @IBM on October 19th will explore how PyTorch has begun delivering essential enterprise-level features and enhancements, specifically tailored to enterprise use cases: events.linuxfoundation.org/pytorch-conference-north-ameri…
-
PyTorch
@PyTorch
🎤 Meet Robert Hundt, VP Distinguished Engineer at @awscloud and a #pytorchcon North America keynote speaker.
Hear how Trainium gained native PyTorch support, from eager mode and torch.compile to TorchTitan and TorchAO.
📅 October 20-21
📍 San Jose
Join us! -
PyTorch
@PyTorch
Looking forward to it!
Red Hat AI
@RedHat_AI
PyTorch moved from research labs to running enterprise AI. On Monday Oct 19, @RedHat, @NVIDIAAI, and @IBM host a day in San Jose: @vllm_project economics, @_llm_d_ at scale, and agents in production, with the @PyTorch maintainers behind them.
Register: luma.com/wjmtvwvw -
PyTorch
@PyTorch
Replacing CUDA with FBTriton for Table Batched Embedding (TBE) kernels delivered massive gains for our rec sys models.
@Meta contributors achieved up to 1.28x faster forward passes, 2x faster backward passes, and a huge boost in developer velocity. Check out the engineering deep-dive: pytorch.org/blog/modernizing-table-batched-embeddings-wit…
✍️ Daohang Shi, Oleksandr Stashuk, Rupert Wu, Liangbei Xu, Rich Zhu -
PyTorch
@PyTorch
Think @DeepSpeedAI is only good for ZeRO and its usability, not training throughput?
At #pytorchcon North America 2026, Masahiro Tanaka will cover tensor, sequence, and expert parallelism in DeepSpeed and walk through benchmarks.
His session, “DeepSpeed Is Not Just ZeRO: Tensor, Sequence, and Expert Parallelism with ZeRO-Level Usability,” will cover AutoTP, AutoSP, and AutoEP, how these capabilities can be combined with ZeRO, and where each parallelism strategy fits.
Register for PyTorch Conference North America 2026: events.linuxfoundation.org/pytorch-conference-north-ameri… -
PyTorch
@PyTorch
October 19: @RedHat, @NVIDIA AI, and @IBM are hosting “PyTorch, Powering the Enterprise,” a #pytorchcon North America Day 0 event. The in-person event will explore PyTorch and the ecosystem shaping the future of enterprise AI.
PyTorch and technologies across the ecosystem like @vllm_project, @raydistributed, Helion, and @_llm_d_ have become foundational to the AI stack, moving from research labs into production at some of the world’s largest enterprises.
Attendees will hear from and interact with the companies helping to bring PyTorch to its full enterprise potential, with conversations spanning AI infrastructure, deployment, security, and the open source ecosystem.
🔗 Learn more and register: luma.com/wjmtvwvw
🔗 Register for #pytorchcon NA: events.linuxfoundation.org/pytorch-conference-north-ameri… -
PyTorch
@PyTorch
From torch.profiler to Hardware Cycles: A Practical Profiling Playbook
AWS Trainium: designed from the ground up for next generation AI training and inference is now a standard PyTorch device. When you need to optimize, the tools are built in. Esha Lakhotia and Pinak Panigrahi of @awscloud will walk you from torch.profiler capture to cycle-level hardware debugging, with AI-assisted analysis that suggests fixes at PyTorch Conference North America.
📅 Oct 21 | 12:20 PM | LL21ABC
Join us in San Jose, October 20-21: events.linuxfoundation.org/pytorch-conference-north-ameri…
#pytorchconThis media couldn't be displayed. See it on the original post. -
PyTorch
@PyTorch
The #opensourceaiweek lineup is loading. Is your event on it? ⏳
Join the Bay Area celebration, October 16-25, with flagship events #pytorchcon North America, October 20-21, and #agntcon + #mcpcon North America, October 22-23.
Submit your event by October 15: -
PyTorch
@PyTorch
Over the last two years, @Meta has consolidated PyTorch's media stack across three libraries: TorchCodec, TorchVision, and TorchAudio.
TorchCodec serves as the single home for CPU and CUDA media decoding and encoding across images, video, and audio. TorchVision and TorchAudio now focus strictly on high performance media transforms.
Read the full technical debrief to learn more about what has changed and why: pytorch.org/blog/evolution-of-the-pytorch-media-processin…
PyTorch
@PyTorch
Many thanks to @hug_nicolas and @_scottas for all this great work!
-
PyTorch
@PyTorch
PyTorch Conference is where the open source Al community gathers to talk about what we are all building together.
Priya Nagpurkar, VP of AI Native Systems at @IBMResearch will give a keynote at #pytorchcon North America on @IBM & @RedHat's contributions to the PyTorch ecosystem, including exciting developments on infrastructure for out-of-tree accelerators, enablement of IBM's Spyre Accelerator, and work with Ilm-d for distributed inference.
Come to the talk, meet the community, and hear what's next in open source Al. Join us in San Jose, October 20-21: events.linuxfoundation.org/pytorch-conference-north-ameri…This media couldn't be displayed. See it on the original post. -
PyTorch
@PyTorch
15 DAYS until the open source AI community takes over San Jose! 🔥
Join 3,500+ attendees for two packed days of PyTorch, vLLM, DeepSpeed, Ray, Helion, Safetensors, and much more.
📅 October 20-21
📍 San Jose
There’s still time to register for #pytorchcon North America: -
PyTorch
@PyTorch
The PyTorch Accelerator Integration Working Group is working to establish standard hardware enablement mechanisms across the platform to unify cross-backend testing, profiling, compiler support, and distributed execution.
So far this year, the group has delivered the cross-repository CI Relay (CRCR), device-agnostic test suite refactoring, the maturing OpenReg reference backend, distributed & torch.compile support, and the official Additional Compute Platforms portal - standardizing integration paths and lowering onboarding friction for all hardware accelerators across the ecosystem.
Read the full technical recap to see how vendor-neutral collaboration keeps PyTorch scalable across heterogeneous compute platforms: pytorch.org/blog/pytorch-hardware-enablement-updates-from… -
PyTorch
@PyTorch
ERRC: Entropy-Reinvested Residual Correction for Tensor-Parallel LLM Communication
PyTorch Foundation Ambassador Abdulsalam Bande will present a poster on ERRC (Entropy-Reinvested Residual Correction for Tensor-Parallel LLM Communication) at PyTorch Conference North America 2026.
ERRC focuses on optimizing GPU data exchange during LLM inference. By compressing inter-GPU communication and using the saved bandwidth to mitigate quantization errors, ERRC makes multi-GPU inference significantly more efficient.
Register and join us to San Jose, October 20-21: events.linuxfoundation.org/pytorch-conference-north-america/
#pytorchcon @abdulsalambande -
PyTorch
@PyTorch
Modern AI workloads rely on a growing range of specialized GPU kernels, and no single kernel generation backend is optimal across every operator.
At #pytorchcon North America 2026, Liz Li and Jiahui Cao (@AMD) will present “Extending TorchInductor with FlyDSL: A New MLIR-Native Backend for High-Performance GEMMs.”
Liz and Jiahui will share how FlyDSL, AMD’s Python-native and MLIR-based GPU kernel DSL, integrates with TorchInductor’s compilation and autotuning pipeline while preserving the torch.compile user experience. The session will also present performance results for transformer training and inference on AMD Instinct GPUs, comparing Triton and FlyDSL implementations.
Register for PyTorch Conference North America 2026: events.linuxfoundation.org/pytorch-conference-north-ameri…This media couldn't be displayed. See it on the original post. -
PyTorch
@PyTorch
Helion, PyTorch's kernel DSL, is showing what autotuned high-level kernels can do for production inference.
In this post, we integrate Helion into @vllm_project linear backend and show how a single Helion GEMM implementation can cover multiple algorithmic variants — Standard GEMM, Split-K, and Swap-AB — with the best variant and config selected automatically per shape. On @nvidia Hopper GPUs, combining per-shape tuning with hybrid dispatch outperforms vLLM's default CUTLASS and DeepGEMM backends across the evaluated models, with consistent end-to-end gains and more than 10% throughput improvement on some workloads.
Read our latest blog: pytorch.org/blog/building-a-high-performance-and-portable…
✍️ Sean Chen (@RedHat) and Shangdi Yu (PyTorch, @Meta Platforms) -
PyTorch
@PyTorch
NEW! Take the PyTorch Certified Associate (PTCA) Certification Pathway which combines focused learning modules & the PyTorch Certified Associate (PTCA) certification exam together in one structured experience. The pathway includes 4 self-paced learning modules plus the PTCA certification exam with a focus on:
PyTorch Fundamentals
Data Handling in PyTorch
PyTorch Model Development
Optimizing PyTorch
Together, the modules cover core skills across the same key areas measured by the PTCA certification, from working with tensors and devices to preparing data, building neural networks, and improving model performance. Learn more: pytorch.org/blog/new-pathway-to-pytorch-certified-associa… -
PyTorch
@PyTorch
New keynote alert! 🎤
Rachad Alao, VP of Engineering at @Cohere, joins #pytorchcon North America to explore how open science can help AI foundation models advance with transparency, security, speed, and scale.
📅 October 20-21
📍 San Jose
Save your seat: -
PyTorch
@PyTorch
Our latest blog presents work on Jagged Flash Attention (JFA) — the attention kernel behind @Meta's Generative Ads Model (GEM) — on @NVIDIA Blackwell (B200), built with TLX (Triton Low-level Extensions), which add explicit, hardware-aware control on top of Triton's high-level, tile-based programming model.
The TLX attention kernel is about 3.2K lines of concise Triton-level code — roughly 3× less than the ~10K-line CuteDSL kernels of the state-of-the-art FlashAttention-4 (FA4), and it outperforms FA4 on the jagged shapes that matter for GEM — by ~13% on the forward pass and ~50% on the backward pass.
Read it here: pytorch.org/blog/optimizing-jagged-flash-attention-with-t…
✍️ Han Xu, Jacky Zhou, Jackie (Jiaqi) Xu, Hongtao Yu, Peng Chen (Dev Infra), Darren Liu, Dev (Devashish) Shankar (@dev17392), Max Leung, Nick Riasanovsky, Hao Yan, Manman Ren, Yuanwei (Kevin) Fang -
PyTorch reposted
Crusoe
@CrusoeAI
We’ll be in San Jose for @PyTorch Conference North America Oct 20 - 21.
🎤 Talks on Triton, MoE fine-tuning + model customization
🤖 Booth demos + challenges
🍻 AI Infra Night with @dstackai, @SGLang (@lmsysorg)
Register: 🔗 luma.com/6j69xyal
#pytorchcon #pytorchfoundation -
PyTorch
@PyTorch
Want to hear more about new vLLM and SGLang engines built on a new PyTorch-native TPU backend, TorchTPU?
Find Qi Zhou of @Google, Colin Taylor and Angela Yi of @Meta at PyTorch Conference North America in San Jose where they will discuss how they focused on making the existing @sgl_project & @vllm_project infrastructure work natively on TPU, preserving the schedulers, batching systems, OpenAI-compatible APIs, and torch.compile workflows already familiar to GPU users.
Because the serving engines remain upstream, new models and features can run on TPU without requiring separate TPU-specific implementations. Learn more about how it works across the stacks & what they learned running this in production, including compile time, device placement under tracing, KV cache layout, and cross-chip collectives.
Register for #pytorchcon NA now: events.linuxfoundation.org/pytorch-conference-north-ameri…This media couldn't be displayed. See it on the original post. -
PyTorch
@PyTorch
Your next favorite #pytorchcon North America session might take only 10 minutes. ⏱️
Visit the Demo Theater in the Community Expo for compact demos with plenty of compute.
Schedule:
events.linuxfoundation.org/pytorch-conference-north-ameri…
Join us Oct 20-21 in San Jose: events.linuxfoundation.org/pytorch-conference-north-ameri… -
PyTorch
@PyTorch
What You Cannot Profile, You Cannot Optimize: Learning to Read PyTorch Traces
In his talk at PyTorch Conference North America 2026, Suvaditya Mukherjee from @huggingface will share practical guidance on how to start using the PyTorch Profiler on your models to extract maximum performance efficiency.
Whether you are aiming to identify performance bottlenecks or optimize model execution, this talk will help you get the most out of your hardware.
Join the open source AI community in San Jose, October 20-21: events.linuxfoundation.org/pytorch-conference-north-ameri…
#pytorchcon @halcyonrayes -
PyTorch reposted
Mark Collier 柯理怀
@sparkycollier
Enabling PyTorch to train any model on any chip in any cloud for any agent is a ridiculously ambitious goal, and these open source community efforts to build CI for testing accelerators are key.
Open source is not only the best way to solve this problem, it’s the only way.
PyTorch
@PyTorch
Keeping out-of-tree accelerators aligned with a fast-moving ecosystem is no small task.
In a new community blog, contributors from @IBM and @RedHat share how they built Torch Spyre on top of PyTorch's Cross-Repository CI Relay (CRCR) to tackle compatibility testing at scale. In the blog they also share testing and workflow patterns that could benefit accelerator developers across the ecosystem.
Read the full technical deep dive here: pytorch.org/blog/from-upstream-changes-to-downstream-conf…
@mehant1 -
PyTorch
@PyTorch
The faster the information can flow, the faster the progress can be made, and that’s exactly where open source really shines.”
At PyTorch Conference China 2026, PyTorch Foundation Executive Director @sparkycollier drove home the value of open source as AI hardware, model architectures, and inference engines evolve rapidly.
In his keynote, “Building Frontier Intelligence in the Open,” Mark describes the challenge as one of coordination across hardware, models, and inference, with the flow of information as a potential bottleneck.
As a concrete example, Mark discusses @Shopify's use of agents in production, where failures can feed back into training with PyTorch and serving with @vllm_project as the model improves.
Mark's full keynote from Shanghai: youtu.be/DAS-mrer7Os
Register for PyTorch Conference North America, October 20–21 in San Jose:
events.linuxfoundation.org/pytorch-conference-north-america/This media couldn't be displayed. See it on the original post. -
PyTorch
@PyTorch
As more teams scale open source AI on secure, governed infrastructure, Ray has become critical across the full AI lifecycle, from data curation to production serving and reinforcement learning.
Ahead of PyTorch Conference North America 2026 in San Jose, we put together a guide highlighting key Ray-focused sessions on the schedule.
Featured speakers include:
Anyscale /@databricks / @UCBerkeley : Ion Stoica
@anyscalecompute : Eric Tang, Sumanth Hedge, Josh Lee, Mengjin Yan
@Google : Ankita Luthra, Trinadh Kotturu, Jago Macleod
@LinkedIn : Tao Huang, Tommy Li
@Pinterest : Gaurav Arora, Shunyao Li, Eric Wang
@Uber : Ke Chen, Peng Zhang, Xandra Zhu
University of Minnesota (@UMNews) : Arun Sharma
Explore engineering takeaways from these technical sessions where you will learn about unified AI orchestration with Kubernetes, elastic training stacks, and scalable RL.
Read the full guide and map out your schedule: pytorch.org/blog/a-ray-focused-guide-to-pytorch-conferenc…
Register for PyTorch Conference North America: events.linuxfoundation.org/pytorch-conference-north-ameri…
PyTorch
@PyTorch
We are especially looking forward to Ion Stoica's keynote on Evolving Ray and Kubernetes Together for the AI Era @istoica05
-
PyTorch
@PyTorch
Planning a Bay Area meetup, hackathon, showcase, or open source AI gathering?
Make it part of #opensourceaiweek, October 16-25, anchored by #pytorchcon North America and #agntcon + #mcpcon North America in San Jose.
Submit by October 15:
linuxfoundation.research.net/survey-closed/?sm=eyET_2BRvh… -
PyTorch
@PyTorch
Keeping out-of-tree accelerators aligned with a fast-moving ecosystem is no small task.
In a new community blog, contributors from @IBM and @RedHat share how they built Torch Spyre on top of PyTorch's Cross-Repository CI Relay (CRCR) to tackle compatibility testing at scale. In the blog they also share testing and workflow patterns that could benefit accelerator developers across the ecosystem.
Read the full technical deep dive here: pytorch.org/blog/from-upstream-changes-to-downstream-conf…
@mehant1 -
PyTorch
@PyTorch
All PyTorch Conference China 2026 sessions are now available to watch on our YouTube channel.
PyTorch Conference China 2026 brought the PyTorch community together in Shanghai on September 8–9 alongside KubeCon + CloudNativeCon and OpenInfra Summit, following sponsor-hosted co-located events on September 7. Technical discussions spanned models, frameworks, distributed training, inference, hardware, cloud native infrastructure, and agents.
“Open Source for the AI Era” framed work across those layers. Across co-located sessions, keynotes, technical demonstrations, a PyTorch Foundation press conference, community meetings, and conversations at the PyTorch booth, the program covered hardware adaptation, training and serving, open infrastructure, accelerator integration, and collaboration across open source communities.
Watch the full PyTorch Conference China 2026 session playlist: youtube.com/playlist?list=PLM5uYJlqsLIw
Next up, #pytorchcon North America comes to San Jose October 20–21. Register today: events.linuxfoundation.org/pytorch-conference-north-ameri… -
PyTorch reposted
vLLM
@vllm_project
We're excited to have a strong vLLM presence at #pytorchcon North America this year.
🔷 @simon_mo_ , vLLM core maintainer and Co-founder / CEO of @inferact, will give the keynote on scaling open frontier inference infrastructure
🔷 vLLM core maintainer @nickhill33 and George Novack will be at the "Meet the Developers of vLLM"
🔷 vLLM maintainers @tms_jr, Lucas Wilkinson, and Joseph Groenenboom from @RedHat_AI will be giving talks on Agentic Inference and Attention in vLLM.
Thank you to @PyTorch for highlighting the community's work!
PyTorch
@PyTorch
vLLM (@vllm_project) is a high-throughput, memory-efficient inference and serving engine for LLMs. At #pytorchcon North America, you’ll find vLLM-related work throughout the program, from Simon Mo’s keynote to technical sessions and posters covering LLM inference and serving.
@simon_mo_ will present the keynote “vLLM Update: Scaling Open Frontier Inference Infrastructure,” covering improvements to vLLM’s core architecture and major optimizations in KV cache management and GPU kernels.
Across #pytorchcon, technical sessions dig into vLLM-related inference, including attention, KV cache management and transfer, disaggregated serving, elastic expert parallelism, scaling across hardware without forks, and more.
"Meet the Developers of vLLM" will feature George Novack and Nick Hill. Posters cover additional vLLM-related work on custom accelerators, Trainium, expert parallelism and RDMA KV-cache transfer, multi-chip KV-cache transfer, tier-aware routing, and more.
Explore the vLLM sessions: events.linuxfoundation.org/pytorch-conference-north-ameri…
PyTorch conferences are the open source AI community’s town square, where what’s next gets decided. Register for PyTorch Conference North America, October 20–21 in San Jose: events.linuxfoundation.org/pytorch-conference-north-ameri… -
PyTorch
@PyTorch
How does the PyTorch Ambassador Program work, and how can you position yourself to become a PyTorch Ambassador?
At #pytorchcon North America 2026, Sahdev Zala (IBM) will present “Inside the PyTorch Ambassador Model: How Ambassadors Grow PyTorch Adoption & How You Can Become One.”
Sahdev will cover what ambassadors have built, the challenges they have encountered, the results they have produced, and ways to engage more deeply with the PyTorch community through advocacy, education, and contribution.
Register for PyTorch Conference North America 2026: events.linuxfoundation.org/pytorch-conference-north-ameri…This media couldn't be displayed. See it on the original post. -
PyTorch
@PyTorch
vLLM (@vllm_project) is a high-throughput, memory-efficient inference and serving engine for LLMs. At #pytorchcon North America, you’ll find vLLM-related work throughout the program, from Simon Mo’s keynote to technical sessions and posters covering LLM inference and serving.
@simon_mo_ will present the keynote “vLLM Update: Scaling Open Frontier Inference Infrastructure,” covering improvements to vLLM’s core architecture and major optimizations in KV cache management and GPU kernels.
Across #pytorchcon, technical sessions dig into vLLM-related inference, including attention, KV cache management and transfer, disaggregated serving, elastic expert parallelism, scaling across hardware without forks, and more.
"Meet the Developers of vLLM" will feature George Novack and Nick Hill. Posters cover additional vLLM-related work on custom accelerators, Trainium, expert parallelism and RDMA KV-cache transfer, multi-chip KV-cache transfer, tier-aware routing, and more.
Explore the vLLM sessions: events.linuxfoundation.org/pytorch-conference-north-ameri…
PyTorch conferences are the open source AI community’s town square, where what’s next gets decided. Register for PyTorch Conference North America, October 20–21 in San Jose: events.linuxfoundation.org/pytorch-conference-north-ameri… -
PyTorch
@PyTorch
Communication overhead remains one of the largest bottlenecks in scaling distributed training.
In an upcoming session at PyTorch Conference North America, Rishi Sinha from @AMD shares how integrating work from the RCCL team enables GPU-initiated networking (GIN) directly within TorchTitan, PyTorch's distributed training framework.
By allowing the GPU kernel itself to issue network puts to remote GPUs, this approach improves all-to-all kernel performance by up to 30 percent and delivers a 12 to 15 percent boost in end-to-end performance.
Join us in San Jose on October 20-21 to explore the future of distributed training infrastructure: events.linuxfoundation.org/pytorch-conference-north-ameri…
#pytorchconThis media couldn't be displayed. See it on the original post. -
PyTorch
@PyTorch
🤝 Meet the people behind the projects.
#pytorchcon North America gives you the opportunity to connect directly with maintainers and contributors, ask questions, and get a deeper understanding of how open source AI technologies are actually developed. Go beyond the code with the people building it.
Join the community in San Jose from Oct 20-21: events.linuxfoundation.org/pytorch-conference-north-ameri… -
PyTorch reposted
Sudhanshu Shrivastava
@Sudhans89466678
Join the PyTorch Community at San Jose Convention Center this October 20th and 21st!
PyTorch
@PyTorch
At #pytorchcon North America 2026, Sudhanshu Shrivastava, Graduate Student Researcher, Electrical and Computer Engineering, @ucdavis, will present a federated learning case study in glaucoma imaging using 5,550 color fundus photographs from nine datasets across seven countries.
Sudhanshu will discuss how federated learning enables collaborative medical imaging research without data centralization, with practical lessons on site-specific fine-tuning, cross-site generalizability, and multi-site learning.
Join us in San Jose on October 20-21: events.linuxfoundation.org/pytorch-conference-north-ameri…
#pytorchcon -
PyTorch reposted
Mark Collier 柯理怀
@sparkycollier
PyTorch is making agent brains and that includes 🤖 of course
This media couldn't be displayed. See it on the original post.
PyTorch
@PyTorch
Hardware-Aware AI: Building Agentic Systems from Cloud to Edge with PyTorch, ExecuTorch
AI agents are moving beyond chat interfaces and onto physical devices. In her upcoming session on Hardware-Aware AI at PyTorch Conference North America 2026, Kavya Sri Chennoju from @Arm will demonstrate how PyTorch, ExecuTorch, and Arm Device Connect work together to deploy AI agents safely onto edge hardware such as robot arms and wearables.
Join the open source AI community in San Jose, October 20-21: events.linuxfoundation.org/pytorch-conference-north-ameri…
#pytorchcon -
PyTorch
@PyTorch
Build a neural network from scratch, train it, and optimize it for real-world AI infrastructure during our PyTorch Associate Training the day before PyTorch Conference North America on October 19th. Your instructor, Faradawn Yang of @NVIDIAAI explains how this training will give you hands on experience with the latest AI accelerators & prepare you for the PyTorch Certified Associate (PTCA) certification exam. events.linuxfoundation.org/pytorch-conference-north-ameri… #pytorchcon
This media couldn't be displayed. See it on the original post. -
PyTorch
@PyTorch
Hardware-Aware AI: Building Agentic Systems from Cloud to Edge with PyTorch, ExecuTorch
AI agents are moving beyond chat interfaces and onto physical devices. In her upcoming session on Hardware-Aware AI at PyTorch Conference North America 2026, Kavya Sri Chennoju from @Arm will demonstrate how PyTorch, ExecuTorch, and Arm Device Connect work together to deploy AI agents safely onto edge hardware such as robot arms and wearables.
Join the open source AI community in San Jose, October 20-21: events.linuxfoundation.org/pytorch-conference-north-ameri…
#pytorchcon -
PyTorch
@PyTorch
💡 Technical insight you can bring back to your own work.
Come to learn. Leave with ideas you can put into practice.
#pytorchcon North America brings practitioners together to share what they're learning, building, and applying in practice. Hear about emerging technologies and real-world use cases and leave with ideas and insights you can put to work yourself.
Join us in San Jose from Oct 20-21: events.linuxfoundation.org/pytorch-conference-north-ameri… -
PyTorch
@PyTorch
Curious about how to make enterprise agentic inference production-ready with @PyTorch and @vllm_project & to learn more about the PyTorch Landscape? Join Joseph Groenenboom of @RedHat at PyTorch Conference North America.
While serving AI models for research and pilot use cases is a well solved problem, moving it to 24/7 Enterprise ready systems is the next important phase in AI maturity. The reliability, observability, KV cache management, and concurrency requirements for Enterprise readiness are non-trivial problems. Rising to this challenge, PyTorch, vLLM, and the other foundation projects and broader ecosystem have begun adding Enterprise level features and enhancements. This talk will cover a sampling of some of the project work; from core PyTorch project build infrastructure up to model serving improvements to account for tool calling support and long context multi-turn chat.
Led by the PyTorch Foundation Ecosystem Working Group, you will learn what the Ecosystem Landscape is and why it matters: how membership drives visibility and community engagement for independent projects; how to apply: a lightweight, GitHub-based process that makes it straightforward for projects to apply for ecosystem status; and how lifecycle management works: what ongoing membership looks like and how the Working Group supports active projects.
See you at #pytorchcon NA in San Jose, October 20-21! Register at: events.linuxfoundation.org/pytorch-conference-north-ameri…This media couldn't be displayed. See it on the original post. -
PyTorch reposted
Vijay Janapa Reddi
@profvjreddi
We’ve taught a generation of students how to use AI. Now we need to teach the next generation how to engineer it.
That means understanding what’s underneath the abstractions, not just calling the APIs.
That’s why we built Tiny🔥Torch.
Don’t just import PyTorch. Build it. 🔥
We’re excited to be working toward bringing TinyTorch into the PyTorch ecosystem. More to come! 🚀
PyTorch
@PyTorch
Every mature systems project eventually needs a teaching version.
TinyTorch is a free, open source curriculum where you build a working machine learning framework from scratch, tensors through transformers, using PyTorch’s own API in pure Python.
It requires no GPU, runs on a 4 GB laptop, and covers 20 hands-on modules designed to give developers, students, and engineers a complete mental model of PyTorch internals.
Read the full technical breakdown here: pytorch.org/blog/tinytorch-dont-just-import-pytorch-build…
@profvjreddi -
PyTorch
@PyTorch
Elastic Expert Parallelism in @vllm_project lets you add or remove GPUs from an active Mixture-of-Experts deployment during traffic with minimal interruption to serving and minimal downtime.
At #pytorchcon North America 2026, Itay Alroy (@nvidia) will present “Elastic Expert Parallelism in vLLM,” covering the architecture, key implementation details, open challenges, and future roadmap for Elastic EP.
Alroy will also examine what happens when EP size changes and how NIXL EP enables grow/shrink under live traffic.
Register for PyTorch Conference North America 2026: events.linuxfoundation.org/pytorch-conference-north-ameri…This media couldn't be displayed. See it on the original post. -
PyTorch
@PyTorch
Debugging LLM training in production is notoriously challenging because subtle bitwise errors can surface long before they ever trigger a spike in the loss curve.
Ziming, a PhD student at the University of Michigan and student researcher at @ByteDanceSeed_ , will speak at PyTorch Conference North America on how to solve this issue using OpGuard. OpGuard compares separate training runs bit by bit to pinpoint the exact initial operation where executions diverge.
Join us in San Jose, October 20 to 21, to learn how bitwise alignment delivers faster, more precise LLM training debugging: events.linuxfoundation.org/pytorch-conference-north-ameri…
#pytorchcon @UMich -
PyTorch reposted
dstack
@dstackai
Going to @PyTorch Conference in San Jose next month? @CrusoeAI and we are hosting an evening on day one, October 20, 6:30 PM, right after the sessions.
We're gathering GPU experts, AI researchers, AI infra engineers, and anyone into AI infra and heterogeneous AI compute.
Space is limited: luma.com/6j69xyal -
PyTorch
@PyTorch
Interested in optimizing Mixture of Experts LLM inference on ARM CPUs?
In his talk at PyTorch Conference North America, Maajid Khan from Fujitsu Research India will explore efficient MoE LLM inference using vLLM and OpenVINO, sharing practical strategies for running these models effectively on ARM architectures.
Register and join us in San Jose, October 20-21: events.linuxfoundation.org/pytorch-conference-north-ameri…
#pytorchcon -
PyTorch
@PyTorch
To support developers, researchers, and engineers in deepening their technical skills, the PyTorch Foundation is running a dedicated Introduction Track at PyTorch Conference North America in San Jose, California, featuring the following speakers:
@NVIDIA - Aastha Jhunjhunwala, Mark Moyou
@RedHat- Lucas Wilkinson, Matthew Bonanni
@HuggingFace - Aritra Roy Gosthipaty, Suvaditya Mukherjee
@CrusoeAI - JanakiRam Goteti, Suman Debnath
ETH Zurich - Andrea Mattia Garavagno
@Harvard University - Vijay Janapa Reddi
@CloudNativeFdn - Yashasvi Misra
Additionally, an official, full-day PyTorch Associate Training session led by instructor Faradawn Yang will take place on Monday, October 19, 2026, offering hands-on labs, real-world projects, and a voucher for the PyTorch Certified Associate exam. Seats are limited, so register by Tuesday, October 13th to secure a spot and elevate your AI development skills.
Read our latest blog to learn which sessions will feature at the Introduction track and how to sign up to the PyTorch Associate Training session: pytorch.org/blog/accelerate-your-ai-journey-with-new-intr… -
PyTorch
@PyTorch
Join us October 17-18 in San Francisco for the ExecuTorch Hackathon.
Developers will build and deploy PyTorch models with ExecuTorch across Compute, Mobile + XR, and IoT tracks.
Teams will get hands-on with Snapdragon-powered PCs, Samsung Galaxy devices, and Arduino hardware while exploring what's possible with open-source, on-device AI. Form a team, submit a proposal, and help shape the future of AI at the edge.
Submit your proposal here: luma.com/executorch-hackathon -
PyTorch
@PyTorch
At #pytorchcon North America 2026, @lizli202503 and @indianspeedster of @AMD will discuss their work enabling scalable MXFP8 pretraining on MI355X GPUs.
Liz and Shekhar will cover optimization of key MXFP8 operators in TorchAO and how those kernels were integrated with TorchTitan to build an end-to-end upstream PyTorch training stack for large language models.
Their session, “Scaling MXFP8 Pretraining on 1K+ AMD Instinct MI355X: TorchAO Kernels and TorchTitan Training,” will also cover Triton and FlyDSL implementations and lessons from numerical validation, convergence, and performance tuning.
Join us in San Jose on October 20-21. Register today: events.linuxfoundation.org/pytorch-conference-north-ameri…This media couldn't be displayed. See it on the original post. -
PyTorch
@PyTorch
🤲 Open source moves forward when people build together.
#pytorchcon North America brings together the researchers, engineers, maintainers, and contributors doing exactly that - sharing what they've learned, working through challenges, and building on each other's work.
Join the open source AI community in San Jose from Oct 20-21: events.linuxfoundation.org/pytorch-conference-north-ameri… -
PyTorch
@PyTorch
🚨 Last Chance To Take The Stage At PyTorch Day Japan!
The Call for Proposals closes this Sunday, September 27 at 11:59 PM JST. Bring your ideas and experiences to a community of PyTorch developers, machine learning engineers, AI researchers, and open source AI leaders from across Japan and beyond.
⏰ Submit Your Proposal >> events.linuxfoundation.org/pytorch-day-japan/program/cfp/ -
PyTorch
@PyTorch
At #pytorchcon North America 2026, Alessandro Sangiorgi, Senior Software Engineer (@RedHat), will show how warm starts let Helion autotuning reuse cached configurations so developers can iterate faster instead of repeating cold searches.
Sangiorgi will present “Accelerating Helion Autotuning with Warm-Start and Shared Caches,” a poster on Helion, a PyTorch DSL for GPU kernels.
Join us in San Jose on October 20-21: events.linuxfoundation.org/pytorch-conference-north-ameri… -
PyTorch
@PyTorch
The PyTorch Foundation OSPO & Academic Outreach Working Group is inviting academic open source projects to submit for a Day 0 workshop at #pytorchcon North America 2026.
Projects using PyTorch, @DeepSpeedAI, Helion, @raydistributed, Safetensors, or @vllm_project can submit for consideration. Eight selected projects will present five-minute lightning talks, followed by a hands-on workshop and mentor office hours.
Depending on the project, workshop conversations may cover open source readiness, governance, reproducibility, community, security and maintenance, and ecosystem positioning.
The call is open to students, researchers, faculty, research engineers, university labs, academic OSPOs, research institutions, and maintainers of research-originated open source projects.
The submission deadline is September 30, 2026, at midnight PT.
Register for PyTorch Conference North America: events.linuxfoundation.org/pytorch-conference-north-ameri…
🔗 Read more and submit: pytorch.org/blog/from-research-project-to-open-source-eco… -
PyTorch
@PyTorch
This just in! Take our live, in-person PyTorch Associate Training the day before PyTorch Conference North America in San Jose, CA on Monday, October 19th.
Through a blend of lectures, demonstrations, guided labs, and assessments, you'll will not only become more familiar with PyTorch’s ecosystem but will also build and optimize real-world models from scratch.
Upon completion of the course, you will also receive a voucher ($250 value) to take the new PyTorch Certified Associate (PTCA) certification exam.
Learn more and sign up for this training at: events.linuxfoundation.org/pytorch-conference-north-ameri…
#pytorchcon -
PyTorch
@PyTorch
Following a great community gathering at Graphcore's London office, momentum is building for PyTorch Conference North America 2026.
Join PyTorch Foundation board member Sylvain Viguier and fellow open source developers, researchers, and technical leaders in San Jose, California on October 20 and 21. We look forward to hearing about your latest projects, sharing technical insights, and connecting in person.
Register now to save your spot: events.linuxfoundation.org/pytorch-conference-north-ameri…
#pytorchcon @graphcoreai -
PyTorch
@PyTorch
Build AI on the edge with ExecuTorch at a two-day @Meta + @Arm hackathon at San Francisco State University.
Students, developers, and AI enthusiasts can get hands-on experience building AI applications with ExecuTorch on Arm-powered devices, with technical talks, demos, workshops, and mentorship.
Participants will also have the chance to collaborate with fellow builders, showcase their projects to judges from Arm and Meta, and compete for prizes and recognition.
🔗 Learn more and register: arm-executorch.devpost.com -
PyTorch
@PyTorch
Open software. Open hardware. Open standards. Open data. Open benchmarks.
If your Bay Area event advances open AI, it could be part of #opensourceaiweek, October 16-25, featuring flagship events #pytorchcon and #agntcon + #mcpcon.
Submit to be a part of it all: -
PyTorch
@PyTorch
How do you keep @vllm_project moving at the speed of light without excluding users who run diverse models on diverse hardware?
In a new PyTorch Foundation blog, contributors from @IBM, @Meta, and @huggingface introduce hardware-agnostic layers designed to balance frontier performance with portability, helping ensure vLLM continues to meet the needs of the broader open source ecosystem.
Read the blog to learn more: pytorch.org/blog/hardware-agnostic-models-in-vllm/
@hmellor_ @th_ortner -
PyTorch
@PyTorch
Where research meets real-world application. 🌎
At #pytorchcon North America, hear from the researchers and practitioners advancing #pytorch and putting those advances to work.
See how ideas move from research into practical implementation and how what gets learned in practice helps shape what comes next.
Join us in San Jose, Oct 20-21: events.linuxfoundation.org/pytorch-conference-north-ameri… -
PyTorch
@PyTorch
PyTorch releases are no longer just about shipping PyTorch binaries. Release engineering now coordinates PyTorch, Triton, and @vllm_project as part of a broader ecosystem.
At #pytorchcon North America 2026, Andrey Talman (@Meta) will discuss how the PyTorch release process is being modernized, including the use of AI agentic workflows to analyze failures and the work required to release projects together with reliability and performance in mind.
Hear more from Andrey about what he’ll cover at the conference.
🔗 Register: events.linuxfoundation.org/pytorch-conference-north-ameri…This media couldn't be displayed. See it on the original post. -
PyTorch
@PyTorch
Frontier models are the fastest way to launch an AI product, but what happens when usage scales? In our latest case study, @Shopify shares how they built a continual learning loop using @PyTorch and @vllm_project for their GraphQL agent, turning everyday production failures directly into model weight improvements.
Read the full breakdown by Cody Mazza-Anthony and @Drewch to learn more about they define quality, calibrate judges, and distribute training across GPUs: pytorch.org/blog/how-shopify-built-a-continual-learning-l…
Plus, don't miss the @ShopifyEng keynote at #pytorchcon NA on how small models can outperform frontier models on well-scoped tasks at a fraction of the cost, with lower latency and higher throughput.
Get your ticket for PyTorch Conference North America (October 20-21 in San Jose, CA): events.linuxfoundation.org/pytorch-conference-north-america/
PyTorch
@PyTorch
Article by @cmazzaanthony & @Drewch
+ @cmazzaanthony will keynote at #pytorchcon NA on the flywheel that turns Shopify's product expertise into robust evaluations, then mines, critiques, and repairs low-scoring conversations to train better models. -
PyTorch
@PyTorch
Every mature systems project eventually needs a teaching version.
TinyTorch is a free, open source curriculum where you build a working machine learning framework from scratch, tensors through transformers, using PyTorch’s own API in pure Python.
It requires no GPU, runs on a 4 GB laptop, and covers 20 hands-on modules designed to give developers, students, and engineers a complete mental model of PyTorch internals.
Read the full technical breakdown here: pytorch.org/blog/tinytorch-dont-just-import-pytorch-build…
@profvjreddi -
PyTorch
@PyTorch
RL post-training has become a critical stage in modern LLM development, but deploying an end-to-end pipeline requires much more than running individual kernels efficiently. Systems must coordinate distributed training, rollout generation, and continuous weight synchronization across multiple software stacks while maintaining correctness and performance.
@JoySong351749 with @AMD will present a poster at PyTorch Conference North America on enabling the open source vime RL post-training framework on AMD Instinct GPUs using ROCm.
Register for PyTorchCon NA at: events.linuxfoundation.org/pytorch-conference-north-ameri… #pytorchconThis media couldn't be displayed. See it on the original post. -
PyTorch
@PyTorch
#pytorch meets TPUs, Trainium, edge devices, resilient training, and more. ⚡
Catch quick live demos in the #pytorchcon North America Community Expo, October 20-21 in San Jose.
Plan your stops: events.linuxfoundation.org/pytorch-conference-north-ameri…
Register: events.linuxfoundation.org/pytorch-conference-north-ameri… -
PyTorch
@PyTorch
Join Valerian Rey from Simplex Lab at PyTorch Conference North America 2026 as he breaks down multi-objective optimization.
He will share practical techniques for training models with multiple loss functions simultaneously and demonstrate how to easily implement these workflows using the TorchJD library. Whether you are optimizing multi-task architectures or managing complex loss tradeoffs, this session will provide concrete steps to streamline your pipeline.
Join the open source AI community in San Jose, October 20-21 : events.linuxfoundation.org/pytorch-conference-north-ameri…
#pytorchcon -
PyTorch
@PyTorch
At PyTorch Conference North America in San Jose, Arkadip Maitra from the PyTorch engineering team at @RedHat will present two technical poster sessions covering key topics in inference performance and testing infrastructure.
Connect with the open source AI community on October 20-21 to discuss open source runtime performance, hardware optimization, and testing frameworks.
Register for PyTorch Conference America today: events.linuxfoundation.org/pytorch-conference-north-ameri…
#pytorchcon @arkadipmaitra -
PyTorch
@PyTorch
At PyTorch Conference North America 2026 in San Jose, @RedHat engineers Jewel Muraledharan and Subin George Malana will present on Cross-Repository CI Relay (CRCR) to explore how downstream repositories can seamlessly integrate into upstream PyTorch CI.
Their session will detail how CRCR enables a tiered onboarding model alongside real-time visibility for downstream repositories in HUD.
Join us in San Jose on October 20 and 21 to learn how CRCR streamlines testing workflows across the ecosystem.
Register today: events.linuxfoundation.org/pytorch-conference-north-ameri…
#pytorchcon -
PyTorch
@PyTorch
At PyTorch Conference North America, explore how new optimizers like Muon and TorchJD work alongside tools like fastsafetensors and LMCache to drive multi-loss efficiency and faster LLM serving.
Featured speakers include:
@awscloud : Paulo Aragao
@Arm : Thomas Cottenier
@Google : Claudio Basile, Aleksey Vlasenko, Ankita Luthra, Trinadh Kotturu
@huggingface : Ben Burtenshaw, Aritra Roy Gosthipaty, Suvaditya Mukherjee
@Huawei : Jiahao Chen, Jiahao Tan
@IBM : Takeshi Yoshimura, Prasanth Chatarasi, Bardia Mahjour, Viji Srinivasan, David Grove, Antoni Viros Martin, Avery Blanchard
@intel : Panagiotis Kourdis, Tanima Dey
@Meta : Felipe Mello, Jiani Wang, Will Constable, Natalia Gimelshein, Driss Guessous, Sanket Jayant Purandare, Aditya Venkataraman, Nicolas Hug, Scott Schneider, Edward Yang
@nvidia : Ian Stenbit, Christine Cheng, Dylan Doblar
Annapurna Labs (AWS subsidiary): Yahav Biran
@argonne National Laboratory: Sam Foreman
Beijing Academy of Artificial Intelligence: Yonghua Lin
Bird of Paradise AI: Jennifer Wei
@BytedanceTalk : Neiwen Ling
@Harvard University: Vijay Janapa Reddi
@RedHat Hat: Subin George, Jewel K M
SimplexLab: Valérian Rey; Khush Patel
@tensormesh : Kuntai Du
University of Genoa: Andrea Mattia Garavagno
University of Virginia: Tianle Zhong
Join us in San Jose, October 20-21: events.linuxfoundation.org/pytorch-conference-north-ameri…
Read the Open Research, Tooling & Optimization Sessions Guide here: pytorch.org/blog/open-research-tooling-optimization-at-py…
#pytorchcon -
PyTorch
@PyTorch
Muon has attracted a lot of attention for fast convergence, but getting those optimizers to work in a real training stack is a different challenge.
At PyTorch Conference North America, @JenniferWe17599 will walk through Muon, Dion, and Dion3 and look at what happens when you add the messy details: sharding, communication, schedulers, and everything else that can go wrong.
If you are interested in optimizers and training dynamics, see you at PyTorchCon NA for Jen's talk on Beyond AdamW: A Practical PyTorch Walkthrough of Muon, Dion, and Orthogonalized Optimizer Variants.
Get your ticket: events.linuxfoundation.org/pytorch-conference-north-ameri…This media couldn't be displayed. See it on the original post. -
PyTorch
@PyTorch
The first-ever PyTorch Day Japan comes to Tokyo on December 10, bringing the community together to explore PyTorch, @vllm_project, @DeepSpeedAI, @raydistributed, Helion, and Safetensors.
Co-hosted by PyTorch Foundation, @huggingface, @IBM, and @ME_JP_official, the event will feature technical talks and interactive discussions across open source AI, including training, inference, responsible AI, physical and edge AI, open model development, and the broader PyTorch ecosystem.
The call for proposals is open for session presentations and lightning talks through September 27 at 11:59 PM JST. Register today!
🔗 Read more: pytorch.org/blog/pytorch-day-japan-2026-comes-to-tokyo/ -
PyTorch
@PyTorch
For supported biomolecular structure-prediction models, NVIDIA BioNeMo Inference Runtime keeps the familiar PyTorch workflow and lets developers construct supported models as torch.nn.Module objects or reuse selected modules in custom code.
In a new NVIDIA Developer Blog post, the team details how BioIR uses optimized kernels and, where applicable, CUDA Graphs for model execution, with Ray replicas for processing large batches of independent inputs across GPUs in a single node.
This post covers BioIR acceleration for Boltz-2, OpenFold2, and OpenFold3.
Read more: developer.nvidia.com/blog/high-throughput-structure-predi… -
PyTorch
@PyTorch
↘️ Deep technical content. Meaningful conversations with people solving the same problems.
At #pytorchcon North America, go deeper into #pytorch features, optimization, deployment, and more then continue the conversation with developers and researchers doing the work.
The talks matter. So do the conversations you can only have in the room. Join us Oct 20-21 in San Jose: events.linuxfoundation.org/pytorch-conference-north-ameri… -
PyTorch
@PyTorch
At PyTorch Conference North America 2026, Dhritiman Das, Staff Software Engineer - Machine Learning Infrastructure (@LinkedIn), will present a torch-native retrieval engine that uses PyTorch as the primary runtime for retrieval, filtering, and ranking.
The system combines a GPU-resident torch tensor index, tensor-based retrieval operations, custom CUDA kernels for attribute filtering, and TorchScript model execution within a unified serving architecture orchestrated through a Rust and tch-rs backend. Dhritiman will also share how the approach scales to critical use cases like feed and search at LinkedIn.
Join us in San Jose on October 20-21: events.linuxfoundation.org/pytorch-conference-north-ameri…
View the poster sessions: events.linuxfoundation.org/pytorch-conference-north-ameri…
#pytorchconThis media couldn't be displayed. See it on the original post. -
PyTorch
@PyTorch
Live demos. Big ideas. Zero slide-deck suspense. 👀
See #pytorch technology in action at the Demo Theater in the #pytorchcon North America Community Expo, October 20-21 in San Jose.
Explore: events.linuxfoundation.org/pytorch-conference-north-ameri…
Register: events.linuxfoundation.org/pytorch-conference-north-ameri… -
PyTorch
@PyTorch
Engineering teams from across the ecosystem are presenting major breakthroughs in torch.compile, custom kernel authoring, and scaling efficiency at the upcoming PyTorch Conference North America.
Deepening performance across the compiler pipeline requires tackling bottlenecks at every layer, from front-end tracing and shape checking, to back-end execution and distributed orchestration.
A few of the speakers sharing their insights include:
@AMD: Liz Li, Prachi Gupta
@huggingface: Sayak Paul
@Huawei: Yun Zhao; Haonan Zhang
@IBM, @IBMResearch: Olivier Tardieu, Matthew Arnold, Burkhard Ringlein
@Intel: Xiaogang Gu, Qun Yang, Whitney Tsang, Artur Fierka, Panagiotis Kourdis, Tanima Dey
@Meta: William Wen, Steven Troxler, Avik Chaudhuri, Elias Ellison, Laith Sakka, Angel Li, Richard Zou, Yidi Wu, Oguz Ulgen, Dunfan Lu, Jason Ansel, Jongsok Choi, Ethan Che, Kaiming Cheng, Laura Wang, Driss Guessous, Simon Layton, Marius Eriksen, Wei Feng, Anshul Sinha, Ailing Zhang, Bob Ren, Aaron Orenstein, Chien-Chin Huang, Pian Pawakapan, Sanket Jayant Purandare, Francisco Massa, Tristan Rice, Kapil Sharma, Natalia Gimelshein, Ben Carver
@NVIDIA: Daniel Galvez, Michael Goldfarb, Guray Ozen, Ke Wen, Sreeram Potluri, Artem Polyakov, Anjulie Agrusa, Ryan Spring, Bruce Zitelli
@anyscalecompute : Masahiro Tanaka
@CrusoeAI: Suman Debnath, JanakiRam Goteti
@UCBerkeley: Yi Pan
University of Washington (incl. Paul Allen School): Megan Frisella, Stephanie Wang
PyTorch Conference is the open source AI community's town square. Where what's next gets decided. Register now to join the open source AI community in San Jose, October 20-21: events.linuxfoundation.org/pytorch-conference-north-ameri…
Read the Open Research, Tooling & Optimization Sessions Guide here: pytorch.org/blog/open-research-tooling-optimization-at-py…
#pytorchcon -
PyTorch
@PyTorch
New from @Meta Engineering: FlashAttention-4 extended with MXFP8 support for @nvidia Blackwell—from forward and backward kernels to fused quantization and jagged cross-attention.
The team developed an end-to-end jagged module with fused quantization, FP8 activation and compute which is being used internally at Meta for GEM training. On the latest gen hardware, LP FA4 kernel reaches 2.85 PFLOP/s forward and 2 PFLOP/s backward, with up to a 1.30× end-to-end module speedup.
✍️ Devashish Shankar, Santosh Mohan, Jiaqi Xu, Darren Liu, Han Xu
Explore the design and open source implementation in our latest blog: pytorch.org/blog/low-precision-flash-attention-4-end-to-e… -
PyTorch
@PyTorch
More visibility. New audiences. One seriously intelligent week. 🧠
Bring your Bay Area event into the #opensourceaiweek lineup, October 16-25, alongside flagship events #pytorchcon and #agntcon + #mcpcon in San Jose.
Submit by October 15:
linuxfoundation.research.net/survey-closed/?sm=eyET_2BRvh… -
PyTorch
@PyTorch
At #pytorchcon North America 2026, Sudhanshu Shrivastava, Graduate Student Researcher, Electrical and Computer Engineering, @ucdavis, will present a federated learning case study in glaucoma imaging using 5,550 color fundus photographs from nine datasets across seven countries.
Sudhanshu will discuss how federated learning enables collaborative medical imaging research without data centralization, with practical lessons on site-specific fine-tuning, cross-site generalizability, and multi-site learning.
Join us in San Jose on October 20-21: events.linuxfoundation.org/pytorch-conference-north-ameri…
#pytorchcon -
PyTorch
@PyTorch
New chips are shipping faster than ever before, but the ecosystem is being held back by having to rewrite and then re-debug the same code over & over again.
@clattner_llvm CEO and Co-founder at @Modular and EVP of Advanced AI Software & Platforms at @Qualcomm, will deliver a keynote at PyTorch Conference North America about an open software platform for heterogeneous compute powered by Mojo and MAX.
PyTorch has always been the place where the best models come together, and now there's a way to get those models onto all kinds of hardware.
If you're interested in Al and compute, join us at the PyTorch Conference in San Jose, CA. Register now: events.linuxfoundation.org/pytorch-conference-north-ameri…
#pytorchconThis media couldn't be displayed. See it on the original post. -
PyTorch
@PyTorch
🎤 Meet Keynote Speaker Colin Brace, VP of Annapurna Labs at @awscloud.
At #pytorchcon North America, Colin will present “Trainium’s Journey to Native PyTorch,” sharing how #pytorch now runs natively on AWS Trainium with no code changes required.
Hear how AWS enabled eager mode and torch.compile, integrated Trainium with TorchTitan, TorchAO, and Hugging Face Transformers v5, and contributed upstream to the PyTorch ecosystem.
📅 October 20-21
📍 San Jose, California
Join the PyTorch community - register today: events.linuxfoundation.org/pytorch-conference-north-ameri… -
PyTorch
@PyTorch
Learn how PyTorch can extend language modeling beyond classification to practical time-to-event prediction.
Witold Czubala of @UBS will share a PyTorch-based transformer model that predicts six-month attrition from longitudinal advisor–client email communications for wealth management during PyTorch Conference North America in San Jose, CA.
Join us October 20-21: events.linuxfoundation.org/pytorch-conference-north-ameri…
#pytorchconThis media couldn't be displayed. See it on the original post.
PyTorch
@PyTorch
From Client Communications to Competing Risks: A PyTorch Transformer for Client Attrition Model by @witty_smart
-
PyTorch
@PyTorch
🍎 Fresh ideas.
💬 Relevant technical conversations.
💡 Insights from the people doing the work.
That’s what attendees have come to expect from #pytorchcon North America, taking place Oct 20-21 in San Jose.
Join the open source AI community for keynotes, technical talks, hands-on sessions, and candid conversations about the work shaping AI today. events.linuxfoundation.org/pytorch-conference-north-ameri…
Register: events.linuxfoundation.org/pytorch-conference-north-ameri… -
PyTorch
@PyTorch
"It's really great to feel the energy and see all the collaboration that's happening, lots of conversations. We have people here who are just starting to learn about PyTorch, and we have people who are maintainers. It's super nice to see that energy and see how together we're going to be able to solve some of these very difficult problems for humanity." Ankit Patel, @nvidia, at PyTorch Conference Europe 2026
Register today to join the open source AI community at PyTorch Conference North America in San Jose, October 20–21: events.linuxfoundation.org/pytorch-conference-north-ameri…
#pytorchcon -
PyTorch
@PyTorch
The open source AI community thrives on collaboration, choice, and open contribution. As Joseph Groenenboom from @RedHat highlights, empowering developers to freely contribute and build options is essential for growing the entire AI ecosystem.
PyTorch Conference North America 2026 is where that community comes together in person. Join us to collaborate with open source pioneers, expand your deployment capabilities, and directly contribute to shaping the future of machine learning.
Register for PyTorch Conference North America today: events.linuxfoundation.org/pytorch-conference-north-ameri…
#pytorchcon -
PyTorch
@PyTorch
Validate your real-world PyTorch skills with the PyTorch Certified Associate (PTCA) program.
Designed for early-stage practitioners, PTCA helps you demonstrate foundational ability across model design, training, and deployment while building credibility across the open source AI ecosystem.
Learn more and enroll here: training.linuxfoundation.org/certification/pytorch-certif… -
PyTorch
@PyTorch
The @huggingface Kernels project now has Helion support.
This blog walks through how to build, autotune, and ship performant and portable Helion kernels via the Hugging Face Kernels project, allowing users to consume these kernels seamlessly.
Learn more here: -
PyTorch
@PyTorch
PyTorch 2.14 introduces updates to Inductor, PyTorch Distributed, c10d, dynamic shapes, Apple Silicon, and accelerator platform support, with 2,995 commits from 487 contributors since PyTorch 2.13.
Bring your questions about PyTorch 2.14 to our live Q&A on Thursday, September 17, 2026. Andrey Talman (@Meta), Natalia Gimelshein (@Meta), @joespeez (@reflection_ai), and Chris Gottbrath (Gottbrath Tech), moderator) will share an overview of PyTorch 2.14 and answer community questions about PyTorch and the new capabilities.
Register here: pytorch.org/event/pytorch-2-14-release-live-qa/
PyTorch 2.14 covers:
- NVGEMM and CuTeDSL-generated CUTLASS kernels in Inductor
- The new nccl2 backend for PyTorch Distributed
- Fault-tolerant collectives and process-group reconfiguration in c10d
- Native linear algebra and additional Metal kernel improvements on Apple Silicon
- torch.switch and CUDA graph capture for torch.while_loop
- Declarative dynamic shapes with @dynamic_spec
- Experimental torch.compile support for complex-valued tensors
- Expanded ROCm, Intel XPU, and NVIDIA platform support
Want to learn more about compiler and runtime work, distributed communication, device portability, accelerator integration, and more? Register for PyTorch Conference North America 2026, where engineers, researchers, and maintainers will convene October 20–21 in San Jose: events.linuxfoundation.org/pytorch-conference-north-ameri…
#pytorchcon -
PyTorch
@PyTorch
Bay Area AI event organizers, your week just got bigger. 🤖
Submit your conference, hackathon, meetup, startup showcase, or networking event to join #opensourceaiweek, October 16-25.
Flagship events: #pytorchcon and #agntcon + #mcpcon
Apply by October 15: -
PyTorch
@PyTorch
🏋️ Train smarter.
From distributed training to optimization techniques and foundation models, the Training Track at #pytorchcon North America, Oct 20-21 in San Jose, is packed with practical sessions to help you build faster, more efficient AI systems.
Learn more:
events.linuxfoundation.org/pytorch-conference-north-ameri…
📅 Schedule:
events.linuxfoundation.org/pytorch-conference-north-ameri…
🎟️ Register:
events.linuxfoundation.org/pytorch-conference-north-ameri… -
PyTorch
@PyTorch
At PyTorch Conference North America 2026, Nicolò Lucchesi, Research Engineer at @MistralAI and vLLM maintainer, will present joint work with @AWS and @RedHat on how disaggregated serving in vLLM has evolved to support the latest generation of hybrid models.
This session will cover the evolution of disaggregated serving for modern hybrid architectures, protocol developments aimed at reducing end-to-end latency, and new key-value pinning mechanisms designed for reliability at scale.
Join us in San Jose on October 20-21: events.linuxfoundation.org/pytorch-conference-north-ameri…
#pytorchcon @vllm_project -
PyTorch
@PyTorch
The PyTorch Korea User Group will host its inaugural offline conference on Saturday, November 21, 2026, hosted at AWS Korea in Centerfield East, Seoul.
Designed around the end-to-end AI lifecycle, the event features three primary tracks: Build, Serve, and Run. Community members, developers, and researchers are invited to submit session proposals highlighting real-world project wins, takeaways from failed experiments, or core performance optimizations.
The deadline to submit proposals is Sunday, September 13, 2026, at 23:59 KST. Submit your talk today: talk.pytorchday.kr/pytorch-day-korea-2026/cfp -
PyTorch
@PyTorch
PyTorch Day Japan 2026 comes to Tokyo on December 10, and the call for proposals is officially OPEN!
We're accepting proposals for session presentations and Lightning Talks across the full spectrum of open source AI, PyTorch, and AI/ML. Suggested topics include:
🚀 Sovereign AI (Local & Open Models)
🏋️ Physical AI & Edge AI
💡 PyTorch Ecosystem
Submit a Proposal by September 27 at 11:59 pm JST >> events.linuxfoundation.org/pytorch-day-japan/program/cfp/ -
PyTorch
@PyTorch
Join Thomas Cottenier from @Arm at PyTorch Conference North America in San Jose this October 20-21. Thomas will present how AI agents can synthesize customized, target-specific runtimes using PyTorch components like torch.export, ExecuTorch, and torchao.
This approach removes redundant prefill computation and creates streamlined inference pipelines that deliver high performance directly on edge hardware.
Register now for PyTorch Conference North America: events.linuxfoundation.org/pytorch-conference-north-ameri…
#pytorchcon -
PyTorch
@PyTorch
Learn how to optimize financial portfolio grouping through a PyTorch-enabled, GPU-accelerated clustering pipeline which delivers hard labels, soft factor loadings, and structural-break signals at scale.
Built to rerun cost-effectively as new returns arrive, it seamlessly transitions from a single GPU to multi-node setups without changing the solver interface.
Explore the complete technical breakdown and reproducible companion notebook on the @nvidia Technical Blog: developer.nvidia.com/blog/gpu-accelerated-clustering-for-… -
PyTorch
@PyTorch
🎤 Meet keynote speaker Zhipeng Wang (@PKUWZP), Senior Staff Software Engineer at @Google and DeepSpeed maintainer. events.linuxfoundation.org/pytorch-conference-north-ameri…
At #pytorchcon North America, he’ll share advances helping DeepSpeed train large models efficiently across diverse hardware.
October 20-21 | San Jose
Register:
events.linuxfoundation.org/pytorch-conference-north-ameri… -
PyTorch
@PyTorch
KubeCon + CloudNativeCon + OpenInfra Summit + PyTorch Conference China 2026 brought the people working across the open source AI stack together in Shanghai. @sparkycollier
No single project, company, or community builds the AI stack alone. Behind the models, frameworks, cloud native technologies, and infrastructure powering AI is a global open source community working across every layer.
PyTorch Foundation welcomed @alibaba_cloud and Cambricon (寒武纪) as Platinum Members and @AntGroup as a Gold Member, joining @Huawei and other existing Foundation members.
Across the program, maintainers, researchers, developers, hardware vendors, and technical leaders discussed PyTorch, distributed training, inference and serving, heterogeneous hardware, cloud native infrastructure, accelerator integration, and agents, with participation from the @CloudNativeFdn and @openinfradev communities.
Our recap covers keynotes from across the open source AI stack, China-based PyTorch contributors and organizations, the PyTorch TAC Accelerator Integration Working Group, the Foundation press conference, and community conversations in Shanghai.
PyTorch conferences are the open source AI community’s town square, where what’s next gets decided.
If you couldn’t join us in Shanghai, PyTorch Conference North America 2026 is the next chance to hear directly from maintainers, researchers, developers, and AI engineers working across the open source AI stack.
PyTorch Conference North America comes to San Jose October 20–21, with maintainers from PyTorch, @vllm_project, @DeepSpeedAI, and @raydistributed among the speakers.
🔗 Read the Shanghai recap and register for PyTorch Conference North America 2026: pytorch.org/blog/pytorch-conference-china-2026-advancing-…
#pytorchcon #kubecon #cloudnativecon #openinfrasummit -
PyTorch
@PyTorch
A conference for people doing the work. 💪
#pytorchcon North America, Oct 20-21 in San Jose, brings together a hands-on community of developers, researchers, engineers, maintainers, and practitioners building with #ai and ML.
Come meet the people building what’s next. -
PyTorch
@PyTorch
At PyTorch Conference North America, Ricardo Noriega de Soto, Tech Lead for the vLLM Omni team and Alexander Brooks, Principal Machine Learning Engineer @RedHat, will demonstrate how extending vLLM’s prefix caching mechanism to multistage pipelines boosts inference speeds while reducing GPU memory overhead.
Join us in San Jose on October 20th to learn practical strategies for optimizing complex AI workloads: events.linuxfoundation.org/pytorch-conference-north-ameri…
#pytorchcon @vllm_project -
PyTorch
@PyTorch
🎤 Meet keynote speaker Jana van Greunen, Director of PyTorch Engineering at @Meta.
At #pytorchcon North America, Jana will share how Meta’s AI workloads are advancing #pytorch across hardware, research, and production.
📅 October 20-21 | San Jose
Register: -
PyTorch
@PyTorch
Deep dive today. Alpamayo 2 Super was built on PyTorch and is available on Hugging Face under OpenMDW‑1.1, the Linux Foundation’s permissive license for open AI model distributions.
NVIDIA DRIVE
@NVIDIADRIVE
Building robotaxis or L4 autonomy? Don't miss our livestream.
On Sept. 9 @ 9AM PT, we'll deep dive into NVIDIA Alpamayo 2 Super, covering release notebooks, robotaxi pipelines, AlpaSim updates and more.
Save the date: nvda.ws/4A1S9r5 -
PyTorch
@PyTorch
That’s a wrap on Day 2 keynotes! Visit the team at the PyTorch Foundation booth (G2) in the Solutions Showcase to talk about the work happening across the open source AI stack, from frameworks, compilers, and inference to hardware, infrastructure, and agents.
Walk through the Project Pavilion while you’re here. Stop by the @DeepSpeedAI table now until 12:45 pm, then find Safetensors from 1:15 to 3:30 p.m.
🔗 lfopensource.cn/kubecon-cloudnativecon-openinfra-summit-p…
#pytorchcon #kubecon #cloudnativecon #openinfrasummit -
PyTorch
@PyTorch
No single project, company, or community builds the AI stack alone. Behind the models, frameworks, cloud native technologies, & infrastructure powering AI is a global open source community working across every layer. Jane Lyu of @linuxfoundation, Fupan Li of @AntGroup, @Zesheng_Zong of @Huawei, Sunny Chan of TCC demonstrate how collaboration between projects & communities turns individual technologies into an open, interoperable AI ecosystem at #kubecon #openinfrasummit #pytorchcon China 2026 @CloudNativeFdn @openinfradev @PyTorch
-
PyTorch
@PyTorch
Hardware vendors and developers, help co-build an open, efficient heterogeneous computing ecosystem for PyTorch. During #pytorchcon China keynote by @Zesheng_Zong shares about the PyTorch TAC Accelerator Integration Working Group (WG) to overcome AI computing hardware heterogeneity challenges that come with high adaptation costs and lack of unified standards. The WG completed achievements and future roadmap including refined device-agnostic APIs and expanded multi-backend test matrix.
PyTorch
@PyTorch
Learn more about PyTorch Foundation working groups and how to join at: pytorch.org/working-groups/
-
PyTorch
@PyTorch
As model complexity and multi-agent workloads continue to grow, Trong Vinh Nguyen explains how Viettel unified a messy reality into a single platform by layering three open source ecosystems:
@openinfradev at the bare-metal layer, @CloudNativeFdn tooling for GPU pooling and multi-tenant slicing, and @PyTorch Foundation projects for serving optimization. The result is a Token-as-a-Service platform that treats every GPU in the fleet (old or new) as a productive contributor. -
PyTorch
@PyTorch
Under identical configurations, HyperParallel FSDP2 + Muon delivers substantially higher training throughput than PyTorch FSDP2 + Muon while maintaining consistent loss convergence. HyperParallel is a PyTorch-based distributed acceleration library optimized for Ascend SuperPoD. Demo during #pytorchcon China keynote conducted on a @Huawei Atlas 800T cluster using a Qwen3-30B-A3B training workload presents the complete distributed model training workflow & dynamically visualizes training throughput and loss convergence curves.
-
PyTorch
@PyTorch
Major ecosystem libraries like PyTorch and CuPy now build on the shared cuda.core foundation, reducing version conflicts and interop bugs for developers.
With CUDA 13.3, @nvidia released CUDA Python 1.0, the libraries and tools that give you the full CUDA platform from Python. Using standard CUDA context, devices, streams, and memory are shared with the rest of the Python GPU ecosystem, so your own kernels can run against CuPy arrays or PyTorch tensors without copying data.
Read the full blog post: developer.nvidia.com/blog/cuda-python-1-0-stable-apis-one… -
PyTorch
@PyTorch
🛡️ Build AI responsibly.
The Responsible AI Track at #pytorchcon North America covers governance, privacy, security, safety, compliance, and ethical AI development with #pytorch.
Learn more: events.linuxfoundation.org/pytorch-conference-north-ameri…
📅 Schedule: events.linuxfoundation.org/pytorch-conference-north-ameri…
🎟️ Register: -
PyTorch
@PyTorch
PyTorch Conference North America 2026 offers an excellent opportunity to connect with researchers, developers, and AI engineers from around the world.
In this video, Arun Bhandari, PyTorch Foundation Ambassador and leader of PyTorch Community Nepal, shares why he is excited to connect with the community and explore the latest developments in PyTorch.
Register here to join us in San Jose, CA this October 20-21: events.linuxfoundation.org/pytorch-conference-north-america/
#pytorchcon @ArunBha78090222This media couldn't be displayed. See it on the original post. -
PyTorch
@PyTorch
More than 250 organizations across China contribute to PyTorch Foundation projects, including @DeepSpeedAI, Helion, PyTorch, @raydistributed, Safetensors, and @vllm_project.
“Open source has become the default way the world builds AI, and the PyTorch Foundation is a leading hub for this innovation,” said @sparkycollier, Executive Director of the PyTorch Foundation.
“Welcoming @alibaba_cloud, Cambricon, and @AntGroup as members alongside @Huawei further strengthens the global open source AI ecosystem and community building the open source intelligence layer developers rely on for training, optimizing, serving, distributing, and running models. PyTorch Conference China brings that community together in Shanghai to continue learning from one another.”
Alibaba Cloud and Cambricon have joined the PyTorch Foundation as Platinum members, and Ant Group has joined as a Gold member.
Representatives from the three new member companies and Huawei are delivering keynotes at PyTorch Conference China on advancing the open AI stack, covering hardware, models, and infrastructure throughout the conference.
Alibaba Cloud’s Qwen infrastructure team is walking through how they serve Qwen at massive scale. Huawei will explore hardware-software co-design and the interoperability needed between Chinese and global AI technology stacks.
Cambricon is detailing how the company is hardening PyTorch’s device-agnostic foundation so any backend can offer broader reach and richer native capabilities. Ant Group is showing how existing cloud native building blocks can be assembled into a secure, on-demand runtime for AI agents.
Taken together, these keynotes move from silicon to software to deployment, giving conference attendees a full-stack view of how open source is being built into every layer of AI in China.
🔗 Read the press release: pytorch.org/blog/alibaba-cloud-ant-group-cambricon-and-hu… -
PyTorch
@PyTorch
Liang Zhang (@Huawei) delivers “Ascend & PyTorch: Pioneer New AI Open Ecosystem” at PyTorch Conference China 2026.
Drawing on eight years of open source practice, Liang Zhang looks at how Ascend’s collaboration with the PyTorch community is evolving from hardware adaptation to joint research on technical standards.
The keynote also covers next-generation AI hardware-software codesign, interoperability between Chinese and global AI technology stacks, and building an open and sustainable AI industrial ecosystem.
Here's Liang Zhang, introduced by @sparkycollier:
#pytorchconThis media couldn't be displayed. See it on the original post. -
PyTorch
@PyTorch
Cambricon’s Wei Li takes the stage at PyTorch Conference China 2026 for “Towards Device-agnostic PyTorch: Building Unified Infrastructure for a Multi-Backend Ecosystem.”
Wei looks at how Cambricon is taking a decade of full-stack co-optimization experience upstream, using an upstream-first approach to harden PyTorch’s device-agnostic foundation for every PrivateUse1 backend.
The goal: fixes upstream, seamless everywhere. Device-agnostic is the enabler, with broader device reach and richer backend-native capabilities as the bigger opportunity.
We’re excited to welcome Cambricon as a Platinum Member of PyTorch Foundation.
🔗 Read the announcement: pytorch.org/blog/cambricon-joins-the-pytorch-foundation-a…
#pytorchcon -
PyTorch
@PyTorch
We’re excited to welcome Cambricon (寒武纪) as a Platinum Member of the PyTorch Foundation!
Cambricon follows an “Upstream First” approach and has consistently contributed to the open source software ecosystem as a long-standing PyTorch contributor.
“We believe that the full potential of AI computing infrastructure can only be realized through tight hardware-software co-optimization and a thriving open ecosystem,” said Elton Gong , Vice President of Software Engineering at Cambricon. “For us, PyTorch is not just a framework, it is the core of our software ecosystem. For developers, a unified framework interface means lower migration costs, a consistent toolchain, and better development experience. For PyTorch, a more general device abstraction means fewer downstream forks and easier maintenance. Therefore, our goal is not simply to integrate Cambricon products with PyTorch. We want to work closely with the PyTorch community through sustained upstream contributions through which help PyTorch broaden its support for diverse backends, strengthen extensibility, and deliver unified device support ability. Through the collective efforts of the community, our shared goal is to help PyTorch deliver a native, out-of-the-box development experience across a broader range of hardware platforms. This is the main reason for our joining the PyTorch Foundation. We hope to put our years of experience in large-scale deployment to work for the global developer community through technical contributions, helping build a more open and diverse AI infrastructure.”
“For any AI accelerator to succeed at scale, it has to meet developers across the AI lifecycle, from building and optimizing models with PyTorch to serving them efficiently with @vllm_project,” said @sparkycollier, Executive Director of the PyTorch Foundation. “Cambricon’s sustained upstream contributions to PyTorch, together with its work enabling vLLM on Cambricon hardware, demonstrate the kind of open source commitment that moves the entire ecosystem forward. Welcoming Cambricon to the PyTorch Foundation strengthens our shared mission to keep AI infrastructure open, portable, and competitive across diverse hardware.”
We’re happy to welcome Jin Wang, Director of AI Frameworks at Cambricon, to our Board.
We're also pleased to welcome Jing Zhu, Lead Maintainer at Cambricon working on PyTorch, to the PyTorch Foundation's Technical Advisory Council (TAC).
🔗 Read the announcement: pytorch.org/blog/cambricon-joins-the-pytorch-foundation-a… -
PyTorch
@PyTorch
Live from Shanghai, @sparkycollier delivers his keynote, “Building Frontier Intelligence in the Open,” at PyTorch Conference China 2026.
Mark focuses on how PyTorch supports an open ecosystem where researchers, developers, model builders, and hardware companies can build and optimize AI across a growing range of models and compute.
From open models to new accelerator architectures, Mark is exploring how open development expands who can build AI, helps breakthroughs move from experimentation to production, and connects intelligence to the infrastructure that ultimately runs it.
#pytorchcon -
PyTorch
@PyTorch
The PyTorch Foundation is the vendor-neutral home for the open source intelligence layer developers use for training, optimizing, serving, orchestrating, and running models on ANY chip in ANY cloud for ANY agent explains @sparkycollier Executive Director of the PyTorch Foundation during keynote at #pytorchcon China in Shanghai
-
PyTorch
@PyTorch
#pytorchcon China 2026 is underway in Shanghai, bringing the PyTorch, cloud native, and OpenInfra communities together around “Open Source for the AI Era” alongside KubeCon + CloudNativeCon and OpenInfra Summit.
Keynotes begin at 9:00 AM, with @sparkycollier taking the stage at 9:32 AM for “Building Frontier Intelligence in the Open.”
Across the program, sessions span frameworks, compilers, inference, hardware, infrastructure, and agents.
Visit the PyTorch booth today or Wednesday (September 8–9) to meet the team and talk about the work happening across the open source AI stack.
🔗 See the full program and session schedule: www.lfopensource.cn/kubecon-cloudnativecon-openinfra-summ…
#pytorchcon #kubecon #cloudnativecon #openinfrasummit -
PyTorch
@PyTorch
At PyTorch Conference 2026, Lu Fang, Research Scientist, and Ilina Mitra, Engineering Manager @Meta, will present a deep dive on building high-performance recommendation inference systems.
They will detail end-to-end production workflows, covering graph capture, model splitting, and serving across large-scale platforms like Facebook and Instagram. Attendees will gain technical insights into advanced optimizations for high TPS and low latency, as well as strategies for multi-accelerator support to handle diverse machine learning workloads at scale.
Register for PyTorchCon North America today: events.linuxfoundation.org/pytorch-conference-north-ameri…
#pytorchcon @houser0ad @ilina_mitraThis media couldn't be displayed. See it on the original post. -
PyTorch
@PyTorch
Connecting researchers, engineers, and open source contributors in Bengaluru, @RedHat and @huggingface hosted an evening focused on the infrastructure, abstractions, and systems shaping the open ML stack.
Check out the full technical recap and session takeaways here: -
PyTorch reposted
Graphcore
@graphcoreai
Join us at Graphcore London for the London PyTorch Meetup!
📅 16 Sept, 6–9pm
🎤 Talks from Arsalan Uddin, Andrew Fitzgibbon and the wider PyTorch community
🍕 Food, drinks and networking
Register: luma.com/e999291v
#pytorch #londontech -
PyTorch
@PyTorch
📸 @sparkycollier provides the opening remarks for “Hardware-Aware AI: Building PyTorch Workloads Across Accelerators,” hosted by @Huawei.
Huawei’s co-located session focuses on PyTorch across GPUs, NPUs, and XPUs, including framework adaptation, operators, compiler co-optimization, workload migration, and performance tuning.
#pytorchcon China 2026 begins tomorrow, with two days of technical sessions and community conversations across PyTorch and the broader open source AI stack.
🔗 See this week’s schedule: www.lfopensource.cn/kubecon-cloudnativecon-openinfra-summ… -
PyTorch
@PyTorch
PyTorch Conference China 2026 begins this week in Shanghai alongside KubeCon + CloudNativeCon and OpenInfra Summit, bringing the PyTorch, Kubernetes, and OpenStack communities together across open source AI and infrastructure.
Across the program, developers, maintainers, and technical leaders will connect work spanning frameworks, compilers, inference, hardware, infrastructure, and agents.
Visit the PyTorch booth Tuesday or Wednesday (Sept 8-9) to meet the team and talk about the work happening across the open source AI stack.
🔗 See the full program and session schedule: www.lfopensource.cn/kubecon-cloudnativecon-openinfra-summ…
#pytorchcon #kubecon #cloudnativecon #openinfrasummit -
PyTorch
@PyTorch
Interested to learn how PyTorch Foundation Ambassadors scale local developer communities?
At PyTorch Conference North America 2026, Jiho Kim and Junghwan Park present a poster on growing PyTorch Korea through translation, mentorship, and regional events.
Register here to join the open source AI community in San Jose, October 20-21, 2026: events.linuxfoundation.org/pytorch-conference-north-ameri…
#pytorchcon -
PyTorch
@PyTorch
Hardware heterogeneity is no longer an edge case - it is the default.
Join us at PyTorch Conference North America 2026 (Oct 20–21, San Jose) for deep dives into kernel engineering, custom compiler backends, and performance optimization across GPUs, TPUs, NPUs, and custom ASICs.
Featured speakers include:
@AWS / AWS Annapurna Labs / Annapurna ML: Maen Suleiman, Yahav Biran, Esha Lakhotia, Pinak Panigrahi
@Arm: Kavya Sri Chennoju, Thomas Cottenier
@Google: Sandeep Pokkunuri, Chris Jones, Rob Mulla, Claudio Basile
@Huawei: Jiahao Chen, Jiahao Tan
@huggingface: Michael Benayoun
@IBM/ @IBMResearch: Takeshi Yoshimura, Olivier Tardieu, Matthew Arnold, Thomas Parnell, Prasanth Chatarasi, Bardia Mahjour, Viji Srinivasan, David Grove, Antoni Viros Martin, Avery Blanchard
@intel: Yu Guangye, Eikan Wang, Panagiotis Kourdis, Tanima Dey, Huma Abidi, Ashok Emani, Qiacheng Li
@Meta: Richard Zou, Mergen Nachin, Digant Desai
@RedHat: Markell Rawls
Beijing Academy of Artificial Intelligence: Yonghua Lin
@Fujitsu_Global / Fujitsu Research of India: Abhishek Jain, N Maajid Khan
Register here and stay for AGNTCon + MCPCon that same week: events.linuxfoundation.org/pytorch-conference-north-ameri…
Read the Hardware Acceleration & Compute Infrastructure Sessions guide: pytorch.org/blog/your-guide-to-hardware-acceleration-comp…
#pytorchcon -
PyTorch
@PyTorch
Ever wondered why type systems don't automatically track tensor shapes across your neural network modules?
In his upcoming talk at PyTorch Conference North America 2026 (October 20–21 in San Jose, CA), Avik Chaudhuri from @Meta breaks down how PyreFly - a static type checker for Python - enables end-to-end static shape coverage for PyTorch models.
Register for PyTorchCon North America today: events.linuxfoundation.org/pytorch-conference-north-ameri…
#pytorchcon @__avikThis media couldn't be displayed. See it on the original post. -
PyTorch reposted
Mark Collier 柯理怀
@sparkycollier
Accelerating Open Intelligence is the theme of #pytorchcon in San Jose this year and we’ve got the speakers lined up to talk about it
This media couldn't be displayed. See it on the original post.
PyTorch
@PyTorch
From research prototypes to production serving across heterogeneous hardware, PyTorch Conference North America 2026 brings the core developer community together this October 20-21 in San Jose.
Sessions will cover native PyTorch hardware integrations, agentic workflows, dynamic shape dynamic compiler optimization, high-performance kernel design and more.
Featured speakers include:
@AWS: Maen Suleiman
@AMD: Liz Li, Xiaohu Guo, Shekhar Pandey
@googlecloud /@Google : Bill Jia, Qi Zhou
@Huawei: Jing Li, Qi Guo
@huggingface: Sayak Paul
@intel: Whitney Tsang, Artur Fierka
@Meta: Oguz Ulgen, Dunfan Lu, Jason Ansel, Elias Ellison, Driss Guessous, Colin Taylor, Angela Yi, Jane Xu, Simon Layton, Angel Li, Richard Zou, Yidi Wu, Laith Sakka
@nvidia: Michael Goldfarb, Guray Ozen, Daniel Galvez
Rebellions: Minwook Ahn
@RedHat: Sean McGovern, Chris Leonard
Core Automation: Mark Saroufim
@CrusoeAI: Suman Debnath, JanakiRam Goteti
d-Matrix: Tristan Webb
Lemurian Labs: Jay Dawani
@Modular: Stefan Lindall
Today is the last chance to register for a standard ticket - join us for PyTorch Conference North America 2026 and stay for AGNTCon + MCPCon that same week: events.linuxfoundation.org/pytorch-conference-north-ameri…
Read the Hardware Acceleration & Compute Infrastructure Sessions guide: pytorch.org/blog/your-guide-to-hardware-acceleration-comp…
#pytorchcon -
PyTorch
@PyTorch
From research prototypes to production serving across heterogeneous hardware, PyTorch Conference North America 2026 brings the core developer community together this October 20-21 in San Jose.
Sessions will cover native PyTorch hardware integrations, agentic workflows, dynamic shape dynamic compiler optimization, high-performance kernel design and more.
Featured speakers include:
@AWS: Maen Suleiman
@AMD: Liz Li, Xiaohu Guo, Shekhar Pandey
@googlecloud /@Google : Bill Jia, Qi Zhou
@Huawei: Jing Li, Qi Guo
@huggingface: Sayak Paul
@intel: Whitney Tsang, Artur Fierka
@Meta: Oguz Ulgen, Dunfan Lu, Jason Ansel, Elias Ellison, Driss Guessous, Colin Taylor, Angela Yi, Jane Xu, Simon Layton, Angel Li, Richard Zou, Yidi Wu, Laith Sakka
@nvidia: Michael Goldfarb, Guray Ozen, Daniel Galvez
Rebellions: Minwook Ahn
@RedHat: Sean McGovern, Chris Leonard
Core Automation: Mark Saroufim
@CrusoeAI: Suman Debnath, JanakiRam Goteti
d-Matrix: Tristan Webb
Lemurian Labs: Jay Dawani
@Modular: Stefan Lindall
Today is the last chance to register for a standard ticket - join us for PyTorch Conference North America 2026 and stay for AGNTCon + MCPCon that same week: events.linuxfoundation.org/pytorch-conference-north-ameri…
Read the Hardware Acceleration & Compute Infrastructure Sessions guide: pytorch.org/blog/your-guide-to-hardware-acceleration-comp…
#pytorchcon -
PyTorch
@PyTorch
🚨 Final call, AI community!
Ticket prices for #pytorchcon North America go up TONIGHT at 11:59 PM PDT.
Save $200 and join AI pioneers, researchers, and developers October 20-21 in San Jose. Hurry & get your pass now:
events.linuxfoundation.org/pytorch-conference-north-ameri… -
PyTorch
@PyTorch
The PyTorch AOTI backend delivered a 1.14x–1.28x speedup over the Python backend in NVIDIA’s HSTU inference tests when deployed with Triton Inference Server.
With the PyTorch AOTI backend and KV cache, @nvidia reports a 2.20x–2.38x speedup in an ideal all-GPU cache-hit scenario.
The results come from NVIDIA’s recsys-examples repository, a collection of examples demonstrating best practices for training and deploying generative recommenders on NVIDIA GPUs using PyTorch. It includes optimized HSTU and Semantic ID implementations covering training and inference workflows.
For HSTU inference, recsys-examples supports PyTorch AOTInductor to execute the model in the Torch C++ runtime. The NVIDIA developer blog also covers nv-embedding-cache, which provides PyTorch-compatible modules for accelerating large-scale embedding lookups.
🔗 Read the full post: developer.nvidia.com/blog/how-generative-recommenders-are… -
PyTorch
@PyTorch
TorchSpec is a PyTorch-native framework for training speculative decoding draft models. This release, a collaboration with @vllm_project, shows it in action on Kimi K3 @lightseekorg
LightSeek Foundation
@lightseekorg
Releasing the @Kimi_Moonshot K3 Draft Collection — 3 draft models (EAGLE-3, DFlash2, DSpark) trained with TorchSpec and @vllm_project on @NVIDIAAI GB200. 🚀
We also shared the data recipes. More on the blog → lightseek.org/blog/kimi-k3-draft-collection.html -
PyTorch
@PyTorch
In PyTorch 2.14, fault tolerance becomes a first-class c10d concept, with in-place process-group reconfiguration.
When a rank fails in a large job, the usual recovery is to tear down the process group and restart, which discards warm state across the whole cluster. Backend and ProcessGroup now expose reconfiguration interfaces so a group can be rebuilt in place, with abort hooks and pre and post collective hooks wired through the same path.
Gloo gains fault-tolerance support alongside nccl2, and the reconfigure APIs are documented. The release blog marks the API as unstable.
🔗 Read the PyTorch 2.14 release blog: pytorch.org/blog/pytorch-2-14-release-blog/ -
PyTorch
@PyTorch
At PyTorch Conference North America 2026, hear directly from and connect with the people working on PyTorch, @vllm_project, @DeepSpeedAI, @raydistributed, Helion, and Safetensors, alongside experts working across the AI stack.
At #pytorchcon NA 2025, @richliaw (@raydistributed, @anyscalecompute) spoke about the Ray team’s focus on building something “useful and critical to the AI infrastructure space” and about “how important Ray can be for the stack.”
PyTorch conferences are the open source AI community’s town square, where what’s next gets decided.
Register by September 4 (tomorrow) to save on your conference pass: events.linuxfoundation.org/pytorch-conference-north-ameri…
#pytorchcon -
PyTorch
@PyTorch
Discover how open source agentic search and hardware-guided workflows are unlocking massive speedups across GPUs and TPUs at PyTorch Conference North America (Oct 20–21 in San Jose).
Speakers will cover hardware-guided multi-agent kernel optimization and LLM autotuning to accelerate performance, multimodal world action models and ExecuTorch runtimes for physical AI, stateful guardrails and governance frameworks to ensure production accountability.
Featured speakers include:
@AMD: Anshu Raina, Peyman Razaghi
@Arm: Thomas Cottenier, Kavya Sri Chennoju
@AWS: Sai Charan Teja Gopaluni, Aaresh Sharma
@Google: Sandeep Pokkunuri, Chris Jones
@intel: Xiaogang Gu, Qun Yang
@Meta: Kaiming Cheng, Laura Wang, Jongsok Choi, Ethan Che, Oguz Ulgen, Dunfan Lu, Jason Ansel, Sanket Jayant Purandare, Aditya Venkataraman, Jacob Szwejbka, Mergen Nachin, Digant Desai
@nvidia: Susie Xia, Ruijie Zheng, George Kurian
@amazon: Purva Chiniya
@Apple: Prakshal Doshi, Aditi Mewada
@boson_ai: Mu Li, Huapeng Zhou, Lindsey Allen
@CapitalOne: Ravi Teja Prabhala Venkata
Rerun: Gijs de Jong, Peter Prettenhofer
Register for your standard ticket by September 4: events.linuxfoundation.org/pytorch-conference-north-ameri…
Read the Agentic AI and Next-Gen Sessions guide: pytorch.org/blog/agentic-ai-and-next-gen-intelligence-ses…
#pytorchcon -
PyTorch
@PyTorch
Tomorrow is your last day to save $200 on registration for #pytorchcon North America!
Register by September 4 at 11:59 PM PDT & join AI pioneers, researchers, and developers October 20-21 in San Jose.
Save your seat and $200:
events.linuxfoundation.org/pytorch-conference-north-ameri… -
PyTorch
@PyTorch
Lablup (@lablupinc) has joined PyTorch Foundation as a Silver Member to advance open source AI!
@lablupinc builds software that powers AI—from desktops to data centers. With backend.ai, anyone can choose, connect, and operate AI models at the right cost and scale.
"Lablup has developed backend.ai as open source since founding. PyTorch sits at the center of that work. Joining the Foundation is our way of contributing back to the ecosystem that has long supported us."
— Jeongkyu Shin, CEO of Lablup -
PyTorch
@PyTorch
A round of applause for our #kubecon + #cloudnativecon + #openinfrasummit + #pytorchcon gold sponsors. This event, Sept 7-9 in Shanghai, brings the OpenInfra, cloud native, & PyTorch ecosystems together for a deep dive into open source's future. Learn more: www.lfopensource.cn/kubecon-cloudnativecon-openinfra-summ…
-
PyTorch
@PyTorch
PyTorch 2.14 brings CuTeDSL-generated CUTLASS kernels to Inductor through NVGEMM, a new nccl2 backend for PyTorch Distributed, first-class c10d fault tolerance, native linear algebra on Apple Silicon, torch.switch and CUDA graph capture for torch.while_loop, declarative dynamic shapes via @ dynamic_spec, broader platform support, and experimental torch.compile support for complex-valued tensors.
Highlights include:
- NVGEMM brings CuTeDSL-generated CUTLASS kernels to Inductor, with epilogue fusion, scaled and NVFP4 GEMM, and grouped-reduction epilogues autotuned alongside Triton and ATen
- A new nccl2 backend for PyTorch Distributed, ported from torchcomms, implementing the full collective contract with nonblocking communicators and eager communicator splitting
- Fault tolerance becomes a first-class c10d concept, with in-place process-group reconfiguration, one-sided RMA windows, and a Flight Recorder that works for any backend rather than only NCCL
- Apple Silicon gains native linear algebra, including Jacobi-kernel SVD, eigh, QR and Cholesky, alongside a five-part reduction rewrite and a further MPSGraph to Metal kernel migration
- torch.switch generalizes torch.cond to multi-way branching, and torch.while_loop can now be captured in a CUDA graph
- Declarative dynamic shapes via @ dynamic_spec, shared across torch.compile, torch.export and make_fx
- Broader platform support: ROCm 7.14 wheels are produced from the TheRock pip SDK, Intel XPU adds native graph capture, and Inductor targets Rubin (sm_107)
- Experimental torch.compile support for complex-valued tensors: opt-in support decomposes supported complex operations into real and imaginary computations, enabling compiler backends to optimize more complex-number workloads
PyTorch 2.14 includes 2,995 commits from 487 contributors since PyTorch 2.13.
Bring your questions about PyTorch 2.14 to our live Q&A on Thursday, September 17, 2026 at 11 AM PT. Andrey Talman (@Meta), Natalia Gimelshein (@Meta), Joe Spisak (@joespeez, @reflection_ai), and Chris Gottbrath (Gottbrath Tech) will share an overview of PyTorch 2.14 and answer community questions about PyTorch and the new capabilities.
Register for the live Q&A: pytorch.org/event/pytorch-2-14-release-live-qa/
🔗 Read the PyTorch 2.14 release blog: pytorch.org/blog/pytorch-2-14-release-blog/ -
PyTorch
@PyTorch
We’re bringing together open source leaders to tackle some of the biggest technical challenges in agentic AI at PyTorch Conference North America (Oct 20–21 in San Jose).
Explore critical themes across the entire lifecycle, from adaptive post-deployment learning to vendor-neutral workload migration, scalable reinforcement learning infrastructure, high-throughput vLLM production serving and agent-assisted workflows for maintaining PyTorch itself.
Featured Speakers include:
@Google : Bill Jia
@huggingface : Ben Burtenshaw, Sergio Paniego Blanco
@IBM : Or Ozeri
@intel : Eikan Wang, Huma Abidi
@Meta : Yichuan Wang, Shuhua Yu, Felipe Mello, Jiani Wang, Edward Yang, Driss Guessous, Andrey Talman
@adaption_ai : Sara Hooker
@AgenticAIFdn : Mazin Gilbert, MBA, Ph.D.
ByteDance: Neiwen LING
@radixark : Mao Cheng
@RedHat : Joseph Groenenboom, Tyler Michael Smith
@tensormesh : Kuntai Du
University of Virginia: Tianle Zhong
Register for your standard ticket by September 4: events.linuxfoundation.org/pytorch-conference-north-ameri… + stay for AGNTCon + MCPCon that same week
Read the Agentic AI and Next-Gen Sessions guide: pytorch.org/blog/agentic-ai-and-next-gen-intelligence-ses… -
PyTorch
@PyTorch
🔥 Keynote Speaker Announcement
@addvin, SVP & AI CTO at @RedHat, joins the keynote lineup at #pytorchcon North America.
📅 October 20-21
📍 San Jose, CA
Full Schedule:
events.linuxfoundation.org/pytorch-conference-north-ameri…
Register:
events.linuxfoundation.org/pytorch-conference-north-ameri… -
PyTorch reposted
The Linux Foundation
@linuxfoundation
Open source powers every layer of the AI software stack—from agents and models to inference, training and cloud infrastructure.
At #ossummit Korea, Linux Foundation CEO Jim Zemlin explains how open collaboration is making AI faster, more affordable and more accessible.
Watch:This media couldn't be displayed. See it on the original post. -
PyTorch
@PyTorch
⏰ ONE WEEK TO GO!
In just seven days, the #opensource community comes together in Shanghai for #kubecon + #cloudnativecon + #openinfrasummit + #pytorchcon China.
Join developers, maintainers, researchers, and technology leaders for three days of ideas, collaboration, and connections across #cloudnative, open infrastructure, AI, and machine learning.
📅 September 7-9
📍 Shanghai, China
The countdown is on. Register now and join us:
www.lfopensource.cn/kubecon-cloudnativecon-openinfra-summ… -
PyTorch
@PyTorch
🗣 Shoutout to our #kubecon + #cloudnativecon + #openinfrasummit + #pytorchcon platinum sponsor. Running Sept 7-9 in Shanghai, China, this event combines CNCF, OpenInfra, & PyTorch programming to shape the future of cloud native & next-gen AI. Learn more: www.lfopensource.cn/kubecon-cloudnativecon-openinfra-summ…
-
PyTorch
@PyTorch
PyTorch 2.14 introduces updates to Inductor, PyTorch Distributed, c10d, dynamic shapes, Apple Silicon, and accelerator platform support, with 2,995 commits from 487 contributors since PyTorch 2.13.
Bring your questions about PyTorch 2.14 to our live Q&A on Thursday, September 17, 2026. Andrey Talman (@Meta), Natalia Gimelshein (@Meta), @joespeez (@reflection_ai), and Chris Gottbrath (Gottbrath Tech, moderator) will share an overview of PyTorch 2.14 and answer community questions about PyTorch and the new capabilities.
Register: streamyard.com/watch/E7iTfnUvpvTW
PyTorch 2.14 covers:
R: UTLASS kernels in Inductor
- The new nccl2 backend for PyTorch Distributed
- Fault-tolerant collectives and process-group reconfiguration in c10d
- Native linear algebra and additional Metal kernel improvements on Apple Silicon
- torch.switch and CUDA graph capture for torch.while_loop
- Declarative dynamic shapes with @dynamic_spec
- Experimental torch.compile support for complex-valued tensors
- Expanded ROCm, Intel XPU, and NVIDIA platform support
Want to learn more about compiler and runtime work, distributed communication, device portability, accelerator integration, and more? Register for #pytorchcon North America 2026, where engineers, researchers, and maintainers will convene October 20–21 in San Jose: events.linuxfoundation.org/pytorch-conference-north-ameri… -
PyTorch
@PyTorch
How do you train a 671-billion-parameter model across a thousand GPUs, and do it efficiently? Normally, finding the best setup means running option after option, burning weeks and a huge amount of compute.
Join Anshu Raina and @peyman_razaghi of @AMD at #pytorchcon where they show how the Primus Tuning Agent predicts how fast each option will run, ahead of time, from quick hardware benchmarks, so you find the best configuration without running them all, saving thousands of GPU-hours of trial-and-error.
Register for PyTorchCon North America today: events.linuxfoundation.org/pytorch-conference-north-ameri…This media couldn't be displayed. See it on the original post. -
PyTorch
@PyTorch
PyTorch can be used to build federated multimodal AI workflows, addressing the challenges caused by distributed data.
To streamline these complex pipelines, NVIDIA FLARE externalizes large message payloads by replacing big objects with lightweight references and transferring data independently. Flare Tensor Downloader further optimizes model distribution through incremental tensor streaming to reduce peak memory requirements.
Read the latest technical blog from @nvidia to learn how to coordinate multi-site federated training and manage large model updates using externalization, tensor streaming, and disk-backed aggregation.
Link to blog: developer.nvidia.com/blog/building-federated-multimodal-a… -
PyTorch
@PyTorch
The Kernel Engineering track at #pytorchcon North America 2026 goes deep on compilers, optimization, custom kernels, domain-specific languages, and the lower-level systems work behind high-performance PyTorch.
And don’t miss @marksaroufim (@GPU_MODE)'s keynote!
Register by September 4 to save: events.linuxfoundation.org/pytorch-conference-north-ameri…
Mark Collier 柯理怀
@sparkycollier
If you like GPU kernels you’re going to love #pytorchcon
And don’t miss @marksaroufim of @GPU_MODE fame who will be giving a keynote!This media couldn't be displayed. See it on the original post. -
PyTorch reposted
Mark Collier 柯理怀
@sparkycollier
Naturally @tobi @ShopifyEng @MParakhin are leading the way, but every company will do this:
1) take open weight models like @Alibaba_Qwen from @AlibabaGroup (trained with @PyTorch)
2) fine tune to make small specialized intelligence models for company specific work
3) Profit
tobi lutke
@tobi
Training tiny models for special purpose use cases works so incredibly well if you have a great self improving recursive flywheel. Shopify ML team is on fire.
finetuned 0.8b model beats GPT 5.6-sol xhigh in this very specialized task. -
PyTorch
@PyTorch
Your code can wait for one compile. This price cannot. ⏳
Only 3 days remain to save $200 on your #pytorchcon North America registration.
Join AI pioneers, researchers, and developers October 20-21 in San Jose:
events.linuxfoundation.org/pytorch-conference-north-ameri… -
PyTorch
@PyTorch
Meet the people behind the open source tools we use every day.
PyTorch Foundation Ambassador, Abdulsalam Bande, is looking forward to connecting with the wider PyTorch Community at PyTorch Conference North America this October 2026.
Register for PyTorchCon NA: -
PyTorch
@PyTorch
One trip. Three ways to connect with #opensource communities in Shanghai. ✨
Alongside #kubecon + #cloudnativecon + #openinfrasummit + #pytorchcon China, September 7-9:
🤖 #agntcon + #mcpcon China, September 6-7
Separate registration required:
www.lfopensource.cn/kubecon-cloudnativecon-openinfra-summ…
🌐 OSPOlogy + #osposummit China
Add it to your main event registration:
www.lfopensource.cn/kubecon-cloudnativecon-openinfra-summ…
Build a bigger Shanghai experience:
www.lfopensource.cn/kubecon-cloudnativecon-openinfra-summ… -
PyTorch
@PyTorch
🎉 THANK YOU to our #kubecon + #cloudnativecon + #openinfrasummit + #pytorchcon China strategic sponsor Huawei. From Sept 7-9, Shanghai will host this flagship gathering uniting Kubernetes, OpenStack, & PyTorch communities under one roof. Learn more: www.lfopensource.cn/kubecon-cloudnativecon-openinfra-summ…
-
PyTorch reposted
Mark Collier 柯理怀
@sparkycollier
If you like GPU kernels you’re going to love #pytorchcon
And don’t miss @marksaroufim of @GPU_MODE fame who will be giving a keynote!This media couldn't be displayed. See it on the original post. -
PyTorch
@PyTorch
⚙️ Performance starts here. The Kernel Engineering Track at #pytorchcon North America (Oct 20-21 in San Jose) explores compilers, custom kernels, optimization, and the low-level technologies that make AI run faster.
Learn more: events.linuxfoundation.org/pytorch-conference-north-ameri…
📅 Full Schedule: events.linuxfoundation.org/pytorch-conference-north-ameri…
🎟️ Join us! events.linuxfoundation.org/pytorch-conference-north-ameri… -
PyTorch
@PyTorch
NVIDIA's (@nvidia) Anjulie Agrusa, Ryan Spring, and Bruce Zitelli will show how the latest NVFP4 pretraining recipes can accelerate large-scale LLM training while closing the quality gap to BF16 at PyTorch Conference North America 2026.
Their October 21 session, “Efficient Pretraining of LLMs in NVFP4,” will cover the recipe and PyTorch tooling that make this possible, including recipe design, kernel choices, and the API surface needed to bring NVFP4 training into native PyTorch workflows.
The recipes are being upstreamed into the PyTorch ecosystem through TorchAO and TorchTitan, with dense linear NVFP4 training available in TorchAO today.
Register by September 4 to save on your conference pass.
🔗 Register: events.linuxfoundation.org/pytorch-conference-north-ameri…
#pytorchcon -
PyTorch
@PyTorch
vLLM (@vllm_project) sessions at #pytorchcon NA 2026 show how teams are optimizing inference, working on PyTorch release validation and compatibility, and using vLLM in broader serving and application workflows.
Speakers will cover CUTLASS, Triton, and Helion; faster model loading with fastsafetensors; quantization and HiFloat; autonomous kernel bring-up and Intel GPU optimization; PyTorch release validation, enterprise agentic inference, stable ABI, and dynamic shapes; vision-language serving; cloud-to-edge workflows; high-speed storage; a serving stack for a physics-constrained generative model; and contributor onboarding and first-PR workflows.
Featured speakers include:
@nvidia: Michael Goldfarb, Guray Ozen, Aastha Jhunjhunwala, and @MarkMoyou
@Meta: Andrey Talman, @janeyx99, and Laith Sakka
@Arm: Kavya Sri Chennoju
@IBM: Takeshi Yoshimura and Nili Guy
@RedHat: Markell Rawls, Joseph Groenenboom, Tyler Michael Smith, Sean McGovern, Christopher Leonard, and Maroon Ayoub
@Google: Ankita Luthra and Trinadh Kotturu
@intel: Xiaogang Gu, Qun Yang, Whitney Tsang, and Artur Fierka
@Huawei: Yun Zhao and Haonan Zhang
@IBMResearch: Burkhard Ringlein
@UMNews: @arunshar08
Register by September 4 to save: events.linuxfoundation.org/pytorch-conference-north-ameri…
Read the vLLM session guide: pytorch.org/blog/vllm-sessions-at-pytorch-conference-nort… -
PyTorch
@PyTorch
🚀 Keynote Speaker Announced
@clattner_llvm, Executive Vice President of Advanced AI Software and Platforms at @Qualcomm, joins the keynote lineup at #pytorchcon North America.
📅 October 20-21
📍 San Jose, CA
Schedule: events.linuxfoundation.org/pytorch-conference-north-ameri…
Register by Sept 4 & save: events.linuxfoundation.org/pytorch-conference-north-ameri… -
PyTorch
@PyTorch
Ready to tackle the systems challenges of Agentic Reinforcement Learning? @YichuanM and @shuhuayu_ will share how to train agents that can runs hundreds of turns along with the infrastructure and training recipe to make it scalable and reproducible at PyTorch Conference North America. Join us for this deep dive into building an end-to-end agentic RL training loop. Register now: events.linuxfoundation.org/pytorch-conference-north-ameri…
This media couldn't be displayed. See it on the original post. -
PyTorch
@PyTorch
vLLM @vllm_project sessions at #pytorchcon NA 2026 span the serving stack, from attention and KV cache management to disaggregated serving and hardware portability across accelerators.
Speakers will cover attention and KV cache systems, disaggregated serving, expert parallelism, and vLLM across TPU, Trainium, Arm, and IBM Spyre.
Featured speakers include:
@RedHat: Lucas Wilkinson, Matthew Bonanni, Zhanqiu Hu, @rickynds, and Alex Brooks
@amazon: Sunita Nadampalli
@IBM: Or Ozeri, Thomas Parnell, and Dave Grove
@Huawei: Mengqing Cao
@nvidia: Itay Alroy
@Google: @Rob_Mulla and Qi Zhou
@awscloud: Maen Suleiman
@Meta: Richard Zou, Colin Taylor, and Angela Yi
@BAAIBeijing: Yonghua Lin
@fujitsulabs: Abhishek Jain and N Maajid Khan
@IBMResearch: Antoni Viros i Martin and Avery Blanchard
@MistralAI: Nicolò Lucchesi
@tensormesh: @this_will_echo
@googlecloud: Bill Jia
Register by September 4 to save: events.linuxfoundation.org/pytorch-conference-north-ameri…
Read the vLLM session guide: pytorch.org/blog/vllm-sessions-at-pytorch-conference-nort… -
PyTorch
@PyTorch
At PyTorch Conference North America 2026, hear directly from and connect with the people working on PyTorch, @vllm_project, @DeepSpeedAI, @raydistributed, Helion, and Safetensors, alongside experts working across the AI stack.
At #pytorchcon NA 2025, Christian Jacobi (@IBM) spoke about clients thinking about deploying AI across core IT and business processes and what comes next: “There’s a lot of innovation ahead of us to do that at scale with the qualities of service that they are used to from classical enterprise computing.”
PyTorch conferences are the open source AI community’s town square, where what’s next gets decided.
Register by September 4 to save on your conference pass: events.linuxfoundation.org/pytorch-conference-north-ameri…
#pytorchcon -
PyTorch
@PyTorch
At PyTorch Conference North America 2026, hear directly from and connect with the people working on PyTorch, @vllm_project, @DeepSpeedAI, @raydistributed, Helion, and Safetensors, alongside experts working across the AI stack.
Keynote speaker @simon_mo_ (@vllm_project, @inferact) says vLLM’s goal is to become “the easiest to use and most efficient inference engine.” At #pytorchcon NA 2025, he spoke about the difficulty and cost of using large language models and continuing to push inference efficiency forward.
PyTorch conferences are the open source AI community’s town square, where what’s next gets decided.
Register by September 4 to save on your conference pass: events.linuxfoundation.org/pytorch-conference-north-ameri… -
PyTorch
@PyTorch
AI pioneers, researchers, and developers: your smartest model this week is registering early. 🧠
Ticket prices for #pytorchcon North America go ⬆️ in 1 week. Register by September 4 to save $200.
Join us October 20-21 in San Jose, CA! events.linuxfoundation.org/pytorch-conference-north-ameri… -
PyTorch
@PyTorch
PyTorch conferences are the open source AI community’s town square, where what’s next gets decided. At #pytorchcon NA 2026, Core PyTorch sessions focus on the framework itself and the engineering work shaping how it is built and extended.
The program spans torch.compile and dynamic shapes, distributed communication, out-of-tree backends, the release process and CI, profiling and observability, tensor layouts, stable ABI, and accelerator backends.
Featured speakers include:
@AMD: Prachi Gupta
@awscloud Annapurna Labs: Esha Lakhotia
@Google: Claudio Basile
@Huawei: Jiahao Chen and Jiahao Tan
@IBM: Olivier Tardieu and Dave Grove
@IBMResearch: Matthew Arnold, Antoni Viros i Martin, and Avery Blanchard
@intel: Yu Guangye, Eikan Wang, Panos Kourdis, and Tanima Dey
@Meta: Andrey Talman, @drisspg, @rice_fry, Kapil Sharma, Natalia Gimelshein, William Wen, Steven Troxler, @__avik, @sanketpurandare, @aditvenk, Elias Ellison, @janeyx99, Simon Layton, Laith Sakka, Angel Li, Richard Zou, and Yidi Wu
@nvidia: @memorypaladin, Sreeram Potluri, and Artem Polyakov
@RedHat: Subin George Malana, Jewel K M, Sean McGovern, and Christopher Leonard
@amazon: Pinak Panigrahi
Register by September 4 to save: events.linuxfoundation.org/pytorch-conference-north-ameri…
Read the Core PyTorch session guide: pytorch.org/blog/core-pytorch-sessions-at-pytorch-confere… -
PyTorch
@PyTorch
At PyTorch Conference North America 2026, hear directly from and connect with those working on PyTorch, @vllm_project, @DeepSpeedAI, @raydistributed, Helion, and Safetensors, alongside experts working on GPUs, NPUs, model architectures, inference engines, and architectures spanning the data center and edge.
PyTorch Foundation Executive Director @sparkycollier points to why bringing communities together matters: new model architectures, hardware architectures, and inference engines need coordination across software and hardware experts, alongside the open source software being built to support them.
Meet the people behind the work October 20–21 in San Jose.
Register by September 4 to save on your conference pass: events.linuxfoundation.org/pytorch-conference-north-ameri…
View the schedule: events.linuxfoundation.org/pytorch-conference-north-ameri…
#pytorchconThis media couldn't be displayed. See it on the original post. -
PyTorch
@PyTorch
Use PyTorch-native libraries within the NVIDIA NeMo Framework to customize models to hit your exacting requirements for latency, speed, memory, and compute.
@NVIDIA's blog demonstrates how quantization-aware distillation (QAD) improves the Nemotron 3.5 Lightning model using NVIDIA Model Optimizer. We walk through the entire training pipeline, and show how QAD consistently outperforms post-training quantization (PTQ) compression on agentic benchmarks, ensuring high quality while reducing memory usage.
Read it here: developer.nvidia.com/blog/developing-nemotron-3-5-lightni… -
PyTorch
@PyTorch
☁️ Keynote Speaker Spotlight
Maen Suleiman, Principal Product Manager at @awscloud, joins #pytorchcon North America to discuss the future of #ai infrastructure & #opensource innovation.
📅 October 20-21
📍 San Jose, CA
Schedule: events.linuxfoundation.org/pytorch-conference-north-ameri…
Register: events.linuxfoundation.org/pytorch-conference-north-ameri… -
PyTorch
@PyTorch
We’re proud to announce the inaugural #pytorchdayjapan, hosted by PyTorch Foundation, @huggingface, @IBM, and Mitsubishi Electric (@ME_JP_official), on December 10 in Tokyo.
#pytorchdayjapan will bring together PyTorch enthusiasts, machine learning engineers, AI researchers, and industry professionals for technical talks and discussions spanning training, inference, responsible AI, and more.
PyTorch Day Japan is dedicated to open source AI and the impact of PyTorch Foundation projects including PyTorch, @vllm_project, @DeepSpeedAI, Ray, Helion, and Safetensors.
🔗 Learn more: events.linuxfoundation.org/pytorch-day-japan/register/ -
PyTorch
@PyTorch
Shanghai, the #opensource community is heading your way! 🇨🇳
In less than 2 weeks, meet attendees from Alibaba, Ant Group, ByteDance, Huawei, Tencent, NVIDIA, Google, Microsoft, Meta, + more at #kubecon + #cloudnativecon + #openinfrasummit + #pytorchcon China.
📅 September 7-9
Register now: www.lfopensource.cn/kubecon-cloudnativecon-openinfra-summ… -
PyTorch
@PyTorch
What began as experimentation with a Python framework evolved into PyTorch, the underlying framework for developers in the fast-moving AI space.
At #pytorchcon NA 2025, Jana van Greunen (@Meta) reflected on that evolution and the scale of the AI work PyTorch powers today.
#pytorchcon North America returns October 20–21, 2026, in San Jose.
🔗 Register by September 4 to save on your ticket: events.linuxfoundation.org/pytorch-conference-north-ameri… -
PyTorch
@PyTorch
🎤 Keynote Speaker Spotlight
Meet Yiwei Song, Senior Director of AI Model Cycle at @CrusoeAI, joining the #pytorchcon North America keynote stage to present “AI Model Customization Platform.” events.linuxfoundation.org/pytorch-conference-north-ameri…
📅 October 20-21
📍 San Jose, CA
Join us! -
PyTorch
@PyTorch
TRANSIT (TRANsparent Scale-In for multi-node Training) is a runtime that makes unified virtual memory practical for large-scale LLM training, enabling models to train on up to 50% fewer GPUs without requiring modification to existing PyTorch training code.
Hyungyo Kim, Ph.D. Candidate in Electrical and Computer Engineering, University of Illinois at Urbana-Champaign will present on TRANSIT as a poster at PyTorch Conference North America with Apoorve Mohan from IBM Research.
Learn how to train more with less at PyTorch Conference North America: events.linuxfoundation.org/pytorch-conference-north-ameri…This media couldn't be displayed. See it on the original post. -
PyTorch
@PyTorch
Attendees of PyTorch Conference Europe earlier this year share what it's like to attend #pytorchcon.
PyTorch Conference North America will be here before you know it. Don't miss out: events.linuxfoundation.org/pytorch-conference-north-ameri…This media couldn't be displayed. See it on the original post. -
PyTorch
@PyTorch
Leverage PyTorch-native building blocks for constructing GPU-accelerated materials simulation workflows with coding agents.
@NVIDIA follows an end-to-end NVIDIA ALCHEMI Toolkit workflow: what the researcher starts with, how they prompt the agent, what code and simulation pipeline it produces, and how the results are validated on NVIDIA H200 GPUs.
Read more: developer.nvidia.com/blog/how-ai-coding-agents-can-unlock… -
PyTorch
@PyTorch
⚡ Keynote Speaker Spotlight
Ujval Kapasi, VP of AI & HPC Frameworks & Libraries at @nvidia, is taking the keynote stage at #pytorchcon North America.
📅 October 20-21
📍 San Jose, CA
Schedule: events.linuxfoundation.org/pytorch-conference-north-ameri…
Register: events.linuxfoundation.org/pytorch-conference-north-ameri… -
PyTorch
@PyTorch
And we have a winner. Congrats to @gatere_mark for creating the winning design in our 2026 PyTorch Foundation Flare Pin Community Design Contest!
You'll be able to collect this flare pin at the Flare Party on Tuesday, October 20th during PyTorch Conference North America. Learn more & get your ticket to attend #pytorchcon events.linuxfoundation.org/pytorch-conference-north-america/ #pytorchpin -
PyTorch
@PyTorch
🎤 The final speakers in our keynote lineup are here!
Hear from leaders across cloud native, AI, and open source at #kubecon + #cloudnativecon + #openinfrasummit + #pytorchcon China, September 7-9 in Shanghai.
Featuring experts from The Linux Foundation, NVIDIA, Huawei, Ant Group, Inferact, Viettel, Xiaohongshu, and more.
🎙️ Meet our speakers: www.lfopensource.cn/kubecon-cloudnativecon-openinfra-summ…
🎟️ Register: www.lfopensource.cn/kubecon-cloudnativecon-openinfra-summ… -
PyTorch
@PyTorch
🎤 It's time to announce our third set of keynote speakers coming to Shanghai!
Hear from leaders across cloud native, AI, and open source at #kubecon + #cloudnativecon + #openinfrasummit + #pytorchcon China, September 7-9 in Shanghai.
Featuring experts from The Linux Foundation, NVIDIA, Huawei, Ant Group, Inferact, Viettel, Xiaohongshu, and more.
🎙️ Meet our speakers: www.lfopensource.cn/kubecon-cloudnativecon-openinfra-summ…
🎟️ Register: www.lfopensource.cn/kubecon-cloudnativecon-openinfra-summ… -
PyTorch
@PyTorch
🎤 We're excited to announce our second set of keynote speakers!
Hear from leaders across cloud native, AI, and open source at #kubecon + #cloudnativecon + #openinfrasummit + #pytorchcon China, September 7-9 in Shanghai.
Featuring experts from The Linux Foundation, NVIDIA, Huawei, Ant Group, Inferact, Viettel, Xiaohongshu, and more.
🎙️ Meet our speakers: www.lfopensource.cn/kubecon-cloudnativecon-openinfra-summ…
🎟️ Register: www.lfopensource.cn/kubecon-cloudnativecon-openinfra-summ… -
PyTorch
@PyTorch
🎤 The keynote lineup is here! Check out our first set of speakers.
Hear from leaders across cloud native, AI, and open source at #kubecon + #cloudnativecon + #openinfrasummit + #pytorchcon China, September 7-9 in Shanghai.
Featuring experts from The Linux Foundation, NVIDIA, Huawei, Ant Group, Inferact, Viettel, Xiaohongshu, and more.
🎙️ Meet our speakers: www.lfopensource.cn/kubecon-cloudnativecon-openinfra-summ…
🎟️ Register: www.lfopensource.cn/kubecon-cloudnativecon-openinfra-summ… -
PyTorch reposted
Mark Collier 柯理怀
@sparkycollier
Can’t wait to kick off PyTorch Conference North America keynotes on October 20th in San Jose!
Keynote line up: events.linuxfoundation.org/pytorch-conference-north-ameri…
Register: events.linuxfoundation.org/pytorch-conference-north-ameri…
#pytorchconThis media couldn't be displayed. See it on the original post. -
PyTorch reposted
vLLM
@vllm_project
vLLM Conference is next week, and we have a packed schedule 🎊 📅. Here's the full list of events you should know:
Mon:
🔷 4–6PM vLLM × Ray × Google Cloud Happy Hour: rsvp.withgoogle.com/events/ray-summit-x-google-cloud-happ…
🔷 6–9PM vLLM × Dynamo Meetup: luma.com/r8o604o0
Tue:
🔷 11–11:30AM vLLM Keynote from @simon_mo_
🔷 12–5PM vLLM Track Day 1
🔷 6–9PM vLLM × AMD Happy Hour: luma.com/6nb8coax
Wed:
🔷 12–5PM vLLM Track Day 2
🔷 6–8:30PM vLLM x DigitalOcean × NVIDIA Happy Hour: luma.com/fufg0bg5
No ticket needed for the happy hours and meetups, but space is limited. To join the full event, register here: vllm.ai/events/vllm-conference/2026 -
PyTorch
@PyTorch
🌱 New to PyTorch? The Introduction Track at #pytorchcon North America covers the fundamentals, workflows, and best practices to help you build confidence and start creating.
Learn more: events.linuxfoundation.org/pytorch-conference-north-ameri…
🎟️ Register by Sept 4 & save: events.linuxfoundation.org/pytorch-conference-north-ameri… -
PyTorch
@PyTorch
The keynote lineup for PyTorch Conference North America is out, offering a clear preview of where our open source ecosystem is heading.
The program highlights four main directions: strengthening the core, expanding multi-hardware support, accelerating efficient training and inference, and building next-generation intelligent systems.
Register now to see visionary keynotes from @Meta, @RedHat, @Google, @cohere, @AgenticAIFdn, @adaption_ai, @nvidia, @Qualcomm, @inferact, @coreauto, @CrusoeAI and @AWS.
Learn more about our keynote speakers here: events.linuxfoundation.org/pytorch-conference-north-ameri…
Register here: events.linuxfoundation.org/pytorch-conference-north-ameri… -
PyTorch
@PyTorch
"The PyTorch Conference is really unique in bringing together users, practitioners and developers across the AI spectrum in a way that really no other event does." Niles Burbank @AMD (PyTorch Conference Europe 2026)
The open-source AI community is gathering in San Jose! Join us October 20–21 for PyTorch Conference North America 2026 for two days packed with technical sessions, hands-on workshops, and deep dives covering every layer of the AI stack.
Register by September 4 to save $200 and secure your pass: events.linuxfoundation.org/pytorch-conference-north-ameri…
#pytorchcon -
PyTorch
@PyTorch
PyTorch Conference North America 2026 lets contributors hear directly from users about the technical problems they're encountering and connect that feedback to ongoing work in PyTorch.
In this clip from #pytorchcon NA 2025, Tristan Rice @rice_fry (@Meta) describes how conversations with users helped him see that work in areas like fault tolerance and communication was paying off.
#pytorchcon North America returns October 20–21, 2026, in San Jose.
Register by September 4 to save $200 and secure your pass: events.linuxfoundation.org/pytorch-conference-north-ameri… -
PyTorch
@PyTorch
☁️ Keynote Speaker Spotlight
Learn from Bill Jia, VP of Engineering, Core ML/AI at @googlecloud, how #pytorch makes it easier to run AI models on different types of AI hardware, including Google's TPUs, without rewriting your code.
📅 October 20-21
📍 San Jose, CA
Schedule: events.linuxfoundation.org/pytorch-conference-north-ameri…
Register: events.linuxfoundation.org/pytorch-conference-north-ameri… -
PyTorch
@PyTorch
Leverage a PyTorch-native fine-tuning library with Day-0 Hugging Face checkpoint support for the recently released Alibaba open weights for Qwen3.8-2.4T-A95B (Qwen3.8-Max), its largest open-weight model.
Developers can post-train the model for domain-specific use cases with configurable reasoning using PyTorch-native tools and NVIDIA NeMo AutoModel. Train directly on existing checkpoints without model conversion, with support for full SFT or memory-efficient LoRA fine-tuning.
Read the full post: developer.nvidia.com/blog/serve-qwen3-8-2-4t-a95b-a-2-4t-… -
PyTorch
@PyTorch
🚨 New keynote speaker announced!
We're excited to welcome @simon_mo_, Co-Founder & CEO of @inferact, to the keynote stage at #pytorchcon North America.
Join us October 20-21 in San Jose, CA to hear Simon's perspective on the future of open source AI and the #pytorch ecosystem.
Register by September 4 to save:
events.linuxfoundation.org/pytorch-conference-north-ameri… -
PyTorch
@PyTorch
🎤 #pytorchcon North America Keynote Speaker Announced!
Join @jpineau1, Chief AI Officer at @cohere, as she shares perspectives on advancing AI through open research, collaboration, & innovation.
📅 October 20-21
📍 San Jose, CA
Schedule: events.linuxfoundation.org/pytorch-conference-north-ameri…
Register: events.linuxfoundation.org/pytorch-conference-north-ameri… -
PyTorch
@PyTorch
💡 Keynote Speaker Spotlight
@ezyang joins the keynote lineup at #pytorchcon North America to share insights from the evolution of #pytorch & what's next for the framework.
📅 October 20-21
📍 San Jose, CA
Learn more: events.linuxfoundation.org/pytorch-conference-north-ameri…
Schedule: events.linuxfoundation.org/pytorch-conference-north-ameri…
Register: events.linuxfoundation.org/pytorch-conference-north-ameri… -
PyTorch
@PyTorch
New model architectures arrive weekly, but software compilation stacks often lag behind. Bringing up new hardware accelerators traditionally takes months of specialist work.
In our latest technical blog, the IBM Spyre team demonstrates how AI coding agents can bridge this gap by writing runtime adapters. By patching unsupported operations and resolving memory alignment constraints, HF-adapters connected stock HuggingFace Transformers directly to PyTorch via torch-spyre.
Key results include 13 AI-written adapters successfully enabling 7,960 of the top 10,000 HuggingFace embedding models, and 6,804 models passing complete end-to-end device tests on the IBM Spyre accelerator.
Read the full technical deep dive here 👉 pytorch.org/blog/harnessing-ai-for-day-one-model-enablement/
@IBMResearch -
PyTorch
@PyTorch
✨ Keynote Speaker Announced
@sarahookr, CEO & Co-Founder of @adaption_ai, joins #pytorchcon North America to discuss the future of #ai & open innovation.
📅 October 20-21
📍 San Jose, CA
Schedule: events.linuxfoundation.org/pytorch-conference-north-ameri…
Register: events.linuxfoundation.org/pytorch-conference-north-ameri… -
PyTorch
@PyTorch
“I think something that's really special about the PyTorch community is that it brings together everyone to actually chat, to discuss, and to share kind of our different learnings to move the field forward.”
@realSharonZhou (@AMD), shared that perspective at PyTorch Conference North America 2025.
#pytorchcon North America returns to San Jose on October 20–21, 2026, with technical sessions and opportunities to connect with contributors and practitioners across the PyTorch ecosystem.
Register by September 4 to save $200 and secure your pass: events.linuxfoundation.org/pytorch-conference-north-ameri… -
PyTorch
@PyTorch
The posters are live for #pytorchcon North America! From compiler optimization & CUDA Graphs to AI architectures, RL, & community innovation, explore the latest research & meet the presenters behind it.
📍 San Jose, CA
📅 October 20-21
🖼️ Posters: events.linuxfoundation.org/pytorch-conference-north-ameri…
📅 Full schedule: events.linuxfoundation.org/pytorch-conference-north-ameri…
🎟️ Register by Sept 4 to save $200: events.linuxfoundation.org/pytorch-conference-north-ameri… -
PyTorch
@PyTorch
🎉Ant Group has joined the PyTorch Foundation as a Gold Member. Through @TheInclusionAI, Ant Group works on open models, infrastructure and agent technologies that make AI easier to build and use. It also helped launch and continues to invest in AReaL @AReaL_AI, a PyTorch Ecosystem Landscape project. Welcome, @ant_oss! #pytorch #opensourceai #inclusiveagi
-
PyTorch reposted
RadixArk
@radixark
Today we're launching Miles v0.1, an open-source RL framework for LLMs and multimodal models.
RL training is easy to start and hard to debug. Miles helps you ensure your run is correct, use hardware efficiently, and keep RL running at scale.
Over the past 9 months, 72 contributors have landed 1,326 commits, 85 GPU E2E CI tests, battle-testing Miles on frontier open models like Kimi K3, DeepSeek V4, Qwen 3.8, GLM 5.2, Inkling, MiniMax H3, etc.
Miles powers frontier-model development and production RL workloads at @humansand, @periodiclabs, @modal, @DecagonAI, @Eigent_AI, @nebiusai, @IBM and more, on both @NVIDIAAI and @AIatAMD hardware.
Here is what we built, and why teams picked Miles🧵 -
PyTorch
@PyTorch
Your conference experience can go even further.
Alongside #kubecon + #cloudnativecon + #openinfrasummit + #pytorchcon China, Sept 7-9 in Shanghai, explore two co-located events:
✨ #agntcon + #mcpcon China (Sept 6-7): Separate registration required.
www.lfopensource.cn/kubecon-cloudnativecon-openinfra-summ…
✨ OSPOlogy + #osposummit China: Add it to your KubeCon + CloudNativeCon + OpenInfra Summit + PyTorch Conference registration.
www.lfopensource.cn/kubecon-cloudnativecon-openinfra-summ…
Register + join us: www.lfopensource.cn/kubecon-cloudnativecon-openinfra-summ… -
PyTorch reposted
Dawn Song
@dawnsongtweets
🚀 The future of AI is agentic — this is one message echoed across every stage at the Agentic AI Summit 2026 (Aug 1 & 2), the largest gathering dedicated to agentic AI:
🏛️ ~5,000 attendees in person at UC Berkeley
🌍 ~100,000 joined online from around the world
🎤 ~200 world-class speakers plus ~200 poster presentations, from frontier AI researchers and visionary founders to leaders and pioneers across academia and industry.
💡 Here are just a few glimpses into the ideas that shaped the conversations at the summit:
💬 "The text box is AI's radio-on-TV phase…. Every new medium starts by imitating the old one."
— Peter Steinberger @steipete, Creator of OpenClaw, OpenAI
💬 "AI infrastructure isn't a chip problem. It isn't a model problem. It's a systems problem."
— Peter DeSantis, SVP, Foundational AI Models, Custom Silicon, Quantum Computing, Amazon
💬 "There will be no AI job apocalypse... we just can't find enough skilled AI engineers."
— Andrew Ng @AndrewYNg, Founder, DeepLearning .AI
💬 "Coding capabilities and cyber capabilities are two sides of the same coin—you cannot make models better at coding without also making them better at cyber."
— Dawn Song, Professor, UC Berkeley; Co-Director, Berkeley RDI; VP of AI Research, Meta Superintelligence Labs
💬 "'Curfew' comes from the French word for extinguishing fire. Medieval cities tried to restrict fire, yet London still burned. AI resilience won't come from one breakthrough. There's no silver bullet for AI safety—only an ecosystem."
— Wojciech Zaremba, Co-Founder, OpenAI
💬 "This is the biggest scientific bet our civilization has ever made—bigger than the Apollo program, the internet buildout, and the Manhattan Project combined."
— Jasjeet Sekhon, Chief Strategy Officer, Google DeepMind
💬 "Our generation was too late to explore the Earth, too early to explore the stars—but right on time to build superintelligence."
— Richard Socher, Founder/CEO, Recursive Superintelligence
💬 "I genuinely believe the next two years will be the time of architecture—the biggest gains will come from stepping away from transformers."
— Jerry Tworek, CEO, Core Automation; Former VP of Research at OpenAI
💬 "Recursive Self-Improvement isn't one capability. It's four: Ideation, Implementation, Experimentation and Evaluation.."
— Oriol Vinyals @OriolVinyalsML, Former VP of Research, Google DeepMind; Co-Founder, Discovery Loop
💬 "We are in a capability overhang—models are far more capable than they're able to side-effect into the world today."
— Ryan Lopopolo, Principal Engineer, Agentic Google Cloud Platform; Previously Led Dark Factory at OpenAI
💬 "Stop thinking about evaluation as the last check before shipping—think of it as an engine that helps you ship a better agent every single day."
— Michele Catasta, President and Head of AI, Replit
💬 "The bottleneck becomes your attention as an agent-using engineer. … We're moving from seeing the code to seeing the entire business."
— Alex Graveley, Co-Founder of FlyingObject .ai; Co-creator, GitHub Copilot & Perplexity Computer
💬 "An agent isn't just an LLM — it's an LLM surrounded by what I call infrastructure... another word for that is computer science."
— Jonathan Cohen, VP of Applied Research, Nvidia; Academy Scientific and Technical Award Winner
💬 "We don't arbitrate the truth. We give people the most powerful tools to make up their own minds."
— Chris Bregler, Senior Director / Distinguished Scientist, Google DeepMind; Academy Scientific and Technical Award Winner
💬 “Thinking doesn’t have to be in text! ... We can even use multiple modalities simultaneously to “think” at the right level of abstraction for the problem at hand”
— Sergey Levine, Co-Founder, Physical Intelligence; Professor, UC Berkeley
💬 “Video is the most general modality that we have that allows us to simulate real-world experience."
— Anastasis Germanidis, Co-Founder/Co-CEO, Runway
💬 “The relationship between AI and enterprise data is not one-directional. Understanding both sides of that equation is the difference between AI that works and AI that disappoints.”
— Dan Roth, Chief AI Scientist, Oracle; Professor, UPenn
💬 "Maybe 99.9% of training data in the next step will be synthetic."
— Weizhu Chen, Technical Fellow & CVP, Microsoft AI
💬 "It's maybe the best time ever to start a company—but most 'obvious' AI products will be outcompeted by the frontier labs. The real opportunities lie in solving specific customer problems."
— Alfred Lin, General Partner, Sequoia Capital
✨Over two days, we explored one central question:
How do we build AI systems that are not only more capable, but also more trustworthy, more secure, and ultimately more beneficial for humanity?
This wasn't the end of a conference - it was the beginning of the next chapter for agentic AI.
Join us to shape and steward the future of AI for human flourishing!
🙏 A heartfelt thank you to our speakers, sponsors, volunteers, partners, and every attendee (in-person or online) who made this summit possible.
👇 What are your learnings, insights, favourite talk, quote, or moment from the summit? We'd love to hear it below! -
PyTorch
@PyTorch
⚡ Speed matters. The Inference Track at #pytorchcon North America, Oct 20-21 in San Jose, covers techniques, libraries, & deployment strategies that help you serve #ai faster, reduce latency, & optimize performance at scale.
Learn more: events.linuxfoundation.org/pytorch-conference-north-ameri…
📅 Schedule: events.linuxfoundation.org/pytorch-conference-north-ameri…
🎟️ Register: events.linuxfoundation.org/pytorch-conference-north-ameri… -
PyTorch
@PyTorch
🚀 Keynote Speaker Announced!
Alban Desmaison of @Meta is joining the #pytorchcon North America keynote lineup to share insights into the future of #ai infrastructure & the #pytorch ecosystem.
📅 October 20-21
📍 San Jose, CA
Schedule: events.linuxfoundation.org/pytorch-conference-north-ameri…
Register: events.linuxfoundation.org/pytorch-conference-north-ameri… -
PyTorch
@PyTorch
AMD has been upstreaming optimizations for improved FP8 training support in PyTorch/TorchTitan and PyTorch/TorchAO, making FP8 training work out of the box on AMD Instinct GPUs! We trace that effort across every layer of the stack:
- Systematically fusing Triton quantization kernels to close the performance gap, collapsing multi-kernel chains into single launches
- Accelerating major kernel (grouped GEMM, attention, etc..) performance in PyTorch stack for FP8 training
Read the blog: pytorch.org/blog/fp8-training-on-amd-gpus-with-torchtitan… @AMD -
PyTorch reposted
Mark A100
@gatere_mark
My 2026 @PyTorch Foundation Flare Pin entry connects the PyTorch symbol with a San Jose-inspired bridge and skyline, representing open-source momentum and a global community building AI together.
Entrant: Mark Gatere
AI-generated with OpenAI ChatGPT.
#pytorchpin #pytorchconThis media couldn't be displayed. See it on the original post. -
PyTorch
@PyTorch
The PyTorch Certified Associate (PTCA) program offers early-stage practitioners a direct route to build credibility and demonstrate hands-on expertise in AI engineering.
As deep learning adoption expands across industries, real-world skills in model design, training, and deployment are essential. PTCA provides a clear pathway to verify your foundational capabilities and stand out in the field.
Learn more about the certification and how to enroll here 👉 pytorch.org/pytorch-certification/ -
PyTorch
@PyTorch
Find your track. Build your agenda.
#kubecon + #cloudnativecon + #openinfrasummit + #pytorchcon China heads to Shanghai September 7-9 with sessions covering #cloudnative, #ai, platform engineering, observability, security, networking, #openinfra, #pytorch, and more.
Explore the tracks: www.lfopensource.cn/kubecon-cloudnativecon-openinfra-summ…
Register: www.lfopensource.cn/kubecon-cloudnativecon-openinfra-summ… -
PyTorch
@PyTorch
There are 3 days left to enter the 2026 PyTorch Foundation Flare Pin Community Design Contest.
The winner will receive one complimentary ticket to PyTorch Conference North America in San Jose, and the winning design will become the official conference pin.
Need help developing your concept? Our blog includes an optional AI design prompt to help turn your idea into a pin design. AI-assisted and AI-generated entries are permitted.
Submit by August 14, 2026, at 11:59 p.m. PT using #pytorchpin and #pytorchcon.
🔗 Review the requirements and use the optional AI design prompt: pytorch.org/blog/pytorch-foundation-flare-pin-community-d… -
PyTorch
@PyTorch
🎙️ Keynote Speaker Spotlight
@marksaroufim, Co-founder of @coreauto, is joining the keynote stage at #pytorchcon North America.
Don't miss his perspective on the future of #ai development with #pytorch.
📅 October 20-21
📍 San Jose, CA
Learn more: events.linuxfoundation.org/pytorch-conference-north-ameri…
Schedule: events.linuxfoundation.org/pytorch-conference-north-ameri…
Register: events.linuxfoundation.org/pytorch-conference-north-ameri… -
PyTorch
@PyTorch
🔥 Want to know what's next for #pytorch? The Core PyTorch Track at #pytorchcon North America explores framework updates, APIs, architecture, and the innovations driving the ecosystem forward.
📅 October 20-21
📍 San Jose, CA
Learn more: events.linuxfoundation.org/pytorch-conference-north-ameri…
📅 Schedule: events.linuxfoundation.org/pytorch-conference-north-ameri…
🎟️ Register: events.linuxfoundation.org/pytorch-conference-north-ameri… -
PyTorch
@PyTorch
1️⃣ trip. 3️⃣ incredible events.
When you register for #kubecon + #cloudnativecon + #openinfrasummit + #pytorchcon China, September 7-9 in Shanghai, you can expand your experience with co-located events:
🤖 AGNTCon + MCPCon China (Sept. 6-7): www.lfopensource.cn/kubecon-cloudnativecon-openinfra-summ…
🌐 OSPOlogy + OSPO Summit China (Sept. 7): www.lfopensource.cn/kubecon-cloudnativecon-openinfra-summ…
Register: www.lfopensource.cn/kubecon-cloudnativecon-openinfra-summ… -
PyTorch
@PyTorch
Win a free ticket to PyTorch Conference North America in San Jose & see your design come to life --> Enter the 2026 Flare Pin Community Design Contest. Submit your original 1-inch enamel pin design featuring the PyTorch logo and "2026" by August 14th. AI assistance more than welcome! Post your entries here on X using #pytorchpin and #pytorchcon Good luck! ✨
-
PyTorch
@PyTorch
Today @AIatMeta introduced Muse Glimmer, an open-weight, 30-billion-parameter model distilled from Meta’s Muse Spark for on-device agentic workflows. Alongside, ExecuTorch is adding end-to-end support for running Muse Glimmer on @NVIDIA GPUs and Macs with @Apple silicon.
Why ExecuTorch? ExecuTorch offers a smarter, native approach:
⚡ Build in PyTorch: Implement your model and decoding strategies right in PyTorch as you normally would
⚡ Seamless Export: Export directly to ExecuTorch when you're ready for deployment
⚡ Automated Optimization: The framework automatically handles backend-specific lowering (Triton on CUDA, MLX-native, or Metal on Apple silicon) and uses ahead-of-time compilation to optimize the full execution path end-to-end
Learn more: pytorch.org/blog/fast-ondevice-agentic-ai-with-executorch
PyTorch
@PyTorch
You can download and start running quickly the ExecuTorch weights on @HuggingFace here: huggingface.co/meta-models/Muse-Glimmer-30B-ExecuTorch-PTE
-
PyTorch
@PyTorch
⚡ Keynote Speaker Spotlight
Mazin Gilbert, Executive Director of the @AgenticAIFdn, joins #pytorchcon North America to discuss the next wave of #opensource #ai & intelligent agent ecosystems.
📅 October 20-21
📍 San Jose, CA
Schedule: events.linuxfoundation.org/pytorch-conference-north-ameri…
Register: events.linuxfoundation.org/pytorch-conference-north-ameri… -
PyTorch
@PyTorch
🚨 Keynote Speaker Announced! Join @sparkycollier, Executive Director of the PyTorch Foundation, at #pytorchcon North America as he shares the foundation's vision for the future of #opensource #ai & the growing #pytorch ecosystem.
📅 October 20-21
📍 San Jose, CA
Schedule: events.linuxfoundation.org/pytorch-conference-north-ameri…
Register: events.linuxfoundation.org/pytorch-conference-north-ameri… -
PyTorch
@PyTorch
Every gain in pre-training efficiency means researchers can train larger models, run more experiments, and reach frontier capability faster on the same infrastructure.
TorchTitan, PyTorch’s native training stack, leverages @NVIDIA contributions to continuously improve its performance on GB300 NVL72. These optimizations compound to deliver approximately 6x higher delivered performance on the same infrastructure, setting a record for pre-training DeepSeek-V3 671B at 1,648 TFLOPs per GPU.
Read the full post:
developer.nvidia.com/blog/setting-a-world-record-for-moe-… -
PyTorch
@PyTorch
The PyTorch Conference North America 2026 keynote lineup features the architects of modern AI and pioneers driving the PyTorch ecosystem forward.
@sparkycollier (PyTorch Foundation), Mazin Gilbert (@AgenticAIFdn), Edward Yang and @albanDesmaison (@Meta), Simon Mo (@inferact @vllm_project), Bill Jia (@googlecloud), Brian Stevens (@RedHat), Ujval Kapasi (@nvidia), Joelle Pineau (@cohere), Mark Saroufim (@coreauto , and Sara Hooker (@adaption_ai) will take the keynote stage in San Jose on October 20–21.
Our two-day conference offers technical sessions, community collaboration, and a look into the latest innovations across the PyTorch ecosystem.
Submit an original 2026 PyTorch Foundation flare pin design by August 14 for a chance to receive one complimentary ticket to PyTorch Conference North America! #pytorchpin #pytorchcon
🔗 Keynotes and more: pytorch.org/blog/pytorch-conference-north-america-announc… -
PyTorch
@PyTorch
UCSC OSPO and @RedHat hosted their inaugaral Santa Cruz PyTorch Meetup!
Check out their origin story, the content of their first event, and why you should start your own community PyTorch Meetup 👉 pytorch.org/blog/pytorch-by-the-sea-the-inaugural-santa-c… -
PyTorch
@PyTorch
Show your creativity beyond code by designing the 2026 PyTorch Foundation flare pin #pytorchpin. The winning design will become the conference pin in San Jose this October, and the winner will receive one complimentary ticket.
Use the AI design prompt in our blog to explore your visual direction and turn your idea into a single design.
Choose the shape, imagery, typeface, and color palette that fit your concept. Include “26” or “2026” and the official PyTorch Foundation symbol.
Post your entry on LinkedIn, X, Facebook, or Bluesky by August 14, 2026, at 11:59 p.m. PT using #pytorchpin and #pytorchcon.
🔗 Review the guidelines and use the AI prompt: pytorch.org/blog/pytorch-foundation-flare-pin-community-d… -
PyTorch
@PyTorch
🚀 Build what's next with the communities shaping #cloudnative, open infrastructure, & #opensource AI.
Join us September 7-9 in Shanghai for #kubecon + #cloudnativecon + #openinfrasummit + #pytorchcon China. Connect with maintainers, developers, architects, & #ai innovators driving the future of open source.
🎟️ Register: www.lfopensource.cn/kubecon-cloudnativecon-openinfra-summ…
📅 Explore the schedule: www.lfopensource.cn/kubecon-cloudnativecon-openinfra-summ… -
PyTorch reposted
vLLM
@vllm_project
The vLLM Conference is coming up in 3 weeks! 🎉
Come learn about the current state and future of AI inference, Aug 24–26 in San Francisco 🌉, hosted by @inferact at @anyscalecompute Ray Summit.
We'll have speakers from Inferact, NVIDIA, AMD, Google TPU, Anyscale, PyTorch, Meta, Red Hat, and key builders around vLLM. The talks on the roadmap deep dive into the latest on accelerators, training and serving pipelines, and production-scale inference 🚀 -
PyTorch reposted
PyTorch
@PyTorch
The 2026 PyTorch Foundation Flare Pin Community Design Contest gives you the chance to create the conference pin for PyTorch Conference North America and win one complimentary ticket to the event in San Jose.
Need help turning an idea into a design? Use our AI design prompt to develop your concept and generate a single design.
Create an original design with “26” or “2026” and the official PyTorch Foundation symbol, then post it on LinkedIn, X, Facebook, or Bluesky by August 14, 2026, at 11:59 p.m. PT using #pytorchpin and #pytorchcon.
🔗 Review the requirements and try the prompt: pytorch.org/blog/pytorch-foundation-flare-pin-community-d… -
PyTorch
@PyTorch
In this post, you’ll learn how to use the PyTorch Torch Inductor compiler and kernel fusion to improve memory bandwidth and reduce kernel launch overhead.
A common bottleneck when writing GPU code is that GPU compute is so fast that even high-bandwidth device memory doesn’t use the GPU kernel fully. Kernel fusion addresses this by combining multiple GPU operations into a single device kernel, so intermediate results don’t need to round-trip through global memory or require separate kernel launches.
We can describe a computation in plain Python and let the compiler generate the kernel. That is what torch.compile does. You give it a function, it traces what the tensors are doing, and Torch Inductor, PyTorch’s compiler, generates a kernel that runs on the GPU.
Read the full post: developer.nvidia.com/blog/kernel-fusion-in-nvidia-cuda-op… -
PyTorch
@PyTorch
Alpamayo 2 Super is available on Hugging Face under OpenMDW‑1.1, the @linuxfoundation's permissive license for open AI model distributions. The license covers fine‑tuning, derivative models and commercial redistribution, allowing AV developers, automakers, truckmakers and suppliers to adapt Alpamayo to their own data, driving policies and deployment strategies.
Jensen Huang
@JensenHuang
Today, we’re launching Alpamayo 2 Super, our frontier open reasoning model for autonomous vehicles.
Beyond seeing, Alpamayo understands and reasons through the complex world - thinks before it acts.
It’s a powerful backbone for robotaxis, trucks, shuttles, delivery vans, tractors and the long tail of mobile robots—billions of autonomous machines someday.
We’re releasing it for commercial use under OpenMDW-1.1 so teams can inspect it, fine-tune it and deploy it—open models advance safety and security.
The next wave of AI is robotics—and it starts with autonomous vehicles.
Great work, Alpamayo team!
blogs.nvidia.com/blog/alpamayo-2-super-open-model-now-ava… -
PyTorch
@PyTorch
🚢 Build #ai that ships.
The Applications Track at #pytorchcon, Oct 20-21 in San Jose, showcases how developers are using #pytorch across LLMs, multimodal AI, robotics, scientific computing, & production deployments.
Learn more: events.linuxfoundation.org/pytorch-conference-north-ameri…
📅 Schedule: events.linuxfoundation.org/pytorch-conference-north-ameri…
🎟️ Register: events.linuxfoundation.org/pytorch-conference-north-ameri… -
PyTorch
@PyTorch
The 2026 PyTorch Foundation Flare Pin Community Design Contest gives you the chance to create the conference pin for PyTorch Conference North America and win one complimentary ticket to the event in San Jose.
Need help turning an idea into a design? Use our AI design prompt to develop your concept and generate a single design.
Create an original design with “26” or “2026” and the official PyTorch Foundation symbol, then post it on LinkedIn, X, Facebook, or Bluesky by August 14, 2026, at 11:59 p.m. PT using #pytorchpin and #pytorchcon.
🔗 Review the requirements and try the prompt: pytorch.org/blog/pytorch-foundation-flare-pin-community-d… -
PyTorch
@PyTorch
PyTorch 2.13 brings FlexAttention to Apple Silicon, cuts peak memory by up to 4× for large-vocabulary models with nn.LinearCrossEntropyLoss, and updates distributed training, compilation, profiling, and on-device inference.
Our live Q&A examined CUDA version support, CuTeDSL in TorchInductor, Python 3.15, ExecuTorch, torch.compile, and plans for PyTorch 2.14.
Andrey Talman (@Meta), @albanDesmaison (@Meta), and Piotr Bialecki (@NVIDIA) joined moderator Chris Gottbrath (Gottbrath Technologies).
This clip explains how FlexAttention compiles kernels specialized for the requested masking pattern, allowing them to skip unnecessary computation. It also covers speedups of up to approximately 12× over SDPA in tested sparse configurations and a deterministic backward path on CUDA that removes one source of nondeterminism in gradient computation.
🔗 Watch the full PyTorch 2.13 Release Live Q&A: www.youtube.com/live/vbdduGRTQC0 -
PyTorch
@PyTorch
Congratulations to SMG on graduating from @lightseekorg and moving to an independent home. As part of the PyTorch ecosystem, SMG will continue working with maintainers from @vllm_project and TokenSpeed on shared frontend and gateway infrastructure for LLM inference.
LightSeek Foundation
@lightseekorg
Today SMG (Shepherd Model Gateway), an engine-agnostic gateway for LLM inference, has officially graduated from LightSeek Foundation and moves to a new independent home:
github.com/smg-project/smg
SMG was the first project incubated by the LightSeek Foundation and was recently accepted into the @PyTorch Ecosystem. It has now reached the point where its next stage should be driven by the broader open-source community.
Why now?
Over the past few months — supporting Day 0 launches for leading open models and maintaining inference engines day to day — it became clear how much of the frontend and gateway layer is genuinely shared across engines. Some of those shared components are already running in production today, and maintainers from TokenSpeed and @vllm_project will keep building them with SMG. Rather than every project maintaining these pieces independently, they're better built once, together.
Model provider protocols have also kept evolving beyond the traditional OpenAI-compatible API, which makes this a good moment to revisit SMG's architecture for the next generation of model interfaces.
Fundamentally this move is about governance. SMG is built by contributors across several companies and inference projects, and it should stay that way: community-driven, maintained across the ecosystem, owned by a broader open-source community. Shared infrastructure makes everyone stronger.
Whether you maintain an inference engine, serve models at scale, or care about where AI serving infrastructure goes next, there's room for you here. -
PyTorch reposted
vLLM
@vllm_project
It's been a pleasure collaborating with the team to co-maintain standalone components, like the multimodal processors powering vLLM's Rust frontend, that can be standardized and shared across open source projects.
We're excited for more collaborations ahead!
LightSeek Foundation
@lightseekorg
Today SMG (Shepherd Model Gateway), an engine-agnostic gateway for LLM inference, has officially graduated from LightSeek Foundation and moves to a new independent home:
github.com/smg-project/smg
SMG was the first project incubated by the LightSeek Foundation and was recently accepted into the @PyTorch Ecosystem. It has now reached the point where its next stage should be driven by the broader open-source community.
Why now?
Over the past few months — supporting Day 0 launches for leading open models and maintaining inference engines day to day — it became clear how much of the frontend and gateway layer is genuinely shared across engines. Some of those shared components are already running in production today, and maintainers from TokenSpeed and @vllm_project will keep building them with SMG. Rather than every project maintaining these pieces independently, they're better built once, together.
Model provider protocols have also kept evolving beyond the traditional OpenAI-compatible API, which makes this a good moment to revisit SMG's architecture for the next generation of model interfaces.
Fundamentally this move is about governance. SMG is built by contributors across several companies and inference projects, and it should stay that way: community-driven, maintained across the ecosystem, owned by a broader open-source community. Shared infrastructure makes everyone stronger.
Whether you maintain an inference engine, serve models at scale, or care about where AI serving infrastructure goes next, there's room for you here. -
PyTorch
@PyTorch
⏰ Today is your final chance to save $400 on #pytorchcon North America, Oct 20-21 in San Jose!
Early Bird pricing ends tonight at 11:59 PM PDT.
📅 See what's on the schedule: events.linuxfoundation.org/pytorch-conference-north-ameri…
🎟️ Register now: events.linuxfoundation.org/pytorch-conference-north-ameri… -
PyTorch
@PyTorch
Great to see! Later this year, RadixArk will roll out SGL-torchtpu as an additional @radixark PyTorch-native TPU backend, featuring eager execution, @PyTorch ecosystem compatibility, and MPMD support. It will let any AI researcher or engineer in the industry run LLMs with @sgl_project on @Google's TPUs using standard PyTorch tooling, with high performance, scalability, and state-of-the-art features.
RadixArk
@radixark
RadixArk and Google Cloud are joining forces with the SGLang community to make TPU a drop-in, cost-efficient path to frontier inference.
SGL-JAX already serves the major open model families on the latest TPU generations: Gemma, Qwen, DeepSeek, GLM, Kimi, Ling, MiniMax, MiMo, Grok, plus Wan and Flux for video and image generation.
With this partnership, TPU unlocks SGLang's production feature set: 5D parallelism, Radix Cache, HiCache, quantization, speculative decoding, on TPU Pallas kernels co-built by Google, RadixArk, and the SGLang community. SGL-torchtpu opens a PyTorch-native path to all of it.
SGLang on TPU comes with the same API and the same features, so for teams already running it, getting started is simple. Going forward, TPU support for new open models will land alongside the rest, and that carries forward to each new TPU generation.
Full announcement and SGL-JAX repo 👇 -
PyTorch
@PyTorch
FBTriton is the Triton repo where Meta develops its experimental GPU optimization solutions (including TLX/torchTLX and autoWS). It has served as an optimization runway for Meta engineers and external partners, including NVIDIA, AMD, and academic collaborators, to co-design compiler and DSL innovations and make them accessible for OSS and industry’s evaluation.
In this blog, we look at continuous upstream ingestion, the L1/L2/L3 validation hierarchy, and the practical gap between engineering ideals and production realities.
Read the full blog here: pytorch.org/blog/fbtriton-infra-upstream-ingestion-hierar…..* -
PyTorch
@PyTorch
⚡ Tomorrow is your last chance to save $400 on #pytorchcon North America!
Register before Friday, July 31 at 11:59 PM PDT and join us October 20-21 in San Jose, CA.
📅 Explore the schedule: events.linuxfoundation.org/pytorch-conference-north-ameri…
🎟️ Register: events.linuxfoundation.org/pytorch-conference-north-ameri… -
PyTorch
@PyTorch
📅 The schedule is live for OSPOlogy + #osposummit China! Join the #opensource leaders, maintainers, legal experts, security professionals, & enterprise practitioners shaping the future of Open Source Program Offices on September 7 in Shanghai.
📖 Explore the schedule: www.lfopensource.cn/kubecon-cloudnativecon-openinfra-summ…
➕ Add OSPOlogy + OSPO Summit to your #kubecon + #cloudnativecon + #openinfrasummit + #pytorchcon China registration for just ¥135 through August 12: www.lfopensource.cn/kubecon-cloudnativecon-openinfra-summ… -
PyTorch
@PyTorch
🚨 Only 3 days left to save $400 on #pytorchcon North America! Join the #opensource #ai community October 20-21 in San Jose, CA for two days of technical talks, keynotes, networking, & the latest across the #pytorch ecosystem.
📅 Schedule: events.linuxfoundation.org/pytorch-conference-north-ameri…
🎟️ Register by Friday, July 31 at 11:59 PM PDT: events.linuxfoundation.org/pytorch-conference-north-ameri… -
PyTorch reposted
AMD India
@AMDIndia
Registrations are closing soon!
Get hands-on at #amdaidevday India 2026 with:
🛠️ AI Agent Development
💻 Local AI
⚡ LLM Fine-Tuning
🎥 AI Video Generation
📍 Bengaluru
📅 8 Aug 2026
@Analyticsindiam @huggingface @PyTorch @UnslothLLM @AIatAMD
Seats are filling fast.
Register now: amd.indiadevday.com -
PyTorch reposted
vLLM
@vllm_project
With Kimi K3 Day-0 on vLLM: Open Frontier Intelligence for Everyone 🚀
At 2.8 trillion parameters, Moonshot AI's Kimi K3 is one of the most powerful open-weight models ever released. Starting today, you can serve it on vLLM the moment the weights are public.
What K3 brings:
🧠 2.8T-parameter Mixture-of-Experts (16 of 896 experts active per token)
📚 1M-token context window
🛠️ Native multimodal understanding, including vision
⚡ Kimi Delta Attention: a hybrid of linear and full attention that makes million-token context affordable
Huge thank you to @Kimi_Moonshot AI for the model release and partnership, @inferact for leading the vLLM optimizations, and to our partners at @nvidia, @AMD, and the broader vLLM community.
1/6This media couldn't be displayed. See it on the original post.
Kimi.ai
@Kimi_Moonshot
Releasing the model weights and technical report of Kimi K3.
Kimi K3 is our most capable model: a 2.8T MoE model with native visual understanding and a 1M-token context window.
New model architecture: 2.5x the intelligence per unit of compute, not just more params.
Alongside Kimi K3, we're opening up more of the stack behind it — high-performance attention kernels, MoE communication library, and infrastructure for running agent environments at scale.
Model weights: huggingface.co/moonshotai/Kimi-K3
Tech report: github.com/MoonshotAI/Kimi-K3/blob/master/k3_tech_report.pdf
Tech blog: kimi.com/blog/kimi-k3 -
PyTorch reposted
LightSeek Foundation
@lightseekorg
Huge congratulations to the @vllm_project team on the Kimi K3 Day 0 release, with the DSpark speculator trained using TorchSpec! 🎉
464 TPS is an impressive achievement—the fastest open-source Kimi K3 inference we've seen so far. 🚀
Thanks for featuring TorchSpec in the release, and congratulations again on a fantastic launch! 👇
vLLM
@vllm_project
vLLM hit new peak bs=1 decode on Kimi-K3: 464 tok/s 🚀
Under a low-entropy reasoning workload, Kimi-K3 + DSpark on vLLM reaches 464 tok/s on batch size 1 with 4×4 GB300.
This benchmark is fully reproducible with public image: vllm/vllm-openai:kimi-k3 and @inferact's DSpark draft model linked in the thread.
1/3 -
PyTorch
@PyTorch
We’re launching the 2026 PyTorch Foundation Flare Pin Community Design Contest, giving you the chance to have your design featured at PyTorch Conference North America and win a free ticket.
Show your creativity beyond code with an original design for the 2026 PyTorch Foundation flare pin. The winning design will become the conference pin in San Jose this October.
Post your design on LinkedIn, X, Facebook, or Bluesky by August 14, 2026, at 11:59 p.m. PT using #pytorchpin and #pytorchcon.
🔗 Review the contest details and submit: pytorch.org/blog/pytorch-foundation-flare-pin-community-d… -
PyTorch
@PyTorch
🚨 Last Chance to Save ¥710 RMB! 🚨
Today is your final opportunity to register for #kubecon + #cloudnativecon + #openinfrasummit + #pytorchcon China, taking place September 7-9 in Shanghai, at the discounted rate.
⏰ Register by today, July 28 at 23:59 China Standard Time: www.lfopensource.cn/kubecon-cloudnativecon-openinfra-summ…
📅 Explore the schedule: www.lfopensource.cn/kubecon-cloudnativecon-openinfra-summ… -
PyTorch
@PyTorch
🚨 Final call! The Poster Session #callforproposals for #pytorchcon North America, October 20-21 in San Jose, CA, closes TODAY at 11:59 PM PDT.
Don't miss your chance to share your work with the PyTorch community: events.linuxfoundation.org/pytorch-conference-north-ameri… -
PyTorch
@PyTorch
⚠️ Poster submissions close TOMORROW, July 26!
Submit your proposal for the Poster Sessions at #pytorchcon North America, October 20-21 in San Jose, CA.
⏰ Submit by 11:59 PM PDT: events.linuxfoundation.org/pytorch-conference-north-ameri… -
PyTorch
@PyTorch
By bringing PyTorch, vLLM, DeepSpeed, Ray, Helion, and Safetensors together under a single vendor-neutral umbrella, the PyTorch Foundation provides community-governed infrastructure across the entire AI lifecycle.
This strategic expansion directly addresses key enterprise deployment challenges, including inference throughput, model safety, data privacy, and distributed scaling costs. Neutral governance ensures that core infrastructure improvements propagate across the ecosystem, giving developers and organizations open, sustainable tools without single-vendor lock-in.
Read the full analysis @TheFuturumGroup on how vendor-neutral governance and cross-project collaboration are shaping the future of open source AI here: futurumgroup.com/insights/can-pytorch-foundations-multi-p… -
PyTorch
@PyTorch
⏰ Just 1 week left to save!
Register for #pytorchcon North America, October 20-21 in San Jose, CA, by July 31 at 11:59 PM PDT & save $400.
ICYMI: The schedule is live! Explore the sessions and start planning your experience: events.linuxfoundation.org/pytorch-conference-north-ameri…
🎟️ Register: events.linuxfoundation.org/pytorch-conference-north-ameri… -
PyTorch
@PyTorch
Helion, PyTorch's domain-specific language (DSL) for custom kernels, is expanding toward hardware-heterogeneous kernel authoring.
In our latest blog post, Meta and Google collaborate to demonstrate how Helion compiles to TPU via Pallas. This integration provides developers with a familiar, unified way to write performant TPU kernels directly within the PyTorch ecosystem.
Using FlashAttention as a case study, the team walks through how the compiler autotunes over multiple code-generation strategies - selecting optimal pipelining schemes across different input shapes to maximize compute–memory overlap.
Read the full technical deep dive here 👉 pytorch.org/blog/helion-on-tpu-towards-hardware-heterogen…..* -
PyTorch
@PyTorch
PyTorch-based synthetic training data to improve Color Code Logical Error rates can be generated with a framework including the @nvidia cuQuantum library and NVIDIA cuStabilizer.
Useful quantum computers will require fault tolerant logical operations. Researchers are actively exploring many different quantum error correction (QEC) codes to enable this, improving the Logical Error Rates (LER) of Quantum Processing Units (QPUs).
This architecture enables developers to produce decoder models tailored to their specific QPU noise.
Read the full post: developer.nvidia.com/blog/nvidia-ising-decoding-cuts-colo… -
PyTorch
@PyTorch
🚨 3 days left to submit!
The Poster Session #callforproposals for #pytorchcon North America, October 20-21 in San Jose, CA, closes July 26.
Get your proposal in before time runs out: events.linuxfoundation.org/pytorch-conference-north-ameri… -
PyTorch
@PyTorch
PyTorch Foundation Executive Director @sparkycollier delivered a keynote at the opening ceremony of the GOAI World Artificial Intelligence Open Source Competition in Hangzhou.
Mark discussed trends in the global open source AI ecosystem, including China’s growing role in developing models, infrastructure, applications, and upstream core code.
He also described Hangzhou as a globally recognized hub for AI innovation, citing @alibaba_cloud, @AntGroup, Deepin, and the city’s community of cloud infrastructure and open source AI developers.
🔗 More: mp.weixin.qq.com/s/iXFpegNEP6SZqlOkqYlJ2A -
PyTorch
@PyTorch
As the officially recommended framework for the @AMD AI DevMaster Hackathon, PyTorch enables developers to build AI applications on ROCm-enabled AMD GPUs.
The fully virtual competition features three tracks: multimodal content creation tools, private AI agents and local deployment, and Physical AI for robotics simulation and application design.
Participants can compete individually or in teams of up to three for a share of the $30,000 prize pool. Eligible participants may also receive access to AMD Radeon GPU resources during the competition.
Registration is open and subject to host approval. Project submissions will be accepted through August 6.
🔗 Register and learn more: pytorch.org/event/amd-ai-devmaster-hackathon/ -
PyTorch
@PyTorch
The PyTorch Conference North America schedule is now live. October 20–21 in San Jose, developers, researchers, and practitioners will explore training and inference, compiler innovations, responsible AI, applications, and the impact of PyTorch Foundation projects including PyTorch, vLLM, DeepSpeed, Ray, Helion, and Safetensors.
Featured sessions examine observability tooling for Cudagraph workloads, accelerating, comparing, and debugging machine learning systems with TorchDynamo, and multi-node training for foundation models.
Poster CFP closes July 26 at 11:59 p.m. PDT. Early Bird conference passes are available through July 31.
🔗 View the schedule: pytorch.org/blog/pytorch-conference-north-america-schedul… -
PyTorch
@PyTorch
How do we get more useful work—not just more tokens—from every AI dollar?
TODAY at 11:50 AM at @AMD #advancingai, PyTorch Foundation CTO @matthew_d_white will explore how open source, @vllm_project and @radixark’s @sgl_project are reshaping inference economics.
In “Accelerating Open Source AI: Just Enough Intelligence,” Matt will outline a practical alternative to using frontier models for every task:
→ Decompose workflows
→ Select right-sized models
→ Route and cache intelligently
→ Escalate only when necessary
→ Measure cost per successfully completed task
The goal is better Dollar per Intelligence: more correct, business-relevant outcomes from every dollar spent, with failures, retries, and review included in the calculation.
Matt opens a series of talks in the AI Training & Inference track ahead of
@simon_mo_, co-founder and CEO of @inferact and lead contributor to vLLM, and @ying11231, co-founder and CEO of RadixArk and co-creator of SGLang.
📍 Moscone West, San Francisco
🗓 Wednesday, July 22
🕚 11:50 AM PDT
Explore the track: www.amd.com/en/corporate/events/advancing-ai/sessions-cat… -
PyTorch
@PyTorch
The PyTorch Foundation continues to grow as a multi-project home dedicated to supporting collaboration across every stage of the AI lifecycle.
We are excited to launch a new quarterly blog series where each hosted project - PyTorch, @vllm_project @DeepSpeedAI @raydistributed, Helion and Safetensors - shares its latest updates, technical progress, and roadmap. From core framework optimizations and hardware enablement to overall ecosystem health, our hosted projects achieved a lot over the past quarter.
Read the complete update to learn more 👉 pytorch.org/blog/driving-the-future-of-open-source-ai-an-…..* -
PyTorch
@PyTorch
Open Source Amplifies the Full-Stack Advantage to Power the Lowest Token Cost. PyTorch is a leading example:
Launched in 2016 with native CUDA support, PyTorch has coevolved with @nvidia's architecture, providing developers access to innovations such as Tensor Cores, Transformer Engine, and NVFP4 directly through a familiar framework.
With an open source flywheel, more developers optimize CUDA-native inference paths, more production deployments feed back into the ecosystem, and each software improvement increases delivered token output while lowering cost per token over time.
Read @nvidia's full post: blogs.nvidia.com/blog/inference-software-lowest-token-cost/ -
PyTorch
@PyTorch
🚀 The schedule is live!
See what's happening at #pytorchcon North America, October 20-21 in San Jose, CA.
From training & inference to compiler innovations, responsible AI, applications, & the growing #pytorch ecosystem, explore the sessions shaping the future of #opensource #ai.
📅 Schedule: events.linuxfoundation.org/pytorch-conference-north-ameri…
🎟️ Register by July 31 & save $400: events.linuxfoundation.org/pytorch-conference-north-ameri… -
PyTorch
@PyTorch
Tomorrow, July 22, at 11 a.m. PT, PyTorch maintainers and contributors will provide an overview of PyTorch 2.13 and answer questions from the community live.
The Q&A will feature @albanDesmaison and Andrey Talman (@Meta), Piotr Bialecki (@NVIDIA), and moderator Chris Gottbrath.
Topics will include FlexAttention, the CuTeDSL “Native DSL” backend for Inductor, nn.LinearCrossEntropyLoss, torchcomms, FSDP2 communication overlap improvements, Python 3.15 wheels for Linux, including free-threaded 3.15t builds, and expanded ROCm, Arm, and Intel XPU platform support.
PyTorch 2.13 includes 3,328 commits from 526 contributors since PyTorch 2.12.
Register for the live Q&A: pytorch.org/event/pytorch-2-13-release-live-qa/ -
PyTorch
@PyTorch
How do we get more useful work—not just more tokens—from every AI dollar? This Wednesday at 11:50 AM at @AMD #advancingai, PyTorch Foundation CTO @matthew_d_white will explore how open source, @vllm_project and @radixark’s @sgl_project are reshaping inference economics.
In “Accelerating Open Source AI: Just Enough Intelligence,” Matt will outline a practical alternative to using frontier models for every task:
→ Decompose workflows
→ Select right-sized models
→ Route and cache intelligently
→ Escalate only when necessary
→ Measure cost per successfully completed task
The goal is better Dollar per Intelligence: more correct, business-relevant outcomes from every dollar spent, with failures, retries, and review included in the calculation.
Matt opens a series of talks in the AI Training & Inference track ahead of @simon_mo_, co-founder and CEO of @inferact and lead contributor to vLLM, and @ying11231, co-founder and CEO of RadixArk and co-creator of SGLang.
📍 Moscone West, San Francisco
🗓 Wednesday, July 22
🕚 11:50 AM PDT
Explore the track: www.amd.com/en/corporate/events/advancing-ai/sessions-cat… -
PyTorch reposted
Mark Collier 柯理怀
@sparkycollier
Fun fireside chat at WAIC today with Dr. Feifei Li, CTO and President of @AlibabaGroup Cloud about how critical open source is for the agent era especially @PyTorch @vllm_project @sgl_project for training inference and agents
-
PyTorch reposted
AI at AMD
@AIatAMD
Registration Is Open for the AMD AI DevMaster Hackathon!
Join the global online competition for developers, researchers, students, AI practitioners, and open-source contributors. Build innovative AI applications accelerated by AMD Radeon™ GPUs and the ROCm™ software stack and compete for a share of the $30,000 USD prize pool.
Why Join?
$30,000 USD in prizes
Free AMD Radeon™ GPU access for eligible participants
Three innovation tracks: Agentic AI, Multimodal AI, and Physical AI
Compete solo or in teams of up to three
Bring your ideas to life, showcase what you can build with AMD and compete with innovators from around the world.
Register today and start building. luma.com/amd-4dhi -
PyTorch
@PyTorch
⏰ 1 week left!
The Poster Session #callforproposals for #pytorchcon North America, October 20-21 in San Jose, CA, closes July 26.
Don't miss your opportunity to present your work to the #pytorch community: events.linuxfoundation.org/pytorch-conference-north-ameri… -
PyTorch
@PyTorch
PyTorch 2.13 introduces updates across attention, compilation, distributed training, memory efficiency, Python support, and accelerator platforms.
Next Wednesday, July 22, at 11 am, PyTorch maintainers and contributors will provide a brief overview of the release and answer questions from the community live.
Our Q&A will feature @albanDesmaison (@Meta), Andrey Talman (@Meta), Piotr Bialecki (@NVIDIA), and Chris Gottbrath for a live 2.13 Q&A.
Topics will include FlexAttention, the CuTeDSL “Native DSL” backend for Inductor, nn.LinearCrossEntropyLoss, torchcomms, FSDP2 communication overlap improvements, Python 3.15 wheels for Linux, including free-threaded 3.15t builds, and expanded ROCm, Arm, and Intel XPU platform support.
PyTorch 2.13 includes 3,328 commits from 526 contributors since PyTorch 2.12.
🔗 Register for the live Q&A: pytorch.org/event/pytorch-2-13-release-live-qa/ -
PyTorch
@PyTorch
The PyTorch Certified Associate program is designed to help early-stage practitioners build instant credibility and validate their real-world skills in AI and machine learning.
As deep learning and AI adoption accelerate across industries, the demand for hands-on, practical engineering skills is higher than ever. Becoming a PyTorch Certified Associate (PTCA) provides a clear pathway to demonstrate your foundational ability to design, train, and deploy machine learning models in real-world environments.
Learn more about the program and how to enroll here: pytorch.org/pytorch-certification/..*🔥 -
PyTorch
@PyTorch
This week in Shanghai, PyTorch Foundation Executive Director @sparkycollier and PyTorch Foundation CTO @matthew_d_white will speak across three forums at World Artificial Intelligence Conference 2026.
On July 18, Mark will participate in @alibaba_cloud's “Agentic Cloud: The Infrastructure for the Agent Era” forum (Silver Hall C+D, Layer G, Shanghai World Expo Center), when Mark will participate in the 11:40 dialog “Build trusted agents at scale with Agentic Cloud” with Ali AI Group CTO Feifei Li.
On July 19, Mark and Matt will deliver keynote talks at BAAI’s Open Compute for AI and AI Agent Ecosystem Forum (Room 618, Shanghai World Expo Center). Their sessions will address how open source is rewiring the future of AI and technical autonomy across hardware architectures, supply chains, and agentic systems.
Later that day, Mark and Matt will deliver keynote talks at @AntGroup's Making large models accessible: AGI Infrastructure Forum (Room 518, Shanghai World Expo Center). Mark will present “The Open Acceleration: How Open Source is Rewiring the Future of AI” at 14:05, followed by Matt’s “Just Enough Intelligence: Why the Key to Widespread Adoption of Intelligence is Optimization Engineering” at 14:20.
Mark and Matt will then participate in the 14:35 dialogue “Open Foundations, Inclusive Futures: Collaborative Infrastructure for Accessible AGI” with Ant Group CTO Zhengyu He.
📸 Check out Mark exploring the conference and speaking with CCTV during an on-site interview. Stay tuned for more from Shanghai. -
PyTorch
@PyTorch
LightSeek (@lightseekorg) TokenSpeed brings Day-0 optimized FP4 inference support for Thinking Machines Lab’s Inkling across @NVIDIA and @AMD accelerators. TokenSpeed is built on PyTorch-based infrastructure and collaborates with @vllm_project to advance high-performance, reusable inference kernels for the open source AI ecosystem.
LightSeek Foundation
@lightseekorg
Thinking Machines Lab released Inkling today.
We're excited to partner with Thinking Machines Lab to bring Day-0 support for Inkling to TokenSpeed.
✅NVIDIA (G)B200/(G)B300 (NVFP4)
✅AMD MI350X/MI355X (MXFP4)
✅Native FP4 serving
✅Unified kernel architecture
✅MTP + optimized attention + heterogeneous KV cache
✅355 tok/s/user on 4×B200 with MTP
Blog 👇
lightseek.org/blog/tokenspeed-inkling.html -
PyTorch
@PyTorch
The PyTorch-Triton 3.7 release introduces the Triton Plugin Extensions system, a framework for dynamically loading custom compiler passes, dialect ops, and DSL extensions into upstream Triton at runtime, without forking or recompiling.
Read the technical deep dive and how to get started here 👉 pytorch.org/blog/triton-plugin-extensions-enabling-tlx-an… -
PyTorch
@PyTorch
🧠 #ai research meets community discussion. Present your work during the Poster Sessions at #pytorchcon North America, October 20-21 in San Jose, CA.
Poster #callforproposals closes July 26. Submit now: events.linuxfoundation.org/pytorch-conference-north-ameri… -
PyTorch
@PyTorch
#opensource is powering the #ai era. Be part of the conversations driving it forward.
Join #kubecon + #cloudnativecon + #openinfrasummit + #pytorchcon China, September 7-9 in Shanghai, and save ¥710 RMB when you register by July 28.
🔗 www.lfopensource.cn/kubecon-cloudnativecon-openinfra-summ… -
PyTorch
@PyTorch
PyTorch-authored generative AI pipelines can move into optimized multi-device inference workflows with NVIDIA TensorRT.
The NVIDIA Developer blog details how pipelines first authored in PyTorch can be converted with Torch-TensorRT into TensorRT engines for C++ production deployment.
The post also covers TensorRT 11.0 multi-device inference support, NCCL-backed distributed collectives, and context parallelism strategies for media generation workloads with long-sequence attention.
Read the full post: developer.nvidia.com/blog/scaling-ai-inference-across-mul… -
PyTorch
@PyTorch
Only four days left to submit nominations for the 2026 PyTorch Foundation Contributor Awards🔥
These awards celebrate outstanding impact across PyTorch Foundation hosted projects, including PyTorch, vLLM, DeepSpeed, Ray, Helion, and Safetensors.
We want to recognize the individuals who help move our ecosystem forward - whether it be through code development, documentation improvements, mentorship or community leadership.
Submit your nomination by July 17 👉 pytorch.org/contributor-awards/ -
PyTorch
@PyTorch
From core framework development to production #ai, #pytorchcon North America brings together the people building what's next.
📍 October 20-21 | San Jose, CA
⏰ Register by July 31 & save $400: events.linuxfoundation.org/pytorch-conference-north-ameri… -
PyTorch
@PyTorch
🚨 #cfp CLOSES TODAY 🚨
The deadline to speak at OSPOlogy + #osposummit China is tonight at 11:59 PM CST.
Join #opensource leaders, practitioners, & community builders in Shanghai on September 7.
Submit before time runs out: www.lfopensource.cn/kubecon-cloudnativecon-openinfra-summ… -
PyTorch
@PyTorch
⚡ Last call!
The OSPOlogy + #osposummit China #cfp closes tomorrow at 11:59 PM CST.
This is your chance to take the stage on September 7 in Shanghai & share your #opensource program office expertise.
Submit now: www.lfopensource.cn/kubecon-cloudnativecon-openinfra-summ… -
PyTorch
@PyTorch
pytorch.org/blog/towards-free-normalization-fusing-normal…..*
PyTorch
@PyTorch
Normalization layers often introduce memory-bound bottlenecks in large language models and recommendation systems due to unique hardware tiling requirements. To address this, Meta has been working on techniques to fuse normalization operations directly with GEMM and Attention kernels. By overlapping CUDA Core normalization math with Tensor Core execution pipelines, notable speedups can be unlocked.
Multiple novel ideas and techniques have been introduced to tackle the key blocker to norm-related fusions: the tiling difference. These include Lazy Pre-Norm, Multi-CTA Norm Fusion, and FlashNormAttention. Testing on real-world RecSys traffic and NVIDIA B200 hardware shows these techniques can hide up to 90% of normalization latency behind GEMM kernels. This yields up to a 35% latency reduction for full Attention blocks with pre-norm, post-norm, and residual connections.
This milestone shows what is possible when you combine algorithmic insights with low-level hardware optimization. We are moving closer to a world of free normalization, where developers get full modeling power without performance compromises.
Read the complete blog, link in comments 👇 -
PyTorch
@PyTorch
Normalization layers often introduce memory-bound bottlenecks in large language models and recommendation systems due to unique hardware tiling requirements. To address this, Meta has been working on techniques to fuse normalization operations directly with GEMM and Attention kernels. By overlapping CUDA Core normalization math with Tensor Core execution pipelines, notable speedups can be unlocked.
Multiple novel ideas and techniques have been introduced to tackle the key blocker to norm-related fusions: the tiling difference. These include Lazy Pre-Norm, Multi-CTA Norm Fusion, and FlashNormAttention. Testing on real-world RecSys traffic and NVIDIA B200 hardware shows these techniques can hide up to 90% of normalization latency behind GEMM kernels. This yields up to a 35% latency reduction for full Attention blocks with pre-norm, post-norm, and residual connections.
This milestone shows what is possible when you combine algorithmic insights with low-level hardware optimization. We are moving closer to a world of free normalization, where developers get full modeling power without performance compromises.
Read the complete blog, link in comments 👇 -
PyTorch
@PyTorch
DFlash is a PyTorch-built block-diffusion model for speculative decoding, designed for faster LLM inference on NVIDIA Blackwell.
Researchers at UC San Diego released DFlash: Block Diffusion for Flash Speculative Decoding in February 2026. The NVIDIA Developer article explains how DFlash uses a lightweight block-diffusion drafter to generate blocks of candidate tokens in parallel before target-model verification.
NVIDIA reports up to 15x higher throughput for gpt-oss-120b on NVIDIA Blackwell at the same interactivity level, with DFlash becoming available across TensorRT-LLM, SGLang, and vLLM.
Read the full post: developer.nvidia.com/blog/boost-inference-performance-up-… -
PyTorch reposted
Matt White
@matthew_d_white
I’ll be speaking at WAIC in Shanghai, July 17-19, with three workshop talks:
- Towards Building Safe and Secure Agentic AI
- Composable Intelligence: The Open Source Agentic AI Stack
- Just Enough Intelligence: Why AI adoption depends on optimization engineering
I’ll be covering safety, security, open source agentic infrastructure, and why efficient, fit-for-purpose intelligence is key to real-world AI adoption.
If you’re at WAIC, come join the sessions. I’d be glad to connect.
#waic #ai #opensource #agenticai
@pytorch @linuxfoundation @aaif_io -
PyTorch reposted
NVIDIA AI Infrastructure
@NVIDIAAIInfra
💡 Continuous software innovation is the force multiplier behind AI infrastructure — compounding inference performance, lowering cost per token, and increasing long-term value with every optimization.
Open source accelerates this advantage.
Leading AI frameworks like @PyTorch and inference engines such as @sgl_project and @vllm_project are built natively on NVIDIA CUDA, enabling research breakthroughs and software optimizations to unlock great performance on NVIDIA GPUs from day zero. -
PyTorch reposted
vLLM
@vllm_project
Announcing the first-ever vLLM Conference — hosted by @inferact at Ray Summit, Aug 24–26 in San Francisco 🎉🌉
This is where we'll get into the work pushing open, high-performance inference forward, such as:
🗺️ Where the vLLM roadmap is headed
⚡ Getting the most out of accelerators including NVIDIA, AMD, TPU
🔗 Wiring vLLM into training and serving pipelines
🚀 Running inference on production scale
The summit features speakers from Inferact, NVIDIA, AMD, Google TPU, Anyscale, PyTorch, Meta, Red Hat, and more 🎤
Come learn where the future of inference, open source, and AI is heading — and meet the leading builders driving it 👇
vllm.ai/events/vllm-conference/2026 -
PyTorch
@PyTorch
💡 Have results to share but not a full conference talk?
The Poster Sessions at #pytorchcon North America, October 20-21 in San Jose, CA, are the perfect place to showcase your work.
Submit by July 26: events.linuxfoundation.org/pytorch-conference-north-ameri… -
PyTorch
@PyTorch
🚨 3 days left!
The OSPOlogy + #osposummit China #callforproposals closes July 12.
Bring your insights on #opensource governance, community growth, compliance, developer engagement, & organizational strategy to Shanghai this September 7.
www.lfopensource.cn/kubecon-cloudnativecon-openinfra-summ… -
PyTorch
@PyTorch
PyTorch 2.13 is here, with 3,328 commits from 526 contributors and updates across FlexAttention, CuTeDSL, nn.LinearCrossEntropyLoss, torchcomms, FSDP2, Python 3.15 wheels, ROCm, Arm, and XPU.
The release blog and notes cover FlexAttention on Apple Silicon with up to ~12x speedup over SDPA on sparse patterns, a deterministic backward path on CUDA, the CuTeDSL "Native DSL" backend for Inductor, nn.LinearCrossEntropyLoss to reduce peak GPU memory by up to 4x, torchcomms for large-cluster training, and FSDP2 communication overlap improvements.
On July 22 at 11 a.m. PT, join @albanDesmaison (@Meta), Andrey Talman (@Meta), Piotr Bialecki (@NVIDIA), and Chris Gottbrath for a live 2.13 Q&A.
🔗 Read the release blog, and register for the live Q&A: pytorch.org/blog/pytorch-2-13-release-blog/ -
PyTorch
@PyTorch
Joseph Gabriel Lagonsin (ITBrief) reports on Shopify’s Platinum membership in PyTorch Foundation, including Shopify’s plans to contribute upstream engineering expertise and share experience from running machine learning systems in retail and commerce settings.
"AI is becoming the operating layer for commerce, and we're convinced that layer needs to be open to reach global scale," said Mikhail Parakhin, Chief Technical Officer, Shopify. "PyTorch is central to how Shopify builds AI today. Joining the Foundation lets us invest in that base directly and help shape it for the agentic era, rather than just building on top of it."
The coverage also details Shopify’s use of PyTorch across Sidekick, search and recommendation tools, fraud protection, and foundation model work tied to merchant tools.
"We are excited to welcome Shopify to the PyTorch Foundation as our newest Platinum Member," said Mark Collier, Executive Director, PyTorch Foundation. "Shopify operates where AI meets real buyers and sellers every day, and that vantage point is exactly what the Foundation needs as agents become a front door to commerce.
Read more: itbrief.news/story/shopify-joins-pytorch-foundation-as-pl… -
PyTorch
@PyTorch
Foundation models are reshaping computational biology.
Adapting models to a specific task is nontrivial, so to reduce the difficulty of building these workflows, @nvidia BioNeMo Recipes provide step-by-step training recipes built on familiar PyTorch, Hugging Face, and other patterns.
This post walks through two case studies that show how the same parameter-efficient and readable recipe applies across biological modalities.
Read the full post: developer.nvidia.com/blog/fine-tuning-biological-foundati… -
PyTorch
@PyTorch
New on the PyTorch Foundation blog: @AMD and @Meta contributors share how PyTorch Monarch was brought to AMD Instinct GPUs with ROCm to support fault tolerant distributed training at scale.
The post walks through the ROCm port of Monarch’s GPU runtime and distributed communication stack, then shows how Monarch, TorchFT, and TorchTitan enable healthy replicas to continue training while failed nodes recover and rejoin without a full checkpoint restart.
Validation includes Llama 3 8B training on a 128 GPU AMD Instinct MI300 SLURM cluster and a 256 GPU AMD Instinct MI355 Kubernetes cluster.
Read the full technical deep dive: pytorch.org/blog/bringing-pytorch-monarch-to-amd-gpus-sin… -
PyTorch
@PyTorch
🚀 Build, benchmark, optimize, & connect with the global #pytorch community at #pytorchcon North America!
Join us October 20-21 in San Jose, CA for two days of technical talks, hands-on learning, & conversations shaping the future of #ai.
💰 Register by July 31 to save $400: events.linuxfoundation.org/pytorch-conference-north-ameri… -
PyTorch
@PyTorch
As Europe’s AI sovereignty debate draws more attention to models, @tech_eu examines PyTorch’s role in the open source infrastructure that supports them.
Cate Lawrence (@tech_eu) spoke with Mark Collier, Executive Director, PyTorch Foundation, about PyTorch as a common software layer for open-weight AI, neutral governance for critical AI infrastructure, and PyTorch Foundation’s expanding role as a home for projects including @vllm_project, @DeepSpeedAI, @raydistributed, and Helion.
The article also covers SafeTensors moving toward community stewardship under PyTorch Foundation.
As Lawrence writes, “For Collier, Europe's competitive advantage isn't simply producing more AI models — it's helping build the open infrastructure that allows an entire ecosystem of companies to innovate.”
🔗 Read it here: tech.eu/2026/07/03/pytorch-the-software-layer-underpinnin… -
PyTorch
@PyTorch
⏳ 5 days left to submit!
The #callforproposals for OSPOlogy + #osposummit China closes July 12.
Share your experiences with OSPO strategy, governance, compliance, community management, #opensource culture, & more.
📍 Shanghai | September 7
www.lfopensource.cn/kubecon-cloudnativecon-openinfra-summ… -
PyTorch
@PyTorch
Ever wondered why a PyTorch CI test failure name doesn't exactly match your source file?
Because PyTorch tests are generated dynamically at import time across various devices and dtypes, CI failures often display specific names that differ from the original template. Understanding how device-generic tests, OpInfos, and CI sharding fit together can significantly speed up your development and contribution workflow.
Read our latest blog which provides a contributor's perspective on how to get started with testing in PyTorch. Link in comments 👇 -
PyTorch
@PyTorch
PyTorch Foundation supported the ExecuTorch Hackathon in San Francisco, where more than 100 participants across 20+ teams built real-time AI applications using PyTorch and ExecuTorch.
Teams built on Snapdragon-powered Samsung Electronics Galaxy S25 Ultra devices, focusing on latency, offline capability, privacy-sensitive processing, energy efficiency, and real-time user experience.
Congratulations to the winning teams:
1st Place: SafeScreen AI, an on-device visual safety layer
2nd Place: SixthSense, an assistive wearable that converts visual information into directional haptic signals
3rd Place: Toddle AI, a privacy-first prototype for analyzing toddler walking patterns locally
The winning projects showed how local execution can support applications that require immediate feedback, limited connectivity, or sensitive data processing.
Read the full recap from @matthew_d_white (PyTorch Foundation), Andrew Caples (@Meta), and Lauren Lunde (@Qualcomm): pytorch.org/blog/building-the-future-of-on-device-ai-at-t… -
PyTorch
@PyTorch
🚀 Your next big #opensource conversation starts in Shanghai.
Join #kubecon + #cloudnativecon + #openinfrasummit + #pytorchcon China, September 7-9, for three days of technical sessions, community collaboration, & the ideas shaping the #ai era.
⏰ Register by July 28 to save ¥710 RMB: www.lfopensource.cn/kubecon-cloudnativecon-openinfra-summ… -
PyTorch
@PyTorch
PyTorch Foundation is a Gold Sponsor of Agentic AI Summit 2026.
Matt White, CTO of PyTorch Foundation, will lead “The Open Agentic Stack,” on building AI systems with open source, open standards, and composability.
🔗 pytorch.org/event/agenticai-summit/ -
PyTorch reposted
Mark Collier 柯理怀
@sparkycollier
Welcome @MParakhin and @ShopifyEng !
This is another signal that companies will train and serve *many models* with @PyTorch & that open source is the only way to do it.
Shopify knows production system at scale, and the whole community will learn & improve together in the open!
PyTorch
@PyTorch
"AI is becoming the operating layer for commerce, and we're convinced that layer needs to be open to reach global scale,” said @MParakhin Chief Technical Officer at @Shopify. “@PyTorch is central to how Shopify builds AI today. Joining the Foundation lets us invest in that base directly and help shape it for the agentic era, rather than just building on top of it."
-
PyTorch
@PyTorch
We’re excited to welcome Shopify as a Platinum Member of the PyTorch Foundation @ShopifyEng 🎉 Shopify provides essential internet infrastructure for commerce and relies on PyTorch as a key part of applied machine learning across Shopify's all-in-one platform that makes it easier to start, run, and grow a business.
PyTorch
@PyTorch
"AI is becoming the operating layer for commerce, and we're convinced that layer needs to be open to reach global scale,” said @MParakhin Chief Technical Officer at @Shopify. “@PyTorch is central to how Shopify builds AI today. Joining the Foundation lets us invest in that base directly and help shape it for the agentic era, rather than just building on top of it."
PyTorch
@PyTorch
As a Platinum member, Shopify intends to invest in the open source ecosystem it depends on: contributing engineering expertise upstream, sharing what it has learned running machine learning at commerce scale, and helping ensure PyTorch keeps serving the demands of real retail and commerce workloads. 👉 Read the full announcement: pytorch.org/blog/shopify-joins-the-pytorch-foundation-as-…
-
PyTorch
@PyTorch
🎓 Students, researchers, & practitioners:
Share your work with the #pytorch community at #pytorchcon North America, October 20-21 in San Jose, CA.
Poster proposals are due July 26: events.linuxfoundation.org/pytorch-conference-north-ameri… -
PyTorch
@PyTorch
#opensource doesn't scale by accident.
Share how your organization approaches governance, contribution strategies, security, compliance, community engagement, & more at OSPOlogy + #osposummit China.
📅 September 7, Shanghai
🎤 Submit to speak by July 12: www.lfopensource.cn/kubecon-cloudnativecon-openinfra-summ… -
PyTorch
@PyTorch
PyTorch-native NeMo AutoModel handles transformer pretraining in @nvidia's end-to-end workflow for building a transaction foundation model.
The workflow combines GPU-accelerated data processing and tokenization, decoder-only model pretraining, embedding extraction, and XGBoost fraud classification.
On the synthetic @IBM TabFormer dataset, combining raw features with learned embeddings increased Average Precision by 41.76% over the raw-feature baseline.
🔗 Read the full post: developer.nvidia.com/blog/build-your-own-transaction-foun… -
PyTorch
@PyTorch
Built on PyTorch, Ray, SGLang, and NVIDIA Megatron-LM, Miles is an open source framework from RadixArk for large-scale LLM reinforcement learning post-training.
Miles uses PyTorch for models, numerics, profiling, and extensibility; Ray for orchestration; SGLang for rollout generation; and Megatron-LM for distributed training.
The framework supports asynchronous rollout and training, NCCL/RDMA weight synchronization, MoE-aware rollout/training alignment, low-precision recipes, LoRA, fault tolerance, observability, and extension points for custom algorithms and model architectures.
🔗 Read more in our latest blog from the Miles Team: pytorch.org/blog/miles-a-pytorch-native-stack-for-large-s… -
PyTorch
@PyTorch
PyTorch now has a Cross-Repository CI Relay (CRCR) that streamlines testing across the ecosystem.
CRCR automatically triggers and tracks continuous integration in out-of-tree backend repositories whenever a PR is opened against pytorch/pytorch. The results flow directly back to the PyTorch CI HUD, providing maintainers with a unified dashboard for both in-tree and out-of-tree CI health. This eliminates the need for downstream repositories to build and maintain custom integrations.
Link to learn more in comments section 👇 -
PyTorch
@PyTorch
💡 Research. Engineering. #opensource collaboration. Experience it all at #pytorchcon North America, October 20-21 in San Jose, California.
⏳ Early bird savings of $400 end July 31. Register now: events.linuxfoundation.org/pytorch-conference-north-ameri… -
PyTorch reposted
Arm Software Developers
@ArmSoftwareDev
Deploying AI models at the edge comes with a different set of challenges.
These hands-on Jupyter labs walk you through using ExecuTorch to deploy and optimize @PyTorch models on Arm CPUs and NPUs, with examples you can run on hardware including Raspberry Pi. -
PyTorch
@PyTorch
“Open source foundations exist to create the conditions for the industry to do hard work together that no single organization can do alone. Security is no different. AI has fundamentally changed the math on vulnerability discovery, and going it alone is no longer just inefficient; it's dangerous. Efforts like Akrites pave the way for the widest possible participation and the largest possible impact.”
Mark Collier, Executive Director, PyTorch Foundation @sparkycollier
Read the Akrites open letter: akrites.org/letter/
Learn how to get involved: akrites.org
The Linux Foundation
@linuxfoundation
The age of AI requires a new solution to cybersecurity challenges. Today, the Linux Foundation and industry leaders launched Akrites, a coordinated effort to defend critical open source software against AI-enabled cyber threats.
Frontier AI can find software vulnerabilities in minutes. Akrites introduces a shared SIRT and a standardized, confidential disclosure process to remediate vulnerabilities upstream before they are exploited.
Read the open letter and learn why top organizations are joining together in this critical effort
akrites.org/letter/ -
PyTorch reposted
vLLM
@vllm_project
Huge milestone from the @anyscalecompute + @googlecloud GKE teams 🎊
Ray Serve LLM provides up to 4.4x higher throughput on prefill-heavy workloads and 24x on decode-heavy workloads than previous versions.
Three optimizations made this possible on the Ray Serve LLM + vLLM stack:
⭐️Direct streaming with a control-plane-only endpoint picker
⭐️ A new vLLM Ray V2 executor backend
⭐️HAProxy ingress for routing at the speed of C
Ray's primitives for fault tolerance, observability, and portability across K8s and VMs are a great foundation as inference deployments get more complex.
Congrats to the team! Try the new Ray V2 executor today in vLLM with --distributed-executor-backend ray.
Seiji Eicher
@seiji_________
Today we are excited to announce, in partnership with the GKE team at Google Cloud (@googlecloud), a major milestone in Ray Serve LLM’s production serving capability. Ray Serve LLM now matches high performance, rust-based routing frameworks such as vllm-router (@vllm_project) in benchmarks across a variety of workloads and deployment patterns.
In Ray 2.56, we see up to 4x higher request throughput on prefill-heavy workloads, and 24x higher request throughput on decode-heavy workloads 🎉 -
PyTorch
@PyTorch
One runtime, multiple GPU architectures, and zero vendor-specific model code.
In this blog post, the TokenSpeed team @lightseekorg introduces TokenSpeed-Kernel, a portable, high-performance kernel system built for modern LLM inference. Using GPT-OSS 120B as a case study, they show how specialized kernels for @AIatAMD and @NVIDIAAI GPUs can seamlessly coexist behind a common API. This unified approach delivers up to 3.6x higher throughput on the AMD MI355X, all without requiring any changes to the underlying model logic.
Link to blog in comments section 👇 -
PyTorch
@PyTorch
📊 Research. Models. Benchmarks. Tools. Infrastructure.
Whatever you're building, bring it to the Poster Sessions at #pytorchcon North America, October 20-21 in San Jose, CA!
Submit by the July 26 #cfp deadline: events.linuxfoundation.org/pytorch-conference-north-ameri… -
PyTorch
@PyTorch
What happens when an AI agent recognizes that an action is unsafe, but executes it anyway?
In this clip from PyTorch Conference Europe 2026, Besmira Nushi, Senior Manager, AI Research at NVIDIA, examines the “action-thought disconnect,” a failure mode in which a model’s expressed reasoning does not match the action it takes.
Using an example from computer use agent evaluation, Nushi explains why task-completion scores alone may miss critical failures and argues for evaluating the full execution trajectory.
🔗 Watch the full keynote: youtu.be/54u05pEJv6g
#pytorchcon -
PyTorch
@PyTorch
From governance & compliance to community growth & developer engagement, OSPOs are shaping the future of #opensource.
Speak at OSPOlogy + #osposummit China on September 7 in Shanghai.
🎤 CFP closes July 12. Submit now: www.lfopensource.cn/kubecon-cloudnativecon-openinfra-summ… -
PyTorch
@PyTorch
NVIDIA highlights vLLM as one of the open source frameworks available for serving Step 3.7 Flash, StepFun's 198B-parameter multimodal Mixture-of-Experts model.
NVIDIA's developer blog covers deployment, inference, and fine-tuning workflows for the model, which supports image and video inputs and a 256K context window.
Read more: developer.nvidia.com/blog/run-step-3-7-flash-on-nvidia-gp… -
PyTorch
@PyTorch
While SGLang provided Day-0 support for DeepSeek-V4, the collaboration between the @lmsysorg and @NVIDIAAI engineering teams has taken its production performance to the next level.
According to the public SemiAnalysis InferenceX dashboard, the GB300 disaggregated lane (DeepSeek-V4 Pro, FP4, 8K/1K) saw a 5x throughput increase—surging from ~2,200 to ~11,200 tok/s/GPU at identical interactivity levels. These updates sustain high throughput much deeper into target interactivity ranges most deployments target, while also driving a 2.9x lift on the Blackwell Ultra aggregated lane.
Find the full technical breakdown in the comments below: -
PyTorch
@PyTorch
🔥 Two days. Hundreds of #ai practitioners. One community.
#pytorchcon North America is coming to San Jose, California, October 20-21.
Register by July 31 to save $400 & join the conversations shaping #opensource AI.
🎟️ events.linuxfoundation.org/pytorch-conference-north-ameri… -
PyTorch
@PyTorch
Ray (@raydistributed) and @vllm_project are helping developers understand when prefill-decode disaggregation can improve throughput and reduce compute costs, and when aggregated serving remains the better choice.
Read more: www.anyscale.com/blog/ray-vllm-prefill-decode-disaggregat…
Anyscale
@anyscalecompute
Save 67% with prefill-decode disaggregation using Ray + vLLM on AMD GPUs.
www.anyscale.com/blog/ray-vllm-prefill-decode-disaggregat… -
PyTorch
@PyTorch
Autotuning is the backbone of Helion, PyTorch's DSL for performance portable ML kernels. Currently Helion searches utilize Likelihood-Free Bayesian Optimization (LFBO) to find the most performant configs. While LFBO works well, it requires grinding through hundreds of compile-and-benchmark cycles per kernel.
What if, instead of starting the search blindly, you could ask an LLM to reason about the kernel and propose configurations?
In this blog, we look at how LLM-guided autotuning is a practical approach to dramatically faster kernel tuning at production quality.
Click the link in the comments section to learn more.
@JongsokC @oguz_ulgen -
PyTorch
@PyTorch
Ray (@raydistributed) Serve LLM and @vllm_project enable high performance distributed inference at scale. Awesome to see Foundation-hosted projects working together to advance the open source AI stack.
Learn more: www.anyscale.com/blog/high-performance-distributed-infere…
ray
@raydistributed
Ray Serve LLM now offers 4.4x higher request throughput on prefill-heavy workloads, and 24.8x higher request throughput on decode-heavy workloads!
🚀Three major optimizations:
- Direct streaming, bypassing an intermediate Ray Serve deployment on the response path with a new, control plane-only endpoint picker
- A new, Ray V2 executor backend in vLLM, enabling optimizations such as async scheduling
- HAProxy ingress, for ingress request routing at the speed of C
All available in Ray 2.56. This is awesome work with @googlecloud and @vllm_project!
Seiji Eicher
@seiji_________
Today we are excited to announce, in partnership with the GKE team at Google Cloud (@googlecloud), a major milestone in Ray Serve LLM’s production serving capability. Ray Serve LLM now matches high performance, rust-based routing frameworks such as vllm-router (@vllm_project) in benchmarks across a variety of workloads and deployment patterns.
In Ray 2.56, we see up to 4x higher request throughput on prefill-heavy workloads, and 24x higher request throughput on decode-heavy workloads 🎉 -
PyTorch
@PyTorch
Prove you can work with the technology behind modern AI:
We are excited to announce the launch of PyTorch Certified Associate (PTCA).
As AI adoption continues to accelerate across industries, the demand for practical, hands-on engineering skills is growing rapidly. The PTCA is designed to validate your foundational ability to design, train, and deploy machine learning models within real-world environments.
Link to learn more in comments section👇
PyTorch
@PyTorch
Learn more here: pytorch.org/blog/just-launched-pytorch-certified-associat…..*
-
PyTorch
@PyTorch
The schedule is now available for KubeCon + CloudNativeCon + OpenInfra Summit + PyTorch Conference China, September 7-9 in Shanghai.
AI is transforming how we build, deploy, and operate technology. Open source is making it possible. The agenda features engineers, maintainers, researchers, and technology leaders advancing cloud native infrastructure, open infrastructure, and AI.
Explore the sessions: pytorch.org/blog/schedule-now-available-for-kubecon-cloud…
@CloudNativeFdn, @openinfradev
#pytorchcon #kubecon #cloudnativecon #openinfrasummit -
PyTorch
@PyTorch
Nominations are officially open for the 2026 PyTorch Foundation Contributor Awards.
These awards celebrate outstanding impact across PyTorch Foundation hosted projects, including PyTorch, vLLM, DeepSpeed, Ray, Helion, and Safetensors.
Whether it be through code development, documentation improvements, mentorship or community leadership - we want to recognise the individuals who help move our ecosystem forward.
Submit your nomination by July 17. Link in comments
PyTorch
@PyTorch
Submit your nomination here 👉pytorch.org/blog/nominations-open-for-the-2026-pytorch-fo…..*
-
PyTorch
@PyTorch
We're seeking a Senior Cloud Operations Engineer who will play a pivotal role in the PyTorch Foundation, leading cloud infrastructure and DevOps initiatives. Apply at: careers.linuxfoundation.org/jobs/647914-senior-cloud-oper…
-
PyTorch
@PyTorch
🚀 Built something with #pytorch?
Show it off at the Poster Sessions during #pytorchcon North America, October 20-21 in San Jose, CA.
Poster submissions are due July 26: events.linuxfoundation.org/pytorch-conference-north-ameri… -
PyTorch
@PyTorch
24 hours left to nominate yourself or someone else as a PyTorch Foundation Ambassador🔥
The PyTorch Foundation Ambassador Program highlights and supports passionate community leaders who organize events, create technical content, mentor new users, and contribute to the open source ecosystem.
As we continue to expand representation across local PyTorch communities, we especially welcome applications from contributors in Africa, Latin America, the Middle East, Oceania, Southeast Asia, and Eastern Europe.
Learn more and apply before June 18, 2026 - link in comments.
PyTorch
@PyTorch
Apply here 👉pytorch.org/programs/ambassadors/application-process/
-
PyTorch
@PyTorch
Submit your talk for OSPOlogy + #osposummit China, taking place September 7 alongside #kubecon + #cloudnativecon + #openinfrasummit + #pytorchcon China in Shanghai.
Share lessons learned from building, scaling, and supporting #opensource programs.
📅 CFP closes July 12: -
PyTorch
@PyTorch
Bridging the gap between model optimization and production deployment
This tutorial walks through a typical end-to-end quantization workflow, from PyTorch model through how to export/compile an NVIDIA TensorRT engine for real-world inference speedup.
Read the full post: -
PyTorch
@PyTorch
🚀 #ai frameworks evolve. Communities move them forward.
Meet the developers, researchers, & practitioners shaping the future of #pytorch at #pytorchcon North America.
📍San Jose, California
📅 October 20-21
Save $400 through July 31:
events.linuxfoundation.org/pytorch-conference-north-ameri… -
PyTorch
@PyTorch
In this clip from his PyTorch Conference Europe 2026 keynote, Patrick von Platen (@MistralAI) discusses why real-world machine interaction requires models that can take continuous input and produce continuous output.
Using live transcription as an example, he explains how streaming architectures differ from traditional speech recognition approaches that process larger chunks of audio at once.
🔗 Watch the full keynote: youtu.be/sn5954LcXq8
#pytorchcon -
PyTorch
@PyTorch
The inaugural PyTorch Meetup Singapore brought together engineers, researchers, and community builders to talk about everything from vLLM project updates to the broader question of sovereign intelligence.
Read the full technical recap and find presentation slides in our latest blog: pytorch.org/blog/pytorch-meetup-singapore-a-milestone-in-… -
PyTorch
@PyTorch
📣 New CNCF-hosted co-located event added!
Join OSPOlogy + #osposummit China on September 7 alongside #kubecon + #cloudnativecon + #openinfrasummit + #pytorchcon China in Shanghai.
Share your insights with the #opensource program office community. Submit to speak by July 12.
🎟️ Add OSPOlogy + OSPO Summit China to your event pass by June 30 for just ¥70 (USD$10) before prices increase.
Learn more: www.lfopensource.cn/kubecon-cloudnativecon-openinfra-summ… -
PyTorch
@PyTorch
Enable smarter, longer-thinking agents
Scale agentic AI and reinforcement learning by shortening CPU execution time, increasing task throughput, and improving overall AI factory output.
The @nvidia custom Olympus core in the NVIDIA Vera CPU uses a neural branch predictor to reduce stalls in branch-heavy code. Combined with other prediction mechanisms, it can sustain two taken branches per cycle with zero penalty, maintaining throughput for deep software stacks such as PyTorch, graph workloads, and scripting engines.
Read the complete blog post:
developer.nvidia.com/blog/nvidia-vera-cpu-sets-a-new-stan… -
PyTorch
@PyTorch
Submit your poster proposal for #pytorchcon North America! Share your latest #ai, ML, #pytorch, tooling, infrastructure, or research work with the community October 20-21 in San Jose, CA.
🗓️ Poster #cfp closes July 26: events.linuxfoundation.org/pytorch-conference-north-ameri… -
PyTorch
@PyTorch
Helion is a PyTorch-native hardware agnostic kernel DSL designed for writing high-performance kernels using a tile-programming model.
In our latest blog post, Sean Chen (@RedHat) and Yanan Cao (PyTorch, @Meta) explored integrating Helion kernels with @vllm_project and evaluated their performance across a range of LLM inference workloads, showing impressive performance speedups thanks to Helion’s Ahead-of-Time autotuning and fine-grained runtime dispatching.
Let’s dive into kernel fusion, framework design, and end-to-end benchmarking, showing how Helion can be easily integrated into vLLM and bring significant benefits.
Read the full technical deep dive 👉 pytorch.org/blog/portable-vllm-model-inference-kernels-in… -
PyTorch
@PyTorch
From #cloudnative to #ai and #openinfra: Experience the full spectrum of #opensource innovation in Shanghai. 🇨🇳
Event: KubeCon + CloudNativeCon + OpenInfra Summit + PyTorch Conference China
Dates: Sept 8-9
💰 Save ¥710 RMB if you register by July 28!
www.lfopensource.cn/kubecon-cloudnativecon-openinfra-summ… -
PyTorch reposted
Luc Georges
@LucSGeorges
perf packed release: safetensors 0.8.0 is out ⚡️
Main takeaways:
- direct copy into metal MTLBuffers + dlpack for 0-copy hand-off to target framework (only torch for now)
-> 2-3x perf improvement + fixes OOMs loading models that are around the limit of unified memory on macOS when loading with transformers
- GIL-free serialization, enabling multi-threaded saves from Python
-> 1.2x to 2x faster for single files, but you can expect more improvement when saving multiple files in parallel!
Check the release notes for the full list of improvements! -
PyTorch
@PyTorch
AI agents are changing how you interact with your PC.
@nvidia and @Microsoft are teaming up to enable the next generation of developers to build on-device agents on the Windows platform, with easier setup, native security, and integration with the apps and tools developers already use.
This includes optimizing the ComfyUI implementation in PyTorch, enabling developers to run larger models with better performance.
Read the complete blog post: developer.nvidia.com/blog/build-personal-ai-agents-on-win… -
PyTorch
@PyTorch
🧠 From breakthrough research to production-scale #ai, #pytorchcon is where the #pytorch community comes together. Join us October 20-21 in San Jose, California.
🎟️ Register by 31 July & save $400: events.linuxfoundation.org/pytorch-conference-north-ameri… -
PyTorch
@PyTorch
OpenEnv is a tool for creating an agentic execution environment, like terminals, browsers, or anything an agent can interact with. OpenEnv contributors announced that the project will now be coordinated by a committee that includes Meta-PyTorch, Reflection, @UnslothAI, @modal, @PrimeIntellect, @nvidia , @mercor, @fleet_ai, and @huggingface.
Today's announcement also notes that OpenEnv is supported and adopted by organizations including PyTorch Foundation, @vllm_project, @LightningAI, and others.
🔗 Read more: huggingface.co/blog/openenv-agentic-rl -
PyTorch
@PyTorch
Build on-device AI with ExecuTorch on @Snapdragon .
The ExecuTorch Hackathon brings developers to San Francisco on June 27–28 to build and optimize real-time AI applications that run directly on Snapdragon-powered mobile devices. Participants will build on Samsung Galaxy S25 Ultra devices powered by Snapdragon and receive mentorship and hands-on support from @Qualcomm and @Meta experts.
Learn more and register: pytorch.org/event/executorch-hackathon/
Applications close June 15. -
PyTorch
@PyTorch
On Monday, June 15, PyTorch Foundation project Helion is hosting a Helion DSL Tutorial at PLDI 2026 (47th ACM SIGPLAN Conference on Programming Language Design and Implementation) in Boulder, CO. Helion is a Python-based kernel DSL that supports multiple backends across NVIDIA, AMD, Google TPU, and Intel.
This workshop is a fantastic opportunity for compiler researchers, kernel authors, and ML systems engineers to dive deep into the technology. This will be an entirely interactive session where attendees will get to write, autotune, and run real Helion kernels live.
@JongsokC
PyTorch
@PyTorch
More details about the tutorial 👉pldi26.sigplan.org/details/pldi-2026-tutorials/1/Writing-…
-
PyTorch
@PyTorch
FINAL CALL! 📢 The #pytorchcon North America #callforproposals closes TONIGHT at 11:59 PM PDT. Share your #ai expertise in San Jose this October 20-21!
Apply now: events.linuxfoundation.org/pytorch-conference-north-ameri… -
PyTorch
@PyTorch
Almost out of time! 🚨 The #callforproposals for #pytorchcon North America (Oct 20-21 | San Jose) closes tomorrow, June 7 at 11:59 PM PDT. Submit your session, BoF, or lightning talk now!
CFP: events.linuxfoundation.org/pytorch-conference-north-ameri… -
PyTorch
@PyTorch
Stanford OpenLab is hosting a seminar session with Matt White (@matthew_d_white) next Monday (June 8) for a conversation on open source AI infrastructure and the future of the AI ecosystem.
Matt will share his perspective on the role of open source software in advancing AI, including how foundational tools, frameworks, and community-driven infrastructure are shaping the development and deployment of AI systems.
He'll also explore opportunities and challenges around open source AI, developer ecosystems, enterprise adoption, and the future of AI infrastructure.
Hosted by Kun Peng (@Stanford)
🔗 Learn more: luma.com/idmjowzj?tk=V6chEGHe -
PyTorch
@PyTorch
Two weeks left to nominate yourself or someone else as a PyTorch Foundation Ambassador🔥
The PyTorch Foundation Ambassador Program supports community leaders who organize events, create technical content, mentor contributors, and support regional PyTorch communities worldwide.
As we continue to expand representation across local PyTorch communities, we especially welcome applications from contributors in Africa, Latin America, the Middle East, Oceania, Southeast Asia, and Eastern Europe.
Ambassadors will receive recognition through PyTorch Foundation channels, exclusive resources, support for community engagement, and professional growth.
Learn more and apply here before June 18, 2026: pytorch.org/programs/ambassadors/: -
Post not available here, view on X
PyTorch
@PyTorch
More details about the tutorial 👉 pldi26.sigplan.org/details/pldi-2026-tutorials/1/Writing-…
-
PyTorch reposted
The Linux Foundation
@linuxfoundation
OpenMDW-1.1 is now available — and @NVIDIAAI is adopting it across Cosmos, Isaac GR00T, Ising, and Nemotron model families.
A permissive, unified legal framework purpose-built for AI models.
Learn more at openmdw.ai -
PyTorch
@PyTorch
At PyTorch Conference Europe, Ramine Roane (@roaner, @AMD) discussed how PyTorch evolved from making single-GPU programming easy to becoming a production tool for distributed training and inference, and the role of the open ecosystem in supporting the next stage of AI development.
In this clip, he highlights the scale of today's open models, citing examples ranging from hundreds of billions to more than a trillion parameters.
🔗 Watch the full keynote:
youtu.be/AiYu980kF-4
#pytorchcon -
PyTorch
@PyTorch
LLMs are revolutionizing the financial trading landscape by enabling sophisticated analysis of vast amounts of unstructured data to generate actionable trading insights.
The Strategic Technology Analysis Center (STAC) has been developing benchmarks for the workloads key to the financial industry for over 15 years, and they have now developed the STAC-AI benchmark to help companies assess the inference pipeline.
This blog leverages the NVIDIA TensorRT LLM inference framework for efficient model execution. These quantized models were run using TensorRT LLM PyTorch runtime for a familiar, native PyTorch development experience while maintaining peak performance.
🔗 Read the full post:
developer.nvidia.com/blog/nvidia-blackwell-sets-stac-ai-r…
#pytorch #opensourceai #ai #innovation -
PyTorch
@PyTorch
DeepSpeed now supports the Muon Optimizer.
Optimized specifically for internal 2D weights within neural networks, Muon is gaining traction for its significant memory savings and strong convergence metrics during LLM training.
In our latest blog post, the DeepSpeed team shares a deep dive into their integration setup, implementation of hybrid optimizer strategies, and early benchmark results. @PKUWZP
Read the full technical breakdown here 👉 pytorch.org/blog/using-muon-optimizer-with-deepspeed/ -
PyTorch
@PyTorch
PyTorch Foundation member @NVIDIA just adopted OpenMDW-1.1 across four of its biggest open model families.
OpenMDW is the Linux Foundation's permissive licensing framework — originally launched in 2025 with the PyTorch Foundation — purpose-built for AI model distributions instead of being retrofitted from traditional software licenses.
By replacing fragmented, restrictive AI licenses with one unified legal framework covering models, weights, code, documentation, and data, OpenMDW gives developers clear rights to train, modify, contribute, redistribute, and deploy.
🔗 Learn more: www.linuxfoundation.org/press/linux-foundation-releases-o… -
PyTorch
@PyTorch
Using PyTorch allowed LinkedIn to enable production-grade optimization at previously infeasible scales.
In our latest PyTorch Foundation case study, the engineering team at LinkedIn shares how they re-architected their extreme scale Linear Programming Solver (DuaLip GPU). Built using PyTorch to enable multi-GPU computations and parallelism, this solver serves as a core building block for massive matching problems that power ranking, personalization, and recommendation systems.
Read the complete case study here 👉 pytorch.org/blog/how-linkedin-uses-pytorch-to-solve-extre…
@PKUWZP -
PyTorch reposted
vLLM
@vllm_project
vLLM v0.22.0 is out! 459 commits from 230 contributors (63 new). 🎉
Highlights: DeepSeek V4 hardening (NVFP4 fused MoE, full+piecewise CUDA graph, ROCm support), experimental Rust frontend in-Tree, batch-invariant Cutlass FP8 (28.9% lower e2e latency), Model Runner V2 advances, multi-tier KV cache offloading.
Thread 👇 -
PyTorch
@PyTorch
The clock is ticking! ⏰ Only 1 week remains to submit your proposal for #pytorchcon North America in San Jose (Oct 20-21). Get your sessions in by June 7.
Submit: events.linuxfoundation.org/pytorch-conference-north-ameri… -
PyTorch reposted
NVIDIA AI
@NVIDIAAI
We're adopting the Linux Foundation’s OpenMDW framework across our open model families.
This helps make open model licensing simpler and more consistent at scale.
A single legal framework across models, code, documentation, and data helps reduce friction for developers and enterprises building with open source.
The Linux Foundation
@linuxfoundation
OpenMDW-1.1 is now available — and @NVIDIAAI is adopting it across Cosmos, Isaac GR00T, Ising, and Nemotron model families.
A permissive, unified legal framework purpose-built for AI models.
Learn more at openmdw.ai -
PyTorch
@PyTorch
Wondering what it's like to attend a PyTorch Conference? Attendees of the first ever #pytorchcon Europe 2026 in Paris share a glimpse into what it's like...
Watch the highlight reel on YouTube: youtu.be/0lKdvXZkS-4
Will we see you at PyTorch Conference China and PyTorch Conference North America later this year?
PyTorch
@PyTorch
Details about PyTorch Conference North America at: events.linuxfoundation.org/pytorch-conference-north-america/ Note: the CFP for speaking submissions is currently open!
PyTorch
@PyTorch
And details about the joint KubeCon + CloudNativeCon + OpenInfra Summit + PyTorch Conference China 2026 are at: www.lfopensource.cn/kubecon-cloudnativecon-openinfra-summ…
-
PyTorch
@PyTorch
How to Eliminate Pipeline Friction in AI Model Serving
There are numerous issues that are collectively known as pipeline friction, and they cost organizations time, money, and competitive advantage.
This post provides actionable best practices for eliminating the most common sources of friction in AI model serving pipelines. Learn about the most frequent sources of pipeline friction, including unsupported operations, dynamic input sizes, version mismatches, and model export issues that might arise, for example, when converting from a training frameworks like PyTorch into optimized inference formats.
Read the full post:
developer.nvidia.com/blog/how-to-eliminate-pipeline-frict… -
PyTorch
@PyTorch
"We believe the future of AI is built on open, production-proven infrastructure - and PyTorch sits at the heart of that future. Joining the PyTorch Foundation is a natural step given our years of running PyTorch at scale across heterogeneous hardware on Alibaba Cloud. We look forward to working alongside the PyTorch Foundation to raise the bar for AI infrastructure and help developers build the next generation of models with confidence," said Dr. Feifei Li, Chief Technology Officer, Alibaba Cloud. ITBrief @techday covers @alibaba_cloud joining the PyTorch Foundation as a Platinum member itbrief.news/story/alibaba-cloud-joins-pytorch-foundation…
-
PyTorch
@PyTorch
PyTorch Compile can make models run dramatically faster, but the real magic is what happens under the hood.
This blog breaks down one of the most important optimizations behind torch.compile: kernel fusion. Instead of launching separate GPU kernels for every PyTorch operation, PyTorch Inductor can combine dependent operations into a single optimized Triton kernel.
The result? Fewer kernel launches, less memory traffic, fewer intermediate tensors, and more efficient GPU execution.
Learn more here 👉 pytorch.org/blog/why-is-pytorch-compile-so-fast-kernel-fu… -
PyTorch
@PyTorch
The speed-of-light optimization for Qwen3.5 on the TokenSpeed inference engine is a significant milestone, achieving a record-breaking 580 tokens per second (tps) for agentic workloads on NVIDIA GPUs.
In the PyTorch Foundation's latest community blog post, you can learn all about the complete design, implementation, and optimization of Qwen3.5 models in the TokenSpeed inference framework and see for yourself how this work is improving performance 👉 pytorch.org/blog/up-to-580tps-new-speed-record-of-qwen3-5…
This achievement was a joint effort between the @Alibaba_Qwen inference team, @lightseekorg Foundation TokenSpeed team, @NVIDIAAI , and the Mooncake team, with special contributions from @tri_dao for FlashAttention-4 (FA4) optimization. @KVCache_AI -
PyTorch
@PyTorch
Don't miss the flagship #pytorch event of the year! 🚀 Join us in San Jose, CA, from Oct 20-21 for #pytorchcon North America. Early bird registration saves you $400 through July 31.
Register: events.linuxfoundation.org/pytorch-conference-north-ameri… -
PyTorch reposted
LightSeek Foundation
@lightseekorg
Introducing EAGLE 3.1 — the next evolution of speculative decoding from @EagleCorp, developed by @hongyangzh, @dogacel0, and the EAGLE team in collaboration with vLLM @vllm_project and TorchSpec @lightseekorg.
EAGLE 3.1 introduces a new FC normalization + post-normalization hidden-state feedback architecture that significantly improves long-context robustness, acceptance length, and serving stability across real-world inference environments.
@NVIDIA has been instrumental in the large-scale training, benchmarking, and inference validation of EAGLE 3.1 to help bring this next step in inference acceleration to production environments.
For EAGLE 3.1, the EAGLE team identified attention drift as a key bottleneck behind deeper-step acceptance-length degradation in speculative decoding.|
The Results:
• Up to 2× longer acceptance length in long-context
• Stronger long-context + chat-template robustness
• More stable serving across diverse prompts/environments
• Native vLLM support
• TorchSpec training support
• Open-source Kimi K2.6 EAGLE 3.1 draft model
Read more below 👇
lightseek.org/blog/eagle-3-1.html -
PyTorch
@PyTorch
We’re excited to welcome @alibaba_cloud as a Platinum Member of the PyTorch Foundation 🎉
Alibaba Cloud is a global leader in full-stack AI infrastructure and the force behind Qwen—one of the world’s most influential open-weight model families. Having run PyTorch at massive scale across diverse hardware, they bring invaluable, production-hardened engineering expertise to the upstream community.
PyTorch
@PyTorch
👉 Read the announcement: pytorch.org/blog/alibaba-cloud-joins-the-pytorch-foundati…
-
PyTorch
@PyTorch
Planning your trip to Shanghai? 🛫 Secure your pass for #kubecon + #cloudnativecon + #openinfrasummit + #pytorchcon China (Sept 8-9) by July 28 to save ¥710 RMB (USD$100).
Join the leaders of the intelligent era: www.lfopensource.cn/kubecon-cloudnativecon-openinfra-summ… -
PyTorch reposted
vLLM
@vllm_project
🎉Thrilled to announce EAGLE 3.1 - the next evolution of speculative decoding from @EagleCorp, developed by @hongyangzh, @dogacel0, and the EAGLE team in collaboration with vLLM @vllm_project and TorchSpec @lightseekorg!
💡EAGLE 3.1 introduces a new FC normalization + post-normalization hidden-state feedback architecture that significantly improves long-context robustness, acceptance length, and serving stability across real-world inference environments.
Shoutout to @NVIDIA who has been instrumental in the large-scale training, benchmarking, and inference validation of EAGLE 3.1 to help bring this next step in inference acceleration to production environments.
For EAGLE 3.1, the EAGLE team identified attention drift as a key bottleneck behind deeper-step acceptance-length degradation in speculative decoding.
✨What's new:
• Up to 2× longer acceptance length in long-context
• Stronger long-context + chat-template robustness
• More stable serving across diverse prompts or environments
• Native vLLM support
• TorchSpec training support
• Open-source Kimi K2.6 EAGLE 3.1 draft model
🔗 Blog: vllm.ai/blog/2026-05-26-eagle-3-1 -
PyTorch
@PyTorch
Model Optimization and Post-Training Quantization
Model quantization is an effective method to reduce VRAM usage and improve inference performance on consumer devices. By lowering computational and memory requirements while preserving model quality, quantization helps AI models run more efficiently in resource-constrained environments.
This post walks through how to use NVIDIA Model Optimizer to quantize a CLIP model in FP8 format with the post-training quantization (PTQ) method, including an example workflow exporting a PyTorch checkpoint.
Read the complete blog post:
developer.nvidia.com/blog/model-quantization-post-trainin… -
PyTorch reposted
Matt White
@matthew_d_white
Back from MLSys 2026 in Bellevue — a packed week at the intersection of AI and systems.
Highlights: @marksaroufim on AI writing systems code, Lidong Zhou on “system intelligence,” deep sessions on LLM serving/training, agentic AI, kernels, compilers, edge ML, benchmarking, and Industry Day.
Also great to see strong interest at the PyTorch Foundation booth all week. Thank you to everyone who stopped by — and especially to the volunteers who represented the community so well.
#mlsys2026 #pytorch #mlsystems #aiinfrastructure -
PyTorch
@PyTorch
PyTorch member Meta just open-sourced a GPU kernel that makes attention 2.3x faster on NVIDIA Blackwell. TLX Block Attention is a warp-specialized Triton kernel built for block-diagonal self-attention — a pattern widely used in recommendation and feature-interaction models.
By exploiting compile-time knowledge of the attention structure, entire stages of the Flash Attention algorithm have been eliminated: no multi-tile loops, no correction factors, no auxiliary tensors.
The result: 2.3x kernel speedup, 3.5x when fused with rotary embeddings, and +30.6% MFU on production layers.
Learn more here 👉 pytorch.org/blog/tlx-block-attention-a-warp-specialized-b…
Code: github.com/facebookresearch/ads_model_kernel_library -
PyTorch
@PyTorch
Deep dive into Core #pytorch, Inference, or Training. 🛠️ Shape the program for #pytorchcon North America (Oct 20-21 | San Jose) - submit to the #callforproposals!
🗓️ Deadline: June 7
Apply: events.linuxfoundation.org/pytorch-conference-north-ameri… -
PyTorch
@PyTorch
The PyTorch Foundation Ambassador Program is open for 2026 nominations. The program supports community leaders who organize events, create technical content, mentor contributors, and support regional PyTorch communities worldwide.
We especially encourage applications from contributors across Africa, Latin America, the Middle East, Oceania, Southeast Asia, and Eastern Europe as we continue expanding representation across local PyTorch communities.
Ambassadors receive recognition through PyTorch Foundation channels, access to collaboration and training opportunities, support for approved community activities, and complimentary admission to PyTorch Conference.
Nominations are open through June 18, 2026. Individuals may nominate themselves or someone else.
🔗 Learn more and apply: pytorch.org/blog/join-the-pytorch-foundation-ambassador-p… -
PyTorch
@PyTorch
PyTorch 2.12 introduced major updates across compilation, distributed systems, export, graph capture, and accelerator support. Wednesday’s PyTorch 2.12 Release Live Q&A provided a technical overview of the release and answered questions from the community live.
Andrey Talman (@Meta), @albanDesmaison (@Meta), and @joespeez (@reflection_ai), moderated by @Chris_AI_HPC, discussed updates including the new device-agnostic torch.accelerator.Graph API, torch.export.save support for microscaling quantization formats, torch.cond capture within CUDA Graphs, and expanded CUDA, ROCm, XPU, MPS, and Arm platform support.
This clip highlights part of the discussion around the range of execution workflows supported in PyTorch, including eager mode, torch.compile, and export and graph-based methods, and the different needs of users working across training, inference, and deployment environments.
Thank you to everyone who joined live.
🔗 Watch the full video: www.youtube.com/live/Zn_flVwhH2EThis media couldn't be displayed. See it on the original post. -
PyTorch
@PyTorch
Federated Learning Without the Refactoring Overhead
The most valuable data is often the least movable. Regulatory boundaries, data sovereignty rules, and organizational risk tolerance routinely prevent centralized aggregation. Meanwhile, sheer data gravity makes even permitted transfers slow, expensive, and fragile at scale.
The latest version of NVIDIA FLARE addresses this reality with a Federated Learning (FL) computing runtime that moves the training logic to the data, while raw data stays put. See examples of how to leverage PyTorch in a federated learning system.
Read the full post:
developer.nvidia.com/blog/federated-learning-without-the-… -
PyTorch
@PyTorch
NVIDIA shared a full playlist of its sessions from PyTorch Conference Europe. NVIDIA engineers and developers covered a wide range of topics, including:
- Symmetric Memory + NCCL Device APIs
- Custom Kernels in torch.compile
- Agentic AI & LLM Evaluation frameworks, and more.
The clip featured here is from Besmira Nushi's keynote, "The Unbearable Lightness of (Agentic) Evaluations," which explores how agentic evaluation frameworks expose gaps between what models say and what they actually do.
Find the full playlist here:
www.youtube.com/playlist?list=PL5B692fm6--u9xhIYmjS_rHUI0… -
PyTorch
@PyTorch
The PyTorch Docathon 2026 has officially wrapped up, and the results are incredible! Over the past two weeks (May 5–19), our open source community showed up with massive energy and dedication to make PyTorch documentation better for developers everywhere.
Here is a snapshot of what we accomplished together:
Ecosystem Reach: 260+ registrants and 30+ active participants collaborated globally.
Impactful Contributions: 150+ merged pull requests successfully landed across all difficulty levels.
Technical Depth: Community members resolved critical issues, added API documentation, and expanded core ExecuTorch documentation.
Why does high-quality documentation matter more than ever in the AI era? Clear documentation lowers the barrier to entry for human developers and directly fuels the modern AI ecosystem. LLMs and AI agents increasingly rely on public technical documentation to learn APIs, generate code, and troubleshoot complex workflows. High-quality PyTorch docs help ensure AI-generated guidance is more accurate, up-to-date, and aligned with best practices.
🏆 Celebrating Our Community Leaders: A massive shout-out to the top-performing contributors who led the way and whose work improves the experience for millions of PyTorch users worldwide:
First Place: ymrohit
Second Place: XAheli, PyDevC, and darknight054
Third Place: JonathanColetti and Kadermiyanyedi
Honorable Mentions: AswaniSahoo, Vasanthadithya-mundrathi, Nazim-fad, ozgecinko, kiszk, saurabhkthakur, and spzala.
Thank you to everyone who brought code, reviews, and the community momentum!
PyTorch
@PyTorch
Read the blog: pytorch.org/blog/pytorch-docathon-2026-results/
-
PyTorch
@PyTorch
Expert-led sessions, hands-on learning, and networking. 🤝 #pytorchcon North America is the place to be this Oct 20-21 in San Jose. Save $400 when you register by July 31!
Details: events.linuxfoundation.org/pytorch-conference-north-ameri… -
PyTorch
@PyTorch
Developing a Real-Time Hailstorm Forecasting Model
With the goal to provide critical weather observation and nowcasting capabilities for severe weather prediction, Colorado State University used PyTorch-based NVIDIA PhysicsNeMo and trained a specialized version of the NVIDIA Earth-2 StormScope Nowcasting model, specifically for operational severe hailstorm prediction.
🔗 Read the full case study:
www.nvidia.com/en-us/case-studies/colorado-state-university/ -
PyTorch reposted
LightSeek Foundation
@lightseekorg
Excited to see Shepherd Model Gateway featured in The Linux Foundation’s May 2026 newsletter.
SMG explores a Rust-based gateway architecture that moves non-GPU orchestration work out of the inference path, helping improve throughput and efficiency for modern long-context LLM serving systems.
Thanks to the LightSeek Foundation and the broader PyTorch ecosystem for the collaboration and support.
pytorch.org/blog/lightseek-smg/
The Linux Foundation
@linuxfoundation
The Linux Foundation’s May 2026 Newsletter is live with updates across open source AI, cloud native infrastructure, networking, and security, including Mega May Cyber Boost training savings, new research surveys, and upcoming LF ecosystem events.
Read the newsletter: -
PyTorch reposted
Edward Z. Yang
@ezyang
I know, these days stars don't mean much, but it's still lovely to see such a nice round number. Thank you everyone for trusting your ML workloads to us, here's to the next 100K stars! (H/t Tianyu for pulling this screenshot)
-
PyTorch
@PyTorch
vLLM and PyTorch worked together to fix a long-standing aarch64 install headache — as of PyTorch 2.11.0, pip install torch on GB200 / GB300 / GH200 just works. 🎉
What changed: PyTorch 2.11.0 now publishes CUDA-enabled aarch64 wheels to the default PyPI index. No more custom --index-url flags. No more transitive dependencies silently swapping your GPU build for the CPU wheel. New users on Grace Hopper and Grace Blackwell systems can follow the standard install instructions and have vLLM work the first time.
In our latest blog, @KaichaoYou (co-founder @inferact, Lead Maintainer @vllm_project) shares the full story: 🐛 A 2024 hackathon bug bringing up vLLM on GH200 🔧 vLLM's in-tree workarounds (use_existing_torch.py and [tool.uv] build-isolation passthrough) 🤝 From GitHub issue to PyTorch Foundation TAC discussion 🚀 The fix landing in PyTorch 2.11.0, driven by NVIDIA and PyTorch core.
A great example of cross-project collaboration under the PyTorch Foundation umbrella — and a reminder that boring infrastructure wins compound.
Read the full story: pytorch.org/blog/vllm-and-pytorch-work-together-to-improv…
✍️ : Piotr Bialecki (@nvidia) — @ptrblck_de, Alban Desmaison (@Meta), Andrey Talman (@Meta), Nikita Shulga (@Meta) -
PyTorch
@PyTorch
Don't miss @DeepSpeedAI virtual office hours on May 26 at 12:00 PM America/New_York to ask questions of @toh_tana member of DeepSpeed TSC & get the latest recent key updates, including AutoSP (sequence parallel), AutoEP (expert parallel), and AutoTP (tensor parallel).
-
PyTorch
@PyTorch
ExecuTorch now has an MLX delegate that runs PyTorch models on Apple Silicon GPUs. It supports LLMs, speech-to-text, and MoE models with quantization via TorchAO. Export with torch.export, run on Metal.
Read our latest blog: pytorch.org/blog/running-pytorch-models-on-apple-silicon-… -
PyTorch
@PyTorch
PyTorch releases include thousands of changes, and our Release Live Q&A gives you direct access to the maintainers and contributors behind them.
In this clip from our PyTorch 2.11 webinar, Nikita Shulga explains why quantization support is moving from PyTorch core to TorchAO and what that means for developers.
Have questions? Join @AndreyTalman, @albanDesmaison, and @joespeez, moderated by @Chris_AI_HPC, on May 20 at 10:00 AM PT for a live Q&A covering PyTorch 2.12 and answering questions from the community.
🔗 Register now: pytorch.org/event/pytorch-2-12-release-live-qa/ -
PyTorch
@PyTorch
Big congrats to the ExecuTorch team. Their paper just won the Best Industry Paper Award at @MLSysConf 2026. 🏆
ExecuTorch is PyTorch's framework for running models on-device, in production today across phones, wearables, desktops, and embedded systems. Backends include Apple, Arm, Qualcomm, MediaTek, Samsung, NXP, Cadence, Intel, NVIDIA, and others.
Catch the team Tuesday morning in the Best Paper Session ( AM PT) and at the poster session Thursday evening.
Paper: arxiv.org/abs/2605.08195
Discord: discord.gg/Dh43CKSAdc
X: x.com/Executorch
Project: github.com/pytorch/executorch
Schedule: mlsys.org/virtual/2026/calendar -
PyTorch
@PyTorch
Want to lead a BoF or a session presentation? 🗣️ #pytorchcon North America #callforproposals is moving fast. Submit your ideas for San Jose (Oct 20-21) before the June 7 deadline!
Apply: events.linuxfoundation.org/pytorch-conference-north-ameri… -
PyTorch
@PyTorch
At #pytorchcon Europe 2026, @ezyang (@Meta) explains why many developers find tensor parallelism difficult to work with and how PyTorch is exploring SPMD types to catch mistakes through type checking.
Watch the full keynote: youtu.be/xvNh5F9t-d4 -
PyTorch
@PyTorch
Driving optimized nuclear reactor design with AI Physics and Digital Twins
The development of socially acceptable nuclear reactors requires that they are safe, clean, efficient, economical, and sustainable. However, validating new designs presents significant challenges including expense, time constraints, and inherent complexities of physical experiments and simulations.
NVIDIA CUDA-X libraries, the PhysicsNeMo AI Physics framework, and the Omniverse libraries help developers in the nuclear industry address these challenges by delivering GPU-accelerated, AI-augmented simulation solutions for real-time digital twins.
Read the full post:
developer.nvidia.com/blog/accelerate-clean-modular-nuclea… -
PyTorch
@PyTorch
PyTorch 2.12 introduces major updates across compilation, export, distributed training, and accelerator support.
Highlights include up to 100x faster batched linalg.eigh on CUDA, the new torch.accelerator.Graph API, Microscaling quantization support in torch .export.save, and fused Adagrad.
The release includes 2,926 commits from 457 contributors since PyTorch 2.11.
Have questions? Join @AndreyTalman (@Meta), @albanDesmaison (@Meta), and @joespeez (@reflection_ai), moderated by @Chris_AI_HPC (@Meta), on May 20 at 10:00 AM PT for a live Q&A covering the release and answering questions from the community.
🔗 Read the release blog and register for the webinar: pytorch.org/blog/pytorch-2-12-release-blog
#pytorch #opensourceai #machinelearning #aiinfrastructure -
PyTorch
@PyTorch
We are heading to Bellevue for MLSys 2026! The PyTorch Foundation is proud to be a Diamond Sponsor and eager to connect with the researchers and engineers pushing the boundaries of machine learning.
Join PyTorch Foundation CTO @matthew_d_white on 18 May for a lightning talk or visit our booth #20 to speak to the experts about projects like #pytorch and @vllm_project
🔗 pytorch.org/event/mlsys-2026/
#pytorch #opensourceai -
PyTorch
@PyTorch
3️⃣ iconic events, one massive stage. 🚀 Join us for #kubecon + #cloudnativecon + #openinfrasummit + #pytorchcon China in Shanghai this Sept 8-9.
Register by July 28 to save ¥710 RMB!
🎟️ Details: www.lfopensource.cn/kubecon-cloudnativecon-openinfra-summ… -
PyTorch
@PyTorch
PyTorch 2.12 introduces updates across compilation, distributed systems, export, graph capture, and accelerator support.
Join Andrey Talman (@Meta), @albanDesmaison (@Meta), and @joespeez (@reflection_ai), moderated by @Chris_AI_HPC (@Meta), on May 20 at 10:00 AM PT for a live Q&A covering the release and answering questions from the community.
Highlights include the new device-agnostic torch.accelerator.Graph API, up to 100x faster batched eigenvalue decomposition on CUDA, support for microscaling quantization formats in torch.export.save, fused Adagrad optimizer support, FlightRecorder updates, multi-GPU and multi-node profiling improvements, updated backend selection for torch.linalg.eigh on CUDA, and expanded CUDA, ROCm, XPU, MPS, and Arm platform support.
🔗 Register today: streamyard.com/watch/MC2PrCkw6UaZ
#pytorch #opensourceai -
PyTorch
@PyTorch
The 2026 PyTorch Docathon is underway, bringing the community together to improve the documentation developers rely on across PyTorch, Tutorials, and ExecuTorch.
Contributors have already closed 100 pull requests and 73 issues. The Docathon runs through May 17, so there's still time to contribute.
🔗 Learn more and register: community.linuxfoundation.org/events/details/lfhq-pytorch…
🔗 Track the leaderboard: docs.pytorch.org/docs/docathons/docathon-leaderboard-2026…
#pytorch #docathon #opensourceai -
PyTorch
@PyTorch
Arm has released a set of hands-on labs designed to help developers deploy PyTorch models using ExecuTorch across real edge devices.
The labs walk-through:
• Exporting models into lightweight .pte artifacts
• Running optimized inference on Arm CPUs (XNNPACK + KleidiAI)
• Offloading workloads to Ethos-U NPUs using TOSA and Vela
• Visualizing model partitioning and performance behavior
It’s a practical way to understand how models are executed across heterogeneous compute—and how to optimize for it.
If you’re working on edge AI or exploring on-device inference, this is worth a look: pytorch.org/blog/efficient-edge-ai-on-arm-cpus-and-npus/
#pytorch #executorch #opensourceai -
PyTorch reposted
InclusionAI
@TheInclusionAI
AReaL is joining the @PyTorch Landscape🎉landscape.pytorch.org
Fully async, modular, built for the agentic AI era. AReaL is a scalable, RL infrastructure designed to bridge foundation model training with modern agent-based applications.
Explore AReaL: github.com/inclusionAI/AReaL -
PyTorch
@PyTorch
Planning your trip to San Jose? 🛫 Join the #pytorch community at #pytorchcon North America, Oct 20-21. Register by July 31 & keep $400 in your pocket with early bird pricing.
Secure your pass: events.linuxfoundation.org/pytorch-conference-north-ameri… -
PyTorch
@PyTorch
Facing the computational chemistry trade-offs between accuracy and speed?
Machine learning interatomic potentials (MLIPs) have emerged as a bridge, offering quantum accuracy at classical speeds. NVIDIA has introduced a collection of GPU-accelerated simulation building blocks that are designed to manage the data flow between accelerated chemistry and materials domain-specific kernels and deep learning models.
NVIDIA ALCHEMI Toolkit extends beyond individual models and kernels to provide a modular, PyTorch-native structure for researchers and developers to compose custom simulation workflows.
🔗 Read the full post: developer.nvidia.com/blog/building-custom-atomistic-simul…
#pytorch #opensourceai #ai #inference #innovation -
PyTorch reposted
Unsloth AI
@UnslothAI
We’re excited to share that Unsloth has joined the PyTorch Ecosystem!
Unsloth is an open-source project that makes training & running models faster, more accurate with less compute. We want AI to be accessible to all
Blog: unsloth.ai/blog/pytorch
GitHub: github.com/unslothai/unsloth -
PyTorch reposted
NVIDIA AI
@NVIDIAAI
TokenSpeed is a brand new inference engine purpose built for speed-of-light agentic workloads.
Read their blog to learn more about its advanced KV cache management, safe and efficient scheduler, and pluggable layered kernel system designed for multi-silicon support. Plus, it also has the fastest MLA attention kernel on NVIDIA Blackwell.
Congrats to @lightseekorg on the launch!
LightSeek Foundation
@lightseekorg
Introducing TokenSpeed, a speed-of-light LLM inference engine.
> TensorRT LLM level performance
> vLLM level usability
> Built by a lean and mission-driven team in two months
> MIT license, open-source
github.com/lightseekorg/tokenspeed
lightseek.org/blog/lightseek-tokenspeed.html -
PyTorch
@PyTorch
AI-Powered Workflows to Build Fault-Tolerant Quantum Systems
The fundamental challenge in quantum computing—qubits are inherently noisy. The best quantum processors make an error roughly once in every thousand operations. To become useful accelerators for scientific and enterprise problems, error rates must drop to one in a trillion or better. AI is the most promising path to closing that gap at scale.
NVIDIA Ising is the world’s first family of open AI models for building quantum processors, launching with two model domains: Ising Calibration and Ising Decoding.
🔗 Read the full post: developer.nvidia.com/blog/nvidia-ising-introduces-ai-powe…
#pytorch #opensourceai #ai #inference #innovation -
PyTorch
@PyTorch
From #kernel Engineering to Responsible #ai: We want your voice at #pytorchcon North America in San Jose (Oct 20-21). 🔥 Submit your talk by June 7 & join the world's leading AI innovators.
#callforproposal submissions: events.linuxfoundation.org/pytorch-conference-north-ameri… -
PyTorch reposted
vLLM
@vllm_project
🚀 Excited to be the exclusive day-0 launch partner for @lightseekorg's Tokenspeed project!
We've integrated Tokenspeed's MLA library, optimized specifically for agentic workloads with long context and multi-turn, purpose-built for Kimi 2.5/2.6 and DeepSeek R1 on NVIDIA Blackwell hardware!
Try it out today with our preview image - nightly support coming soon!
LightSeek Foundation
@lightseekorg
Introducing TokenSpeed, a speed-of-light LLM inference engine.
> TensorRT LLM level performance
> vLLM level usability
> Built by a lean and mission-driven team in two months
> MIT license, open-source
github.com/lightseekorg/tokenspeed
lightseek.org/blog/lightseek-tokenspeed.html -
PyTorch reposted
LightSeek Foundation
@lightseekorg
Introducing TokenSpeed, a speed-of-light LLM inference engine.
> TensorRT LLM level performance
> vLLM level usability
> Built by a lean and mission-driven team in two months
> MIT license, open-source
github.com/lightseekorg/tokenspeed
lightseek.org/blog/lightseek-tokenspeed.html -
PyTorch
@PyTorch
FINAL CALL for savings! ⏳ Today is the absolute last day for early bird rates for #kubecon + #cloudnativecon + #openinfrasummit + #pytorchcon China (8-9 Sept).
Join us in Shanghai and save ¥1,270 RMB if you register by 23:59 CST tonight: www.lfopensource.cn/kubecon-cloudnativecon-openinfra-summ… -
PyTorch reposted
vLLM
@vllm_project
🚀 Day-0 MTP support for Gemma4 now available at vLLM with ready-to-use docker image!
⚡️Enjoy up to 3x faster decoding performance to supercharge your development with zero quality degradation!
Check out the full vLLM recipes for Gemma 4 model series👇
recipes.vllm.ai/Google/gemma-4-26B-A4B-it
Google for Developers
@googledevs
Gemma 4: Now up to 3x Faster. ⚡
Same quality, way more speed. Our new MTP drafters allow Gemma 4 to predict multiple tokens at once, effectively tripling your output speed without compromising intelligence. -
PyTorch
@PyTorch
The second in the series of Simplifying Sparse Deep Learning with Universal Sparse Tensor in nvmath-python
In a previous post, NVIDIA introduced the Universal Sparse Tensor (UST), enabling developers to decouple a tensor’s sparsity from its memory layout for greater flexibility and performance. We’re excited to announce the integration of the UST into nvmath-python v0.9.0 to accelerate sparse scientific and deep learning applications.
Read the follow-on post:
developer.nvidia.com/blog/simplify-sparse-deep-learning-w…
#pytorch #opensourceai #ai #inference #innovation -
PyTorch
@PyTorch
We’re excited to share In-Kernel Broadcast Optimization (IKBO)—a kernel-model-system co-design approach driving @Meta's large-scale recommendation system (RecSys) inference. It serves as the scalability backbone for the request-centric, inference-efficient framework underlying the Meta Adaptive Ranking Model (serving LLM-scale models in production).
The core idea is simple but powerful: broadcast is a data layout concern, not a computational necessity. Instead of materializing broadcast at the service layer, IKBO pushes it all the way down into the kernel layer—precisely where request and candidate features interact. This enables the system, together with model co-design, to capture the full performance upside. By preserving request and candidate inputs in their native batch sizes and fusing broadcast directly into the kernel, IKBO eliminates replicated memory movement and redundant computation across the stack.
From Attention in sequence modeling to GEMM in traditional workloads, the same idea delivers broad inference gains.
Results from our co-designed deployments:
⚡ Up to a 2/3 reduction in compute-intensive net latency on co-designed models.
⚡ End-to-end deployment across Meta's RecSys stacks on both GPU and MTIA (Meta's in-house accelerator).
⚡ Up to 4x speedups for linear compression GEMM and up to 2.4x/6.4x (kernel only / kernel + broadcasting) throughput for IKBO attention compared to FlashAttention-4 on H100.
🔗 If you’re interested in how rethinking a primitive like broadcast can unlock system-level gains for modern AI inference, take a look: pytorch.org/blog/in-kernel-broadcast-optimization-co-desi…
By @jiao_jian62798, @liptds_11, Hongtao Yu, Yuanwei Fang, Zhengkai Zhang, Zoran Zhao, Yuxuan Chen, Sijia Chen, Yang Chen
#pytorch #opensourceai #recsys #aiinfrastructure -
PyTorch
@PyTorch
Relive the energy of 2025 as we prepare for San Jose! ⚡ #pytorchcon North America returns to the Bay Area Oct 20-21. Check out last year’s highlights & lock in your $400 savings today.
📺 Recap 2025: events.linuxfoundation.org/archive/2025/pytorch-conference/
🎟️ Register for 2026: events.linuxfoundation.org/pytorch-conference-north-ameri… -
PyTorch
@PyTorch
Registration deadline alert! 🚨 Tomorrow is the last day to save ¥1,270 (USD$179) on your pass for #kubecon + #cloudnativecon + #openinfrasummit + #pytorchcon China in Shanghai (8-9 Sept).
Secure early bird rates by 6 May at 23:59 CST: www.lfopensource.cn/kubecon-cloudnativecon-openinfra-summ… -
PyTorch
@PyTorch
FINAL CALL! 🚨
The #cfp for #kubecon + #cloudnativecon + #openinfrasummit + #pytorchcon China, 8-9 Sept in Shanghai, closes TODAY at 23:59 China Standard Time. Don't miss your chance to speak on the premier #opensource stage.
Submit NOW: www.lfopensource.cn/kubecon-cloudnativecon-openinfra-summ… -
PyTorch
@PyTorch
IBM Research uses vLLM at the heart of its Research Inference & Tuning Service (RITS) Platform, providing shared access to model inference and tuning across its research community.
Our recent case study outlines how RITS supports more than 1,300 active users and hosts over 100 models at any given time, with vLLM serving as the core model serving runtime. pytorch.org/blog/ibm-research-uses-vllm-at-the-heart-of-i…
The Futurum Group covered the case study and examines what this approach could mean for enterprise AI infrastructure, including centralized access, governance, and cost control.
🔗 Read here: futurumgroup.com/insights/can-ibms-rits-platform-and-vllm…
#pytorch #vllm #aiinfrastructure #opensourceai -
PyTorch reposted
vLLM
@vllm_project
🎉 Day-0 support for @deepseek_ai V4 Pro and Flash on vLLM — a new generation of DeepSeek model, purpose-built for tasks up to 1M tokens. Alongside the release, we're publishing a first-principles walkthrough of the new long-context attention and how we implemented it in vLLM.
The new attention mechanism, in four moves:
• Shared K/V + inverse RoPE → 2× memory savings
• c4a / c128a KV compression → 4×–128× savings
• DeepSeek Sparse Attention over compressed tokens
• Short sliding window for locality across compression boundaries
At 1M context, per-layer KV state is ~8.7× smaller than a DeepSeek V3.2-style 61-layer stack (9.62 GiB vs 83.9 GiB, bf16). fp8 attention cache + fp4 indexer cache shrink it further.
vLLM side:
• Unified hybrid KV cache — single logical block size (256 native positions) across all compression rates; compressor state folded into the SWA KV cache spec so prefix caching, disagg prefill, CUDA graphs and MTP reuse the same abstraction
• Three page-size buckets for the full 5-way cache stack → no cross-kind fragmentation
• Fused kernels: compressor + RMSNorm + RoPE + cache insert (1.4–3×), inverse RoPE + fp8 quant (2–3×), Q-norm + KV RoPE + K insert (10–20×)
• Multi-stream overlap of indexer vs main-KV compression vs SWA insertion
Disaggregated serving is supported out of the box and strongly recommended for best performance.
Follow our recipes site for verified commands for @nvidia Blackwell (B200, B300, GB200, GB300) and Hopper (H100/H200/H20) systems.
Thanks to the @deepseek_ai team for open-sourcing DeepSeek V4, and to @inferact for landing day-0 support 🤝
📝 Blog: vllm.ai/blog/deepseek-v4
📖 Recipes: recipes.vllm.ai/deepseek-ai/DeepSeek-V4-Pro
🤗 huggingface.co/deepseek-ai/DeepSeek-V4-Pro
DeepSeek
@deepseek_ai
🚀 DeepSeek-V4 Preview is officially live & open-sourced! Welcome to the era of cost-effective 1M context length.
🔹 DeepSeek-V4-Pro: 1.6T total / 49B active params. Performance rivaling the world's top closed-source models.
🔹 DeepSeek-V4-Flash: 284B total / 13B active params. Your fast, efficient, and economical choice.
Try it now at chat.deepseek.com via Expert Mode / Instant Mode. API is updated & available today!
📄 Tech Report: huggingface.co/deepseek-ai/DeepSeek-V4-Pro/blob/main/Deep…
🤗 Open Weights: huggingface.co/collections/deepseek-ai/deepseek-v4
1/n -
PyTorch
@PyTorch
LightSeek Foundation recently released Shepherd Model Gateway (SMG).
It came out of a production bottleneck in LLM serving: CPU-bound work sitting on the critical path. Light Seek moved all non-GPU work into a Rust-based gateway, with a minimal gRPC boundary around inference.
The project is developed and maintained by @lightseekorg. The result: up to 3.5× throughput in long-context scenarios.
🔗 More details in our latest blog: pytorch.org/blog/lightseek-smg/
#pytorch #lightseek #opensourceai #shepherdmodelgateway -
PyTorch
@PyTorch
Got a #pytorch breakthrough to share? 🎤 The #callforproposals for #pytorchcon North America (Oct 20-21 | San Jose) is in full swing. Submit your technical session idea by June 7!
Apply: events.linuxfoundation.org/pytorch-conference-north-ameri… -
PyTorch
@PyTorch
The clock is ticking to join the program for #kubecon + #cloudnativecon + #openinfrasummit + #pytorchcon China. Share your knowledge with the global ecosystem & submit to speak by 3 May: www.lfopensource.cn/kubecon-cloudnativecon-openinfra-summ…
And don't forget early bird rates end in 1 week! Save now: www.lfopensource.cn/kubecon-cloudnativecon-openinfra-summ… -
PyTorch reposted
vLLM
@vllm_project
🏆 vLLM powers the fastest inference on NVIDIA Blackwell Ultra on Artificial Analysis.
On @digitalocean's Serverless Inference, powered by vLLM on NVIDIA HGX B300:
🥇 AA #1 output speed for DeepSeek V3.2 (230 tok/s, 0.96s TTFT) and Qwen 3.5 397B
🔧 MiniMax-M2.5: 23% TPOT gain via an EAGLE3 draft model trained on TorchSpec
Co-design highlights:
- NVFP4 quantization on Blackwell Ultra
- EAGLE3 + MTP speculative decoding
- Per-model kernel fusion
Thanks to @digitalocean, @nvidia, and @inferact for the collaboration. Optimizations land back in open-source vLLM.
🔗 www.digitalocean.com/blog/how-we-built-fastest-deepseek-m… -
PyTorch reposted
LightSeek Foundation
@lightseekorg
Congratulations to @vllm_project and @digitalocean on the launch. We also appreciate them adopting TorchSpec for EAGLE 3 training—great to see the open-source ecosystem thriving.
vLLM
@vllm_project
🏆 vLLM powers the fastest inference on NVIDIA Blackwell Ultra on Artificial Analysis.
On @digitalocean's Serverless Inference, powered by vLLM on NVIDIA HGX B300:
🥇 AA #1 output speed for DeepSeek V3.2 (230 tok/s, 0.96s TTFT) and Qwen 3.5 397B
🔧 MiniMax-M2.5: 23% TPOT gain via an EAGLE3 draft model trained on TorchSpec
Co-design highlights:
- NVFP4 quantization on Blackwell Ultra
- EAGLE3 + MTP speculative decoding
- Per-model kernel fusion
Thanks to @digitalocean, @nvidia, and @inferact for the collaboration. Optimizations land back in open-source vLLM.
🔗 www.digitalocean.com/blog/how-we-built-fastest-deepseek-m… -
PyTorch
@PyTorch
Need to cut LLM training checkpoint costs?
Training LLMs requires periodic checkpoints, full snapshots of model weights, optimizer states, and gradients saved to storage so training can resume after interruptions. At scale, these checkpoints become massive. NVIDIA nvCOMP is a GPU-accelerated lossless compression library that compresses the checkpoint before it leaves GPU memory, no roundtrip – no extra data movement.
Developers can easily integrate high-throughput compression directly into their Python workflows (such as PyTorch or TensorFlow).
🔗 Read the full post:
developer.nvidia.com/blog/cut-checkpoint-costs-with-about…
#pytorch #opensourceai #ai #inference #innovation -
PyTorch
@PyTorch
Want to train LLMs on longer contexts without re-engineering your entire systems stack?
Introducing AutoSP — the first compiler-based solution that automatically optimizes LLM training for long contexts. Under the hood, AutoSP applies a series of compiler passes that trigger sequence parallelism, paired with a curated activation-checkpointing scheme tailored for long-context training. It's integrated directly into DeepSpeed, so enabling long-context training is just a config change away.
No more rewiring your stack to push context lengths. Read the blog to learn more 🖇️ pytorch.org/blog/introducing-autosp/
✍ @AhanGupta13, Zhihao W., Neel Dani, @toh_tana, Tunji Ruwase, @_Minjia_Zhang_
#pytorch #deepspeed #autosp #opensourceai -
PyTorch
@PyTorch
Only 1 week left to submit! ⏳ Join in Shanghai this 8-9 September for #kubecon + #cloudnativecon + #openinfrasummit + #pytorchcon. Whether it's a panel or a lightning talk, we want your insights.
Submit by the 3 May deadline: www.lfopensource.cn/kubecon-cloudnativecon-openinfra-summ…
Register by 6 May + save! -
PyTorch
@PyTorch
The 2026 PyTorch Docathon runs May 5 to May 19, bringing contributors together to improve PyTorch tutorials, guides, examples, and documentation.
Beginner-friendly issues, skill-based tasks, and community support are available for new and experienced contributors.
pytorch.org/blog/rsvp-for-the-2026-pytorch-docathon/
#pytorch #pytorchdocathon -
PyTorch
@PyTorch
IBM Research introduced the RITS Platform to provide its research community with shared access to model inference endpoints. @vllm_project is at the heart of the RITS Platform and has been critical to democratizing access to the latest LLMs as they release.
“The vLLM community is vibrant and responsive, and with collaborative expertise, we are able to do great things both upstream and internally by leveraging and contributing to this groundbreaking project. vLLM has been critical to democratizing access to our research community to the latest and greatest LLMs as they release.”
– Priya Nagpurkar, Vice President, AI Platform, @IBM Research (@IBMResearch)
Read our latest case study:
🔗 pytorch.org/blog/ibm-research-uses-vllm-at-the-heart-of-i…
#vllm #pytorch #opensourceai -
PyTorch reposted
Red Hat AI
@RedHat_AI
Red Hat and Tesla engineers tackled a real production problem together.
3x output tokens/sec, 2x faster TTFT on Llama 3.1 70B with KServe + @_llm_d_ + @vllm_project. Fixes pushed upstream to KServe along the way.
This is what open source looks like. 🤝 🚀
Yuan (Terry) Tang
@TerryTangYuan
Excited to share our latest blog post on how we're solving real-world LLM inference challenges at production scale, a collaboration between @RedHat_AI and Tesla engineering teams.
We hit the usual pain points: massive model weights choking storage, GPU cycles wasted on naive load balancing, infrastructure that fights you when nodes go down.
Our answer: KServe + @_llm_d_ + @vllm_project with prefix-cache aware routing.
The results: 3x more output tokens/sec and 2x faster time to first token.
Thanks everyone who've contributed to this successful adoption: Scott Cabrinha, Sai Krishna, Sergey Bekkerman, Nati Fridman, Killian Golds, Andres Llausas, Bartosz Majsak, Greg Pereira, Pierangelo Di Pilato, Ran Pollak, Vivek Karunai Kiri Ragavan, Robert Shaw -
PyTorch reposted
Mark Collier 柯理怀
@sparkycollier
If you missed PyTorch Con EU you can now check out all of the talk recordings
And make plans to come to PyTorchCon in Shanghai in September and PyTorchCon NA in San Jose in October
PyTorch
@PyTorch
PyTorch Conference Europe 2026 was one for the books. 2 days in Paris building the future of open source AI together. 100+ session recordings are now live. View the full #pytorchcon EU playlist: www.youtube.com/playlist?list=PL_lsbAsL_o2DZbCiISSjbucDOW…
-
PyTorch
@PyTorch
Mark Collier (@sparkycollier), Executive Director of PyTorch Foundation and General Manager of AI & Infrastructure at @linuxfoundation, opened #pytorchcon Europe 2026 with a keynote on how the open source intelligence stack advances through coordination across hardware, software, and open source communities.
He shared updates on our growth, our expanding set of hosted projects, and why open collaboration remains essential to building AI infrastructure at global scale.
🎥 Watch the keynote: youtu.be/_BEmlMAKNSI
#pytorchcon #pytorch #vllm #deepspeed #ray #helion #safetensors #executorch #opensourceai -
PyTorch
@PyTorch
What to streamline the process of packaging your apps for AI accelerated computing?
Michael Kennedy of Talk Python Training interviews a coalition from @NVIDIA, Astral, and QuantSight who have been working on Wheel Next: A set of PEPs that let packages declare what hardware they need and let installers like uv pick the right build automatically.
Listen to the PodCast – ‘Wheel Next + Packaging PEPs’:
talkpython.fm/episodes/show/544/wheel-next-packaging-peps
#pytorch #opensourceai #ai #inference #innovation -
PyTorch
@PyTorch
llm-d published a new post on KServe + llm-d + vLLM for production LLM inference on Kubernetes.
Authors from @RedHat and Tesla describe how the stack addressed routing, customization, and day-2 operational challenges, citing 3x higher output tokens/s and 2x lower TTFT in one deployment after enabling prefix-cache aware routing.
By Yuan Tang, Scott Cabrinha, Robert Shaw, and Sai Krishna
@CloudNativeFdn
🔗 @_llm_d_ llm-d.ai/blog/production-grade-llm-inference-at-scale-kse…
#vllm #kserve #kubernetes #llmops #opensource -
PyTorch
@PyTorch
Join us in San Jose for #pytorchcon North America! 🚀 Secure your spot for Oct 20-21 & save $400 with our early bird rates. Don’t miss the premier event for the #pytorch community.
Register now: events.linuxfoundation.org/pytorch-conference-north-ameri… -
PyTorch reposted
vLLM
@vllm_project
🎉 We just shipped a major redesign of recipes.vllm.ai.
"How do I run model X on hardware Y for task Z?" now has a clickable answer.
What's new:
- URLs mirror HuggingFace: just swap huggingface.co → recipes.vllm.ai in any model URL to jump straight to its recipe (e.g. recipes.vllm.ai/Qwen/Qwen3.6-35B-A3B)
- Interactive command builder: pick hardware, variant, strategy (tensor, tensor+expert, or data+expert; single or multi-node; or a prefill/decode disaggregated cluster), toggle features → get the exact `vllm serve` command
- Pluggable hardware: NVIDIA + AMD already integrated. One-click switch between Hopper/Blackwell and MI300X/MI355X, and the right flags and env are applied automatically
- JSON API for agents: every recipe is also published at /<org>/<repo>.json (e.g. recipes.vllm.ai/Qwen/Qwen3.6-35B-A3B.json), so tools and agents can consume recipes without scraping
- Contribute a new recipe end-to-end with the agent skill shipped in the repo: github.com/vllm-project/recipes
🔗 recipes.vllm.ai
Enjoy! ✨ -
PyTorch
@PyTorch
PyTorch Conference Europe 2026 was one for the books. 2 days in Paris building the future of open source AI together. 100+ session recordings are now live. View the full #pytorchcon EU playlist: www.youtube.com/playlist?list=PL_lsbAsL_o2DZbCiISSjbucDOW…
-
PyTorch
@PyTorch
Want to Integrate Physical AI Capabilities into Existing Apps?
By stripping away the platform plumbing, Isaac Lab can leverage tensorized data exchange for direct, high-speed access to simulation states via GPU buffers (e.g., positions/velocities as PyTorch tensors without host copies). You can interact using zero-copy transfer data exchange directly alongside popular frameworks like NumPy, PyTorch, and Warp.
🔗 Read the full post:
developer.nvidia.com/blog/integrate-physical-ai-capabilit…
#pytorch #opensourceai #ai #inference #innovation -
PyTorch
@PyTorch
Meta teams pursue aggressive ROI goals, requiring substantial capacity reductions for model training and serving to meet financial targets. This is especially challenging for large-scale training jobs, which involve more data, GPUs, and advanced modeling techniques—resulting in higher initialization costs as models grow.
To improve efficiency, @Meta uses Effective Training Time (ETT%) to measure the proportion of end-to-end (E2E) wall time spent on productive training, factoring in overheads like initialization, restarts, checkpoint delays, and failures.
Since 2024, teams have launched initiatives to minimize training job overhead. This blog reviews key focus areas, progress made, and next steps.
🔗 Read our latest blog: pytorch.org/blog/optimizing-effective-training-time-for-m…
#pytorch #opensourceai #ett #optimization -
PyTorch
@PyTorch
🎤 Take the stage at #pytorchcon North America! We are looking for technical deep dives & production stories for our return to San Jose this Oct 20-21. Check out our "Preparing to Submit" guide to help craft your proposal.
🗓️ Deadline: June 7
Apply now: events.linuxfoundation.org/pytorch-conference-north-ameri… -
PyTorch
@PyTorch
The first-ever PyTorch Conference Europe brought more than 600 researchers, developers, and practitioners to Paris for two packed days of keynotes, technical deep dives, lightning talks, poster sessions, and community connection. Thank you to the speakers, sponsors, and attendees who made it possible.
PyTorch Foundation announced Helion and Safetensors as foundation-hosted projects, alongside PyTorch, vLLM, DeepSpeed, and Ray, and welcomed ExecuTorch into PyTorch Core.
Our program focused on production AI, with sessions on inference optimization and model serving, deployment across edge devices and browsers, kernel development in PyTorch, and responsible AI topics, including privacy and security.
🔗 Read the full recap and explore key sessions: pytorch.org/blog/pytorch-conference-europe-2026-a-landmar…
#pytorch #aiinfrastructure #opensourceai #pytorchcon -
PyTorch reposted
clem 🤗
@ClementDelangue
Introducing Kernels on the Hugging Face Hub ✨
What if shipping a GPU kernel was as easy as pushing a model?
- Pre-compiled for your exact GPU, PyTorch & OS
- Multiple kernel versions coexist in one process
- torch.compile compatible
- 1.7x–2.5x speedups over PyTorch baselines -
PyTorch
@PyTorch
PyTorch literally prevents the AI industry's worst nightmare: total hardware fragmentation. @sparkycollier Executive Director of @PyTorch Foundation sits down with Swapnil Bhartiya of TFiR to explore the 3 pillars of AI infrastructure (training, inference, agents), the multi-project foundation strategy (Helion for GPU accessibility, SafeTensors for model provenance), and why coding agents finally proved ROI for enterprise AI
Watch the full interview: www.youtube.com/watch?v=Wj-P4X9i7EU -
PyTorch reposted
vLLM
@vllm_project
🚀 Great to see vLLM powering OCR at this scale — Chandra-OCR-2 (5B) serving ~60 papers/hour per L40S across 16 parallel jobs.
The full pipeline breakdown is a great read 👇
🔗 huggingface.co/blog/nielsr/ocr-papers-jobs
clem 🤗
@ClementDelangue
We just OCR'd 27,000 arxiv papers into Markdown using an open 5B model, 16 parallel HF Jobs on L40S GPUs, and a mounted bucket.
Total cost: $850 Total time: ~29 hours Jobs that crashed: 0
This now powers "Chat with your paper" on hf.co/papers -
PyTorch reposted
Sayak Paul
@RisingSayak
We've been studying what it takes to get NVFP4 & MXFP8 deliver good speedups on modern flow models for image & video gen. on B200 🕵️♂️
Today, I'm excited to share those findings!
Bringing some cool recipes through Diffusers and TorchAO with `torch.compile` 🔥
Hop in ⬇️ -
PyTorch
@PyTorch
PyTorch Foundation is expanding its #opensourceai stack with #safetensors, #executorch, and #helion to improve model security, inference, and performance portability, writes Meredith Shubel for @thenewstack.
@sparkycollier: Bringing Safetensors into the fold is “an important step towards scaling production-grade AI models.”
ExecuTorch becomes a part of #pytorch Core to expand on-device inference capabilities. Safetensors and Helion join @vllm_project, @DeepSpeedAI, and @raydistributed as foundation-hosted projects. Read Meredith Shubel’s coverage at @thenewstack here: thenewstack.io/pytorch-ai-stack-expand/
@huggingface @Meta -
PyTorch
@PyTorch
Safetensors and Helion have joined PyTorch Foundation as foundation-hosted projects to secure model distribution for trusted agentic solutions and simplify kernel development across the open source AI ecosystem.
PyTorch Foundation CTO Matt White to Noah Bovenizer at The Stack: “Having portable formats that work across different frameworks is extremely important to be able to ship and move models around. And then Helion makes things more accessible for folks that want to do custom kernel development.”
Safetensors and Helion join PyTorch, @vllm_project, @DeepSpeedAI, and @raydistributed as foundation hosted projects. Read Noah Bovenizer’s coverage at The Stack here: www.thestack.technology/hugging-faces-safetensors-metas-h…
#pytorch #opensource #ai #safetensors #helion -
PyTorch
@PyTorch
PyTorch Conference Europe 2026 was 🔥🔥🔥
What were your main takeaways?
#pytorchcon EU -
PyTorch
@PyTorch
We want to hear your #opensource story! 📖 Submit a talk for #kubecon + #cloudnativecon + #openinfrasummit + #pytorchcon China. Topics: #kubernetes, #ml systems, #pytorch, security & more.
📍 Shanghai | 8-9 Sept
📣 Submit by 3 May: www.lfopensource.cn/kubecon-cloudnativecon-openinfra-summ… -
PyTorch
@PyTorch
Improve latency up to 1.68x with NVFP4 and MXFP8 using Diffusers and TorchAO on Blackwell across a suite of different models 🔥.
Squeeze out maximum performance with recipes involving selective quantization and regional compilation.
🔗 Read our latest blog from @vkuzo (@Meta) and @RisingSayak (@HuggingFace): pytorch.org/blog/faster-diffusion-on-blackwell-mxfp8-and-…
#pytorch #torchao #mxfp8 #nvfp4 #opensourceai -
PyTorch
@PyTorch
And that’s a wrap. Thanks for an amazing first-ever #pytorchcon Europe 2026!
-
PyTorch reposted
Mark Collier 柯理怀
@sparkycollier
“PyTorch is the most important open-source project at this moment in history.”
-
PyTorch
@PyTorch
⏰ ICYMI — #pytorchcon North America 2026 CFP is open! Got a session or poster idea? Submit for Oct 20–21 in San Jose. We're looking for work on training, inference, kernel engineering, responsible AI & more.
👉 Submit a session by June 7: events.linuxfoundation.org/pytorch-conference-north-ameri…
⚡Submit a poster by July 26: events.linuxfoundation.org/pytorch-conference-north-ameri… -
PyTorch
@PyTorch
PyTorch Ambassadors are making a big difference, spanning 21 countries and 5 continents. During the #pytorchcon Europe 2026 Ambassador Meetup, ambassadors met with PyTorch Foundation leadership to share experiences
-
PyTorch reposted
Lysandre
@LysandreJik
Safetensors is joining the @PyTorch Foundation as a foundation-hosted project
It has always been open-source. Going forward, strategy and direction is now open
Now, safetensors has a clear path towards integration in torch core
ML is big, so is making it safe. Come contribute! -
PyTorch
@PyTorch
Normalization methods (LayerNorm/RMSNorm) are foundational in modern deep learning models. We evaluate and improve torch.compile performance for LayerNorm/RMSNorm on NVIDIA H100 and B200 to reach near SOTA performance on a kernel-by-kernel basis, whilst providing automatic fusion capabilities with torch.compile for peak e2e performance.
🔗 Read our latest blog from Shunting Zhang, Paul Zhang, Markus Höhnerbach, Elias Ellison, Jason Ansel, and Natalia Gimelshein: pytorch.org/blog/sota-normalization-performance-with-torc…
Today at PyTorch Conference EU: Lightning Talk: Faster Than SOTA Kernels in Torch.compile With Subgraph Fusions and Custom Op Autotuning - Elias Ellison & Paul Zhang, Meta, 15:40 - 15:50
#pytorch #torchcompile #opensourceai #pytorchcon -
PyTorch
@PyTorch
By optimizing for token efficiency and memory footprints, we unlock a new class of applications that are faster, private, and more accessible. During #pytorchcon EU keynote, Léonard Hussenot, Research Scientist at @GoogleDeepMind explores the philosophy and engineering behind Gemma 4, arguing that the future of AI isn't only about size, but about "intelligence per byte."
-
PyTorch
@PyTorch
As AI moves from frontier labs into mainstream production, the operational challenges start to look increasingly cloud native: orchestration, autoscaling, routing, security, policy, and observability. @jbryce, Executive Director, Cloud and Infrastructure, @linuxfoundation @CloudNativeFdn explores why the next phase of AI adoption will move faster if PyTorch and cloud native communities work together to extend proven open source patterns during #pytorchcon EU keynote
-
PyTorch
@PyTorch
Lysandre Debut, Chief Open-Source Officer, @huggingface speaks about The Hub as Infrastructure: From Open PyTorch Models, to a Safe and Performant Distribution Hub at #pytorchcon Europe
-
PyTorch
@PyTorch
At #pytorchcon EU Artur Niederfahrenhorst, Member of Technical Staff at @anyscalecompute presents the latest updates on @raydistributed
-
PyTorch
@PyTorch
At #pytorchcon Europe, @tms_jr Chief Architect - Inference Engineering at @RedHat presents the latest updates on @vllm_project
-
PyTorch
@PyTorch
PyTorch Foundation Announces Safetensors as Newest Contributed Project to Secure AI Model Execution 👏
As AI model development accelerates, security risks in the production pipeline inherently increase, necessitating secure, high-performance formats that can keep pace with deployment. Safetensors joining the Foundation minimizes security risks associated with model architectures and execution, providing developers with a trusted path to production.
Lysandre Debut of @huggingface shares at #pytorchcon Europe 2026 in Paris
Read more: pytorch.org/blog/pytorch-foundation-announces-safetensors… -
PyTorch
@PyTorch
Kicking off our day at #pytorchcon Europe 2026 @matthew_d_white, Global CTO of AI and CTO at PyTorch Foundation provides an update on technical strategy, ecosystem and projects and working groups.
-
PyTorch
@PyTorch
Big update to #monarch, our distributed programming framework for #pytorch! Since its launch at the #pytorchcon NA in October, the team has shipped Kubernetes support, RDMA on AWS EFA and AMD ROCm, distributed SQL-based telemetry, a terminal UI, and dashboards for live job inspection, an optimized build, and more.
Monarch is designed to make programming a supercomputer feel like writing code on your laptop, and that simplicity extends to AI agents, too. With SQL-queryable distributed state, fast code syncing via RDMA filesystems, and a single Python program controlling the full cluster, agents can (re) launch jobs, debug, and iterate on changes easier than ever. Check out the blog for the full rundown.
Today at PyTorch Conference Europe: Lightning Talk: Monarch: An API To Your Supercomputer - Marius Eriksen, Meta: 10:35 - 10:45 CEST
🔗 Latest blog from the PyTorch Team at @Meta: pytorch.org/blog/monarch-an-api-to-your-supercomputer/
#opensourceai -
PyTorch
@PyTorch
Bienvenue! We're ready for Day 2 of PyTorch Conference Europe #pytorchcon
-
PyTorch
@PyTorch
Today at #pytorchcon Europe 2026 we’re excited to share that ExecuTorch is becoming a part of PyTorch Core. ExecuTorch extends PyTorch functionality for efficient AI inference on edge devices, from desktop/laptop to mobile phones and embedded systems. Learn more:
PyTorch
@PyTorch
At #pytorchcon EU, Mergen Nachin of @Meta discusses bringing ExecuTorch to the next frontiers of Edge AI
-
PyTorch
@PyTorch
The TorchInductor team dives deep on how to generate state-of-the-art matrix multiply kernels with the new CuteDSL backend. Learn more: pytorch.org/blog/gemms-torchinductor-cutedsl-backend/?hss…
-
PyTorch
@PyTorch
Measuring how well models and systems perform in agentic tasks is fragile & difficult to scale across different domains. At #pytorchcon Europe, @besanushi of @NVIDIA discusses the common challenges in reproducing agentic evaluations, including differences in reference implementation, error handling, trajectory post processing, and tooling definitions & best practices that can help alleviate “lightness” and build more consistent measurement pipelines
-
PyTorch
@PyTorch
Open Source AI Unlocks the World's Potential shares Maryam Tahhan and Nicolò Lucchesi of @RedHat at #pytorchcon Europe 2026
-
PyTorch
@PyTorch
Live from #pytorchcon Europe Patrick von Platen of @MistralAI discusses Streaming Everything, how to move from Request input to Streaming input
-
PyTorch
@PyTorch
PyTorch has become the backbone of production AI. From One Node to Distributed Training and Inference, @roaner of @AMD shares how the PyTorch ecosystem changed AI at #pytorchcon Europe
-
PyTorch
@PyTorch
The RL open source ecosystem is exploding 💥 At #pytorchcon EU @joespeez of @reflection_ai, shares how community-led open source RL is reshaping the AI landscape
-
PyTorch
@PyTorch
90% of open source ML projects are using PyTorch explains @ezyang of @Meta who takes the stage at #pytorchcon Europe to share the latest PyTorch updates and what's ahead for the framework from torch.compile to dynamic shapes & beyond
-
PyTorch
@PyTorch
PyTorch Foundation is excited to welcomes Helion as a Foundation-hosted project to standardize open, portable, and accessible AI kernel authoring 🎉
Helion joins the Foundation as AI model development expands from training to an inference boom, elevating the importance of serving models at scale. In this landscape, in which hardware, software, and model architectures are shifting simultaneously, engineering teams face significant hurdles in cross-platform compatibility. Helion eliminates bottlenecks associated with model architectures and execution, providing developers with radically simpler kernels, automated ahead-of-time autotuning, and greater hardware performance portability.
Read more: pytorch.org/blog/pytorch-foundation-welcomes-helion-as-a-…
#pytorchcon -
PyTorch
@PyTorch
Kicking off #pytorchcon Europe with @sparkycollier, Executive Director of @PyTorch Foundation & GM of AI & Infrastructure at @LinuxFoundation! 🎙️ Mark's keynote explores how the open source intelligence stack compounds and what it means for the future of AI infrastructure
-
PyTorch
@PyTorch
It’s here! 💥
#pytorchcon Europe starts TODAY in Paris.
Let’s build, learn, and celebrate the #pytorch community together.
🎟 Join us:
events.linuxfoundation.org/pytorch-conference-europe/regi… -
PyTorch
@PyTorch
Welcome to PyTorch Conference Europe 2026 in Paris! Today's program features keynote sessions from leading voices in AI and practical deep dives on training, inference, GenAI, and focused tracks on responsible AI & compliance, security & privacy, frameworks & compilers, and more.
Share your posts this week using the #pytorchcon hashtag! -
PyTorch
@PyTorch
Early bird registration has been extended! 🐦 Register for #kubecon + #cloudnativecon + #openinfrasummit + #pytorchcon China by 6 May to save up to ¥1270 / USD$179.
Register: www.lfopensource.cn/kubecon-cloudnativecon-openinfra-summ…
Don't forget: The CFP is still open through 3 May: www.lfopensource.cn/kubecon-cloudnativecon-openinfra-summ… -
PyTorch reposted
LightSeek Foundation
@lightseekorg
🚀TorchSpec has been live for 2 weeks — and kimi-k2.5-eagle3 just hit 40K downloads on HuggingFace!
Thanks to @KT_Project_AI Team and @vllm_project Team for the amazing collaboration.
Links in comments. -
PyTorch
@PyTorch
The creator of Diffusers & former core maintainer of Transformers is coming to Paris! 🎨
Patrick von Platen of @MistralAI joins #pytorchcon Europe to discuss scalable #ai systems & his work on vLLM.
📍 Paris | 7-8 April
Learn more: events.linuxfoundation.org/pytorch-conference-europe/prog…
Register: events.linuxfoundation.org/pytorch-conference-europe/regi… -
PyTorch
@PyTorch
🚀 It all starts tomorrow!
#pytorchcon Europe
7–8 April | Paris
Two days of #ml innovation, community & #pytorch breakthroughs. 🎟 It's not too late to join us: events.linuxfoundation.org/pytorch-conference-europe/regi… -
PyTorch
@PyTorch
How do we scale evaluations for agentic #ai? 🤖
@besanushi (Senior AI Research Manager @nvidia) joins #pytorchcon Europe to discuss "The Unbearable Lightness of (Agentic) Evaluations" and the road to consistent measurement pipelines.
📍 Paris | 7-8 April
Learn more: events.linuxfoundation.org/pytorch-conference-europe/prog…
Register: events.linuxfoundation.org/pytorch-conference-europe/regi… -
PyTorch
@PyTorch
Meet Leonard Hussenot, the lead behind the Gemma post-training team at @GoogleDeepMind! 🧠
Don't miss his keynote at #pytorchcon Europe where he will share insights on scaling reinforcement learning and compact models for on-device AI.
📍 Paris | 7-8 April
Explore his session: events.linuxfoundation.org/pytorch-conference-europe/prog…
Register: events.linuxfoundation.org/pytorch-conference-europe/regi… -
PyTorch reposted
Red Hat AI
@RedHat_AI
Red Hat AI is showing up big at #pytorchconeurope, Paris, April 7-8.
Catch us in two keynotes, talks, and sponsor sessions covering @vllm_project, Docling, @openclaw, @_llm_d_, @raydistributed, inference efficiency, agentic AI, and more.
Full schedule: pytorchconferenceeu2026.sched.com?searchstring=red+hat&if… -
PyTorch
@PyTorch
We’re excited to announce the 2026 PyTorch Docathon! May 5-19, refine technical documentation, test tutorials in CI environments, and help accelerate the transition from research to production.
Docathon begins with a live kick-off and Q&A on May 5 at 10 AM PT.
Submissions and feedback run May 6–15, followed by final reviews May 16–18. Winner announcements will be shared on May 20.
Whether you are a seasoned expert or a newcomer familiar with Python, you can contribute to core modules, tutorials, or website issues. Maintainers will be available on the PyTorch Discord to help with tasks labeled by skill level.
🔗 RSVP now: pytorch.org/blog/rsvp-for-the-2026-pytorch-docathon/
#pytorch #opensource #machinelearning #developerdocs #ai -
PyTorch
@PyTorch
🙏 A heartfelt thank you to our #pytorchcon Europe diamond sponsor Meta. Europe's #ai community is converging in Paris 7-8 April for deep dives into GenAI, #agentic systems, infrastructure, & expert keynotes. Register: events.linuxfoundation.org/pytorch-conference-europe/regi… Schedule: events.linuxfoundation.org/pytorch-conference-europe/prog…
-
PyTorch
@PyTorch
🤠 Hats off to our #pytorchcon Europe diamond sponsor Red Hat. Join us for two exciting days in Paris from 7-8 April for keynotes, workshops, & focused tracks on #genai, frameworks, compilers, security, & MORE! Register: events.linuxfoundation.org/pytorch-conference-europe/regi… Schedule: events.linuxfoundation.org/pytorch-conference-europe/prog…
-
PyTorch
@PyTorch
From leading the #pytorch transition to the @linuxfoundation to spearheading the Llama #opensource strategy, Joe Spisak has defined the #ai landscape. 🚀
Join him at #pytorchcon Europe in Paris to discuss the future of collaborative AI!
📍 Paris | 7-8 April
Details: events.linuxfoundation.org/pytorch-conference-europe/prog…
Register: events.linuxfoundation.org/pytorch-conference-europe/regi… -
PyTorch reposted
Label Studio
@HumanSignalHQ
We’re excited to sponsor @PyTorch Conf EU!
Join the Label Studio and #docling teams for drinks & bites to talk all things Open Source AI:
Tuesday, April 7th at 18:30 CEST
Register to attend. Venue is walking distance from Station F on the Seine. luma.com/ya2wihmc -
PyTorch reposted
vLLM
@vllm_project
🎉 Gemma 4 is officially available on vLLM! Byte-for-byte, these are the most capable open models for advanced reasoning and agentic workflows.
Key features include:
- Native Multimodal Support: Full vision and audio capabilities with up to a 256K context window.
- Broad Hardware Support from Day 0: Enabled for major GPU architectures and Google TPUs.
- Openly Accessible: Now live under an Apache 2.0 license.
here's a quick start 👇 - detailed deployment recipe & model release blog coming soon!
#gemma4 #vllm
Google DeepMind
@GoogleDeepMind
Meet Gemma 4: our new family of open models you can run on your own hardware.
Built for advanced reasoning and agentic workflows, we’re releasing them under an Apache 2.0 license. Here’s what’s new 🧵 -
PyTorch reposted
Mark Collier 柯理怀
@sparkycollier
It’s always fun to meet with reporters and have a chance to talk about open source ai and why software like @PyTorch and @vllm_project are essential to making the latest AI hardware (GPUs, etc) sing
PyTorch
@PyTorch
"PyTorch is probably the most important piece of open source software most enterprise technology leaders have never had a governance conversation about. Every GPU launch, every major model release – somewhere in the stack, there it is."
In conversation with Alyx MacQueen (@diginomica) at KubeCon Europe 2026, @sparkycollier detailed why neutral governance is the prerequisite for this level of industry-wide adoption. As specialized hardware enters the market, @PyTorch and @vllm_project serve as the essential layers of enablement that make these options viable for production.
By hosting PyTorch, vLLM, @DeepSpeedAI, and @raydistributed, PyTorch Foundation ensures the industry has a reliable, open path from training to inference.
Hardware Portability: PyTorch enables competition across silicon, including AWS Trainium, Google TPUs, and emerging accelerators.
Neutral Governance: The trademark is held by PyTorch Foundation, not any single company. This provides a contractual guarantee that the license remains open and technical leadership is earned through contribution.
Industry Standard: Every major model ships with PyTorch support on day one. Understanding who governs PyTorch is due diligence for any organization making serious AI infrastructure decisions.
Read the full article @diginomica: diginomica.com/every-gpu-has-work-pytorch-reach-market-so…
#pytorch #opensource #aiinfrastructure #kubecon #vllm #cloudnative -
PyTorch
@PyTorch
"The Hub as Infrastructure: From Open PyTorch Models, to a Safe and Performant Distribution Hub" 🎤
Join Lysandre Debut (Chief OS Officer @huggingface) at #pytorchcon Europe this April! Learn how distribution hubs are revolutionizing the #ml lifecycle.
📍 Paris | 7-8 April
Details: events.linuxfoundation.org/pytorch-conference-europe/prog… -
PyTorch
@PyTorch
PyTorch Foundation is officially opening the Call for Proposals (CFP) for PyTorch Conference North America 2026, held October 20–21 in San Jose, California.
This is the primary technical forum for maintainers, researchers, and engineers to share advancements across the PyTorch ecosystem and hosted projects, including vLLM, DeepSpeed, and Ray. Technical tracks include Core PyTorch, kernel engineering, compilers, distributed training, and inference optimizations.
Deadlines:
June 7: Session CFP Closes
July 20: Speaker Notifications
July 26: Poster Submissions Due
Oct 20–21: PyTorch Conference North America
Register by April 10 at 11:59 PM PDT to secure Super Early Bird discounted rates.
🔗 Details: pytorch.org/blog/call-for-proposals-open-for-pytorch-conf…
#pytorch #opensource #machinelearning #pytorchcon #ai -
PyTorch
@PyTorch
The PyTorch Ecosystem Working Group is happy to welcome several new projects to the PyTorch Ecosystem Landscape, including PhysicsNeMo, Unsloth, ONNX, and KTransformers.
The PyTorch Ecosystem Landscape is a map of the innovative open source AI projects that extend, integrate with, or build upon PyTorch. Welcome to the newest PyTorch Ecosystem Landscape projects!
If you’re developing a project that supports the PyTorch community, you’re welcome to apply for inclusion in the Ecosystem landscape.
🔗 Read the full blog: pytorch.org/blog/pytorch-ecosystem-landscape-q126/
#pytorch #opensource #ai -
PyTorch
@PyTorch
"PyTorch is probably the most important piece of open source software most enterprise technology leaders have never had a governance conversation about. Every GPU launch, every major model release – somewhere in the stack, there it is."
In conversation with Alyx MacQueen (@diginomica) at KubeCon Europe 2026, @sparkycollier detailed why neutral governance is the prerequisite for this level of industry-wide adoption. As specialized hardware enters the market, @PyTorch and @vllm_project serve as the essential layers of enablement that make these options viable for production.
By hosting PyTorch, vLLM, @DeepSpeedAI, and @raydistributed, PyTorch Foundation ensures the industry has a reliable, open path from training to inference.
Hardware Portability: PyTorch enables competition across silicon, including AWS Trainium, Google TPUs, and emerging accelerators.
Neutral Governance: The trademark is held by PyTorch Foundation, not any single company. This provides a contractual guarantee that the license remains open and technical leadership is earned through contribution.
Industry Standard: Every major model ships with PyTorch support on day one. Understanding who governs PyTorch is due diligence for any organization making serious AI infrastructure decisions.
Read the full article @diginomica: diginomica.com/every-gpu-has-work-pytorch-reach-market-so…
#pytorch #opensource #aiinfrastructure #kubecon #vllm #cloudnative -
PyTorch
@PyTorch
🔥 CFP is LIVE for #pytorchcon North America 2026! Submit a talk or poster for Oct 20–21 in San Jose. Topics span training, inference, kernel engineering, responsible AI, & more. Deadlines: June 7 (talks) · July 26 (posters). Learn more + submit: events.linuxfoundation.org/pytorch-conference-north-ameri…
Super early bird reg ends April 10. Save up to $500: events.linuxfoundation.org/pytorch-conference-north-ameri… -
PyTorch
@PyTorch
It was great to see @sparkycollier (Mark Collier) on the keynote stage at #kubecon + #cloudnativecon to discuss how cloud native infrastructure is powering the shift from AI inference to autonomous agents.
It’s clear that CNCF OSS is the backbone of the modern AI landscape.
From Amsterdam to Paris, let’s carry the torch to #pytorchcon Europe, 7-8 April!
Register: events.linuxfoundation.org/pytorch-conference-europe/regi…
#pytorch #ai #cloudnative #opensource #genai -
PyTorch
@PyTorch
#pytorchcon is packed with @AMD engineers this year including joint work with engineers from @Meta and @RedHat. Multiple sessions spanning distributed training, quantization, inference routing, and privacy-preserving fine-tuning — all on ROCm™.
This is what native PyTorch support looks like in practice.
📅 April 07, 2026
📍 Venue: Station F, Paris
Full schedule 👇
events.linuxfoundation.org/pytorch-conference-europe/prog…
#togetherweadvance #rocm #opensource -
PyTorch
@PyTorch
5️⃣ days until #pytorchcon Europe! 🇫🇷 And of course the Flare Party is happening. 🔥 Don't miss the fun: events.linuxfoundation.org/pytorch-conference-europe/feat…
7–8 April | Paris
🎉 Join us: events.linuxfoundation.org/pytorch-conference-europe/regi… -
PyTorch
@PyTorch
Yesterday’s PyTorch 2.11 live Q&A with Nikita Shulga and Andrey Talman, moderated by Chris Gottbrath, covered five major focus areas: FlexAttention with FlashAttention-4, differentiable collectives, MPS operator expansion, RNN/LSTM GPU export support, and hardware backend improvements for AMD and Intel.
A key topic of conversation was the influx of AI-generated code contributions and the specific framework maintainers use to protect repository integrity. Watch the clip below to see the discussion.
Technical Policy on AI Contributions:
1. User owns the code: PyTorch treats the human submitter as the sole owner. Nikita Shulga stated that "User owns the code, not AI system" and maintainers will treat the contribution the same regardless of whether it comes through an AI agent or a person.
2. Called actionable: To preserve maintainer bandwidth, Nikita noted that contributions should focus on issues explicitly "called actionable." High-volume bursts, such as "fifty pull requests in an hour," are considered "disruptive behavior" and subject to temporary account blocks.
3. Test-driven development: PyTorch values "test-driven development." Nikita Shulga noted that if an AI contribution consists of "only fix," contributors will likely receive a comment to "please add a regression test" to verify the change against existing repository test structures.
4. First line of defense: Andrey Talman confirmed that the CI-CD system remains the "first line of defense," finding issues and ensuring code meets stability standards before it is accepted.
Full video: www.youtube.com/live/BW3s3Oxze7Q
#pytorch #opensource #machinelearningThis media couldn't be displayed. See it on the original post. -
PyTorch reposted
Mark Collier 柯理怀
@sparkycollier
Come to #pytorchcon in Paris for the amazing open source AI keynotes and stay for the parties:
Tuesday April 7:
Flare Party 17:05 - 18:30: pytorchconferenceeu2026.sched.com/event/2HDlf/flare-party
Then join the Open Source AI Soirée from 18:30-21:00:
luma.com/ya2wihmc (**RSVP REQUIRED**) -
PyTorch
@PyTorch
🎉 THANK YOU to our #pytorchcon Europe diamond sponsors. Join us in Paris on 7-8 April for two exciting days of technical talks, workshops, & keynotes from the brightest minds in #ai. Register: events.linuxfoundation.org/pytorch-conference-europe/regi… Schedule: events.linuxfoundation.org/pytorch-conference-europe/prog…
-
PyTorch reposted
Google for Developers
@googledevs
🌟 Join the TorchTPU session at #pytorchcon Europe 2026 in Paris on April 7–8. Learn the strategy and roadmap that brings a native @PyTorch experience to TPUs.
The program includes infrastructure, applications, and agent-based systems, with sessions on training, inference, gen AI, responsible AI, security, privacy, and frameworks. -
PyTorch
@PyTorch
🗣 Shoutout to our #pytorchcon Europe gold sponsors. Mark your calendar for 7-8 April in Paris & be part of this historic debut with technical sessions & workshops defining the future of #ai. 🇫🇷 Register: events.linuxfoundation.org/pytorch-conference-europe/regi… Schedule: events.linuxfoundation.org/pytorch-conference-europe/prog…
-
PyTorch
@PyTorch
1️⃣ week until #pytorchcon Europe! 🇫🇷 Paris becomes the home of #pytorch for two days of #ml breakthroughs & community from 7-8 April. Check out schedule: events.linuxfoundation.org/pytorch-conference-europe/prog…. 🎟 Join us! events.linuxfoundation.org/pytorch-conference-europe/regi…
-
PyTorch
@PyTorch
1 week left to save up to ¥1270! 🎟 Register for #kubecon + #cloudnativecon + #openinfrasummit + #pytorchcon China by 7 April for early bird rates.
Plus: Got a talk idea? Submit to the #callforproposals by 3 May!
Details: www.lfopensource.cn/kubecon-cloudnativecon-openinfra-summ… -
PyTorch
@PyTorch
A round of applause for our #pytorchcon Europe silver sponsors. Paris becomes the center of the #ai world on 7-8 April. 🌍 Join us for two days packed with world-class keynotes, workshops, & specialized tracks on modern AI development. Register: events.linuxfoundation.org/pytorch-conference-europe/regi… Schedule: events.linuxfoundation.org/pytorch-conference-europe/prog…
-
PyTorch
@PyTorch
The Training Systems track at #pytorchcon Europe, 7-8 April, explores distributed training, infrastructure optimization & scaling models across modern hardware. Learn more: events.linuxfoundation.org/pytorch-conference-europe/prog…
🎟 Register → events.linuxfoundation.org/pytorch-conference-europe/regi… -
PyTorch
@PyTorch
PyTorch 2.11 features improvements for distributed training and hardware-specific operator support. Join Andrey Talman and Nikita Shulga on Tuesday, March 31st at 10 am for a live update and Q&A.
Topics:
- Differentiable Collectives for Distributed Training
- FlexAttention: Now includes a FlashAttention-4 backend on Hopper and Blackwell GPUs
- MPS (Apple Silicon): Comprehensive operator expansion
- RNN/LSTM GPU Export Support
- XPU Graph
Register: pytorch.org/event/pytorch-2-11-release-live-qa/
#pytorch #opensource #aiinfrastructure -
PyTorch
@PyTorch
NCCL watchdog timeouts are some of the most commonly misunderstood and difficult-to-debug errors in AI training. In the past, PyTorch released Flight Recorder to make debugging these errors easier, but interpreting its outputs has been tricky.
Based on an analysis of countless NCCL watchdog timeouts at Meta, the PyTorch team at Meta has put together a guide on how to effectively use Flight Recorder to debug NCCL watchdog timeouts, and to better understand why they occur (spoiler: it's usually not because of network or NCCL issues).
If you've ever spent hours debugging these errors and are looking for a better solution, this blog post is for you: pytorch.org/blog/flight-recorder-a-new-lens-for-understan…
✍ Yifei Liu, Uttam Thakore, Ph.D., Junjie W., Yongzhong Yang
#pytorch #opensourceai #nccl #flightrecorder -
PyTorch
@PyTorch
GPU MODE (@GPU_MODE) & PyTorch Foundation are organizing an ML systems hackathon in Paris on April 9, immediately following PyTorch Conference Europe 2026.
Researchers and engineers will compete across two tracks:
-Distributed training (LLM speedrun) and inference optimization (leaderboard)
- Access to a B300 cluster from Verda and H200 instances from Sesterce
- Cloud credits as prizes, including 48-hour access to a GB300 NVL72 rack
- Talks from PyTorch (Helion), vLLM, Prime Intellect, and more
- Food and refreshments
Doors open at 9:30, with the closing ceremony at 20:00. Attendees can join with a pre-formed team or match on-site. Location details are shared upon registration.
Spots are limited. Register: luma.com/gpu-mode-paris-2026
#opensourceai #pytorchcon #pytorch #vllm #helion -
PyTorch
@PyTorch
🔐 #ai systems must be secure by design. The Security & Privacy track at #pytorchcon Europe (7-8 April, Paris) explores protecting models, safeguarding data & defending AI systems from emerging threats. Learn more: events.linuxfoundation.org/pytorch-conference-europe/prog…
🎟 Register → events.linuxfoundation.org/pytorch-conference-europe/regi… -
PyTorch
@PyTorch
PyTorch and Nebius have collaborated to speed-up pre-training DeepSeek-V3 (16B & 671B) on 256 NVIDIA B200 GPUs using TorchTitan.
Combining MXFP8 via TorchAO with DeepEP yielded up to 41% faster training throughput over BF16 (with equivalent convergence). Full results and reproducible configs in the blog:
🔗 pytorch.org/blog/enabling-up-to-41-faster-pre-training-mx…
✍ Alireza Shamsoshoara, Matthias Reso, Hamid Shojanazeri, @vega_myhre, Hooman Ramezani
#pytorch #opensourceai #torachao #mxfp8 -
PyTorch
@PyTorch
⚖️ Building #ai responsibly matters. The Responsible AI & Compliance track at #pytorchcon Europe, 7-8 April in Paris, explores governance, fairness, transparency & regulatory considerations in AI development. Learn more: events.linuxfoundation.org/pytorch-conference-europe/prog…
🎟 Join us → events.linuxfoundation.org/pytorch-conference-europe/regi… -
PyTorch
@PyTorch
Ready to take the stage in Shanghai? 🎤 The #callforproposals is taking submissions for #kubecon + #cloudnativecon + #openinfrasummit + #pytorchcon China, 8-9 September! Share your technical breakthroughs in #cloudnative, #ai, or infrastructure.
🗓 Submit by 3 May: -
PyTorch
@PyTorch
Meta, in collaboration with @huggingface and PyTorch Foundation, is launching India’s first OpenEnv AI Hackathon. Participants will build reinforcement learning environments using OpenEnv, contributing directly to how intelligent agents are trained. @Meta
What's in it for developers?
$30,000 prize pool!
Round 1 (Online): March 25 – April 8
Finale (Bangalore): April 25 – 26 (48-hour in-person hackathon at Scaler School of Technology)
Learning resources are provided for those without prior RL experience.
🔗 Register by April 3: pytorch.org/event/openenv-ai-hackathon/
#pytorch #openenv #metaai #huggingface #opensource -
PyTorch
@PyTorch
Today at KubeCon + CloudNativeCon Europe during keynote fireside chat @sparkycollier, PyTorch Foundation ED, explained that the problems we need to solve to deliver open source AI for training, inference and agents require deep expertise across different domains, and those experts work in communities organized by a number of different foundations.
To train and run thousands of models, @Uber relies on PyTorch Foundation projects: @PyTorch, @raydistributed & @vllm_project and runs on @CloudNativeFdn project @kubernetesio and the newest CNCF project, llm-d, is tightly integrated with vLLM
#kubecon #cloudnativecon #pytorch #ray #vllm #kubernetes #cloudnative #opensource
PyTorch
@PyTorch
We have to get out of our silos and tribes that deliver just pieces for users to figure out, and actually do co-design and co-evolve the full stack to deliver what the world needs.
-
PyTorch
@PyTorch
PyTorch 2.11 features improvements for distributed training and hardware-specific operator support. Join Andrey Talman and Nikita Shulga on Tuesday, March 31st at 10 am for a live update and Q&A.
Topics:
- Differentiable Collectives for Distributed Training
- FlexAttention: Now includes a FlashAttention-4 backend on Hopper and Blackwell GPUs
- MPS (Apple Silicon): Comprehensive operator expansion
- RNN/LSTM GPU Export Support
- XPU Graph
Register: pytorch.org/event/pytorch-2-11-release-live-qa/
#pytorch #opensource #aiinfrastructure -
PyTorch
@PyTorch
PyTorch 2.11 is now available, featuring 2,723 commits from 432 contributors since PyTorch 2.10. This release prioritizes performance scaling for distributed training and next-generation hardware architectures.
Highlights include a FlashAttention-4 backend for FlexAttention on Hopper and Blackwell GPUs, Differentiable Collectives for distributed training, and performance optimizations for Intel GPUs via XPU Graph. This release also delivers comprehensive operator expansion for Apple Silicon (MPS) and RNN/LSTM GPU export support.
🖇️ Read the PyTorch 2.11 release blog and release notes: pytorch.org/blog/pytorch-2-11-release-blog/
#pytorch #opensource #aiinfrastructure -
PyTorch
@PyTorch
As AI systems move from training to real-world deployment, 2 forces are rapidly reshaping the landscape: the explosive growth of AI inference & the emergence of agentic AI. Don’t miss the KubeCon + CloudNativeCon Europe 2026 fireside chat tomorrow AM that will explore how the rapidly expanding inference market is driving new infrastructure needs with @addvin - @RedHat, @linsun_unc - @soloio_inc, @jbryce - @linuxfoundation, @sparkycollier - @PyTorch
📅 Tues, March 24
⏰ 09:56 CET
Session details: sched.co/2JHMJ
#opensource #generativeai #kubecon #cloudnativecon #aiinference #agenticai #ai -
PyTorch
@PyTorch
🚀 The Inference & Production track at #pytorchcon Europe (7-8 April in Paris) covers deploying models, optimizing inference pipelines & scaling #ai systems.
Learn more:
events.linuxfoundation.org/pytorch-conference-europe/prog…
🎟 Register →
events.linuxfoundation.org/pytorch-conference-europe/regi… -
PyTorch
@PyTorch
PyTorch 2.10 is now optimized for @Intel Core Ultra Series 3 processors to bring high-performance AI to the PC and edge.
This release leverages the new Xe3 architecture and Arc B-series GPUs to deliver up to 120 XMX TOPs. Native TorchAO integration enables seamless int4 weight-only quantization, allowing a Llama 3.2 3B Instruct model to run locally with a first token latency of 242.29 ms and a 2+ token latency of 27.24 ms. For edge scenarios, developers can achieve 1.4x to 1.7x faster training for vision models via Anomalib, with WinClip seeing gains up to 2.5x compared to previous generations.
Read our latest blog from the Intel PyTorch and Client AI SW teams for the full technical deep dive and benchmarks:
pytorch.org/blog/pytorch-2-10torchao/
#pytorch #intel #aipc #edgeai #opensourceai -
PyTorch
@PyTorch
🚨 Today’s the day! Registration for #pytorchcon Europe increases €100 TONIGHT after 23:59 CET.
Join us 7-8 April in Paris. 🎟 Grab your pass: events.linuxfoundation.org/pytorch-conference-europe/regi… -
PyTorch
@PyTorch
We’re excited to introduce TorchSpec, a torch-native framework for scalable speculative decoding training developed by the TorchSpec and Mooncake teams.
By streaming hidden states from inference engines to training workers via Mooncake, TorchSpec enables fully disaggregated pipelines where inference and training scale independently.
🔗 Read our latest blog from TorchSpec & Mooncake teams: pytorch.org/blog/torchspec-speculative-decoding-training-…
@lightseekorg @KT_Project_AI
#pytorch #torchspec #mooncake #opensourceai -
PyTorch
@PyTorch
Want to build differentiable computational physics Code leveraging AI?
NVIDIA Warp is a framework for accelerated simulation, data generation, and spatial computing that bridges CUDA and Python. Warp enables developers to write high-performance kernels as regular Python functions that are JIT-compiled into efficient code for execution on the GPU.
Warp can be easily made differentiable through the Warp native support for automatic differentiation. Straightforward to integrate with optimization or training workflows while remaining interoperable with frameworks like PyTorch, JAX, and NumPy.
🖇️ Read the full post:
developer.nvidia.com/blog/build-accelerated-differentiabl…
#pytorch #opensourceai #ai #inference #innovation -
PyTorch
@PyTorch
Heading to #nvidiagtc next week? Let’s talk @PyTorch. 🚀
We’re bringing the community to San Jose. Drop by Booth #338 to meet expert developers and core maintainers in person.
Scaling, inference, foundation models, and OSS contributions.
Full schedule below 👇 #pytorch
PyTorch
@PyTorch
🗓️ Plan your week: Check out the full "Meet the PyTorch Experts" schedule here: pytorch.org/event/nvidia-gtc-ai-conference/
We'll be posting the daily lineups here in this thread all week. See you at the booth! 🤝 @NVIDIADev
PyTorch
@PyTorch
🗓️ MONDAY @ Booth #338
2PM: Shaping the Future w/ @matthew_d_white 3PM: TensorRT + PyTorch w/ Angela Yi & @narendasan 4PM: DeepSpeed Trillion-Param Training w/ @PKUWZP 5PM: PyTorch Export w/ Angela Yi 6PM: Ray Distributed Computing w/ @robertnishihara
#ai #gtc2025Post not available here, view on X
PyTorch
@PyTorch
1PM: Join the Ecosystem w/ Alban Desmaison 2PM: Start Contributing w/ Alban 3PM: CuteDSL CUDA Kernels w/ Vicki Wang, Manas Sahni 4PM: SGLang Inference w/ Baizhou Zhang, Hao Lu 5PM: Monarch Framework w/ Ali Sol, Saurabh Mishra 6PM: TorchComms w/ Davide Italiano, Matthias Reso
PyTorch
@PyTorch
1PM: Custom GPU Kernels w/ Triton & TLX w/ Cicie Wang, Hongtao Yu, Manman Ren, Nick Riasanovsky, Shane Nay, Yueming Hao
Last chance to connect with the community! 🧡 -
PyTorch reposted
vLLM
@vllm_project
Great to see @AMD select vLLM as one of the designated inference frameworks for the GPU MODE Hackathon. 🎉
The challenge: push Kimi K2.5 1T FP4 end-to-end inference performance on 8× AMD Instinct MI355X — using vLLM or AMD ATOM. Grand prize: $650,000.
What makes this different: winning optimizations must be mergeable into AMD ATOM or vLLM upstream. Improvements that land in vLLM benefit the whole community.
Phase 1 (kernel optimization) runs through April 6.
More details ⬇️
AMD
@AMD
Join the GPU MODE Hackathon, sponsored by AMD, and push the boundaries of LLM inference performance on leading open models, optimized for AMD Instinct MI355X GPUs.
Finalists will compete for the $1.1M total cash prize pool across two independent tracks, each focused on a specific model and inference stack.
Learn more and get registered here: luma.com/cqq4mojz -
PyTorch
@PyTorch
⏰ Last call! Registration for #pytorchcon Europe, 7-8 April in Paris, goes up €100 tomorrow at 23:59 CET. 🪧 Don't miss a thing - check out the Poster Presentations: events.linuxfoundation.org/pytorch-conference-europe/feat… 🎟 Register now: events.linuxfoundation.org/pytorch-conference-europe/regi…
-
PyTorch
@PyTorch
We’re excited to share Generalized Dot-Product Attention (GDPA) — a production-driven attention kernel designed specifically for large-scale recommendation systems (RecSys).
Proposed in our recent paper, GDPA replaces softmax with a flexible activation tailored for real-world RecSys traffic patterns and has been deployed in Meta’s largest recommendation model, GEM.
🔗 Read our latest blog: pytorch.org/blog/generalized-dot-product-attention-tackli…
By redesigning attention around production characteristics rather than benchmark assumptions, GDPA achieves 2× forward speedup (1,145 BF16 TFLOPs, ~97% tensor core utilization), 1.6× backward speedup, and up to 3.5× forward speedup vs. FA4 under short K/V settings on NVIDIA B200.
This work demonstrates how real production traffic can fundamentally reshape kernel design.
✍ Jiaqi Xu, Han Xu, Junqing Zhou, Devashish Shankar, Xiaoyi (Leo) Liu, Shuqi Yang
#pytorch #opensourceai #gdpa #gem -
PyTorch
@PyTorch
3️⃣ days left before rates rise! Registration for #pytorchcon Europe increases €100 after 20 March.
🐦 Join us in Paris, 7-8 April, where you'll find friends with shared interest at BoFs:
events.linuxfoundation.org/pytorch-conference-europe/feat…
🎟 Register: events.linuxfoundation.org/pytorch-conference-europe/regi… -
PyTorch
@PyTorch
#executorch addresses fragmented native deployment for #ai agents as a #pytorch native platform. It enables voice models across CPU, GPU, and NPU on Android, iOS, Linux, macOS & Windows
🔗 pytorch.org/blog/building-voice-agents-with-executorch-a-… -
PyTorch
@PyTorch
🚀 Put your brand in front of the #pytorch community. Sponsor #pytorchcon Europe, 7–8 April in Paris, and connect with the researchers, engineers & #ml leaders building the next generation of #ai.
Showcase your tech. Meet top talent. Build real partnerships. 🤝 Explore opportunities: events.linuxfoundation.org/pytorch-conference-europe/spon… -
PyTorch
@PyTorch
The #genai & Multimodal track at #pytorchcon Europe explores building & scaling generative & multimodal models using #pytorch. Learn more: events.linuxfoundation.org/pytorch-conference-europe/prog…
🎟 Register → events.linuxfoundation.org/pytorch-conference-europe/regi… -
PyTorch
@PyTorch
Before we head to Paris for PyTorch Conference EU 2026, we’re looking back on PyTorch Conference 2025 keynotes from visionary AI leaders in our community.
We’re starting with Eli Uriegas (@_seemethere) from Meta on testing PyTorch at scale: 11,000 commits and 794 million minutes of CI/CD compute in 2025 alone. This session recognizes the partners working across competitive lines to keep the ecosystem stable for everyone.
Watch the full keynote: youtu.be/xWjXsP1E5mQ
See you in Paris: pytorch.org/event/pytorch-conference-europe/
#pytorch #opensourceai #pytorchconf -
PyTorch reposted
vLLM
@vllm_project
🎉 Congrats to @nvidia on the release of Nemotron 3 Super — day-0 support in vLLM v0.17.1! Verified on NVIDIA GPUs.
120B hybrid MoE, only 12B active at inference. Big upgrades over the previous Nemotron Super:
- 5x higher throughput
- 2x higher accuracy on Artificial Analysis Intelligence Index
- Multi-Token Prediction (MTP) for faster long-form generation
- Configurable thinking budget — dial accuracy vs token cost per task
- 1M token context window
Supports BF16, FP8, and NVFP4. Fully open: weights, datasets, recipes.
Blog: vllm.ai/blog/nemotron-3-super
🤝 Thanks @NVIDIAAIDev Nemotron team and vLLM community contributors!
NVIDIA AI Developer
@NVIDIAAIDev
Introducing NVIDIA Nemotron 3 Super 🎉
Open 120B-parameter (12B active) hybrid Mamba-Transformer MoE model
Native 1M-token context
Built for compute-efficient, high-accuracy multi-agent applications
Plus, fully open weights, datasets and recipes for easy customization and deployment. 🧵 -
PyTorch
@PyTorch
MXFP8 training for MoEs on GB200s enables a 1.3x speedup with equivalent convergence versus BF16. This #pytorch update via TorchAO and TorchTitan on Crusoe Cloud details gains from dynamically quantized grouped GEMMs. #ai #opensource
🔗 pytorch.org/blog/mxfp8-training-for-moes-1-3x-training-sp…
✍️ @vega_myhre, @_xmfan, @drisspg, Chinmay Baikar -
PyTorch
@PyTorch
Community matters. ❤️
Join the Women & Non-Binary in #pytorch Lunch at #pytorchcon Europe, 7-8 April, in Paris. 🍽️ Learn more: events.linuxfoundation.org/pytorch-conference-europe/feat…
⏳ Registration goes up €100 on 20 March. 🎟 Get your pass now! events.linuxfoundation.org/pytorch-conference-europe/regi… -
PyTorch
@PyTorch
🇨🇳 Registration is open for #kubecon + #cloudnativecon + #openinfrasummit + #pytorchcon China, 8-9 September in Shanghai!
🎟 Register by 7 April + save up to ¥1270: www.lfopensource.cn/kubecon-cloudnativecon-openinfra-summ….
🎤 Got insights to share? Submit a talk by 3 May: www.lfopensource.cn/kubecon-cloudnativecon-openinfra-summ… -
PyTorch reposted
Mark Collier 柯理怀
@sparkycollier
Let’s meet up in Paris April 7-8 to talk @PyTorch, @vllm_project , @DeepSpeedAI, @raydistributed and the full stack of open source for training, inference, and agents
Sponsor info: events.linuxfoundation.org/pytorch-conference-europe/spon…
PyTorch
@PyTorch
💡 The Applications & Case Studies track at #pytorchcon Europe, 7-8 April in Paris, showcases production deployments, lessons learned & innovative use cases across industries. Learn more: events.linuxfoundation.org/pytorch-conference-europe/prog…
🎟 Register: events.linuxfoundation.org/pytorch-conference-europe/regi… -
PyTorch
@PyTorch
PyTorch Day India 2026 was a builder-focused milestone for open source AI in Bengaluru. Hosted by the @PyTorch Foundation, @IBM, @nvidia, & @RedHat, it provided an unparalleled platform for technical talks and interactive discussions designed to foster knowledge exchange & collaboration with 460 in-person attendees. View the video highlights ▶️ www.youtube.com/watch?hss_channel=tw-776585502606721024&v… #pytorchdayindia
-
PyTorch
@PyTorch
🚀 Put your brand in front of the #pytorch community. Sponsor #pytorchcon Europe, 7–8 April in Paris, and connect with the researchers, engineers & #ml leaders building the next generation of #ai.
Showcase your tech. Meet top talent. Build real partnerships. 🤝 Explore opportunities: events.linuxfoundation.org/pytorch-conference-europe/spon… -
PyTorch
@PyTorch
⚙️ The Frameworks & Compilers track at #pytorchcon Europe, Paris 7-8 April, dives into #pytorch internals, compiler innovations & tools that accelerate #ml workloads. Learn more: events.linuxfoundation.org/pytorch-conference-europe/prog…
🎟 Register: events.linuxfoundation.org/pytorch-conference-europe/regi… -
PyTorch
@PyTorch
PyTorch is heading to @NVIDIA #gtc26 in San Jose next week!
📍 Visit us at Booth #338 for:
✨ Helion kernel authoring demos
✨ ExecuTorch on-device inference
✨ Meet PyTorch core maintainers & experts
Plus talks, hands-on labs & a hackathon!
🔗 pytorch.org/blog/pytorch-at-nvidia-gtc-2026/?hss_channel=… -
PyTorch
@PyTorch
💡 The Applications & Case Studies track at #pytorchcon Europe, 7-8 April in Paris, showcases production deployments, lessons learned & innovative use cases across industries. Learn more: events.linuxfoundation.org/pytorch-conference-europe/prog…
🎟 Register: events.linuxfoundation.org/pytorch-conference-europe/regi… -
PyTorch
@PyTorch
Building on the previous correctness-focused pipeline, KernelAgent can now integrate GPU hardware-performance signals into a closed-loop multi-agent workflow to guide the optimization for Triton Kernels. Learn more: pytorch.org/blog/kernelagent-hardware-guided-gpu-kernel-o… @KaimingCheng @marksaroufim
-
PyTorch
@PyTorch
Great to see!
Raghu Ganti
@RaghuGanti
We just published our 1H 2026 roadmap (dev-discuss.pytorch.org/t/ibm-spyre-accelerator-pytorch-e…) and an accompanying blog (research.ibm.com/blog/pytorch-support-ibm-spyre) for enabling the IBM's Spyre accelerator in PyTorch — ecosystem-first, building on torch.inductor, vLLM, and contributing back (Dataflow accelerator's Tile IR, OpenReg, out-of-tree CI).
While the market debates whether AI disrupts legacy tech, we're busy building the accelerator infrastructure that enterprise AI runs on.
We're sharing this journey in the open. Come see our talks on extending torch.inductor for dataflow accelerators and Spyre's vLLM integration at the inaugural PyTorch Conference Europe in Paris, April 7–8!
@PyTorch @IBMResearch @IBM @RedHat_AI -
PyTorch
@PyTorch
🤖 The Agents & Interop track at #pytorchcon Europe, 7-8 April in Paris, explores building agentic workflows, tool integrations & interoperability across models, frameworks & infrastructure. Learn more: events.linuxfoundation.org/pytorch-conference-europe/prog…
🎟 Register: events.linuxfoundation.org/pytorch-conference-europe/regi… -
PyTorch
@PyTorch
Want to prototype Multimodal VLM with Kimi K2.5 on GPU-accelerated endpoints?
NVIDIA NeMo AutoModel is a PyTorch distributed native training library within the NeMo Framework that provides a lightweight and flexible tool for developers and researchers to do rapid experimentation on the latest frontier models.
🔗 Read the full post:
developer.nvidia.com/blog/build-with-kimi-k2-5-multimodal…
#pytorch #opensourceai #ai #inference #innovation -
PyTorch
@PyTorch
FlexAttention now has a FlashAttention-4 backend.
FlexAttention has enabled researchers to rapidly prototype custom attention variants—with 1000+ repos adopting it and dozens of papers citing it.
But users consistently hit a performance ceiling. Until now.
We've added a FlashAttention-4 backend to FlexAttention on Hopper and Blackwell GPUs. PyTorch now auto-generates CuTeDSL score/mask modifications and JIT-instantiates FlashAttention-4 for your custom attention variant.
The result: 1.2× to 3.2× speedups over Triton on compute-bound workloads.
🖇️ Read our latest blog here: pytorch.org/blog/flexattention-flashattention-4-fast-and-…
No more choosing between flexibility and performance.
hashtag#PyTorch hashtag#FlexAttention hashtag#FlashAttention hashtag#OpenSourceAI -
PyTorch
@PyTorch
PyTorch at the micro-edge? Yes.
See how ExecuTorch brings PyTorch models to Arm microcontrollers—quantized, compiled, and running on a Corstone-320 + Ethos-U NPU (via FVP). 🔗 pytorch.org/blog/deploying-pytorch-models-to-the-micro-ed…
From training to deployment, end to end.
#pytorch #executorch #edgeai #tinyml #arm -
PyTorch
@PyTorch
💡 Share ideas. Build models. Meet the community.
#pytorchcon Europe
7–8 April | Paris
💰 Rates increase €100 after 20 March. 🎟 events.linuxfoundation.org/pytorch-conference-europe/regi…
🎓 Less than a week left to apply for a scholarship: events.linuxfoundation.org/pytorch-conference-europe/atte… -
PyTorch
@PyTorch
Got #cloudnative, #openinfra, or #pytorch insights to share? 🎤
Take the stage at #kubecon + #cloudnativecon + #openinfrasummit + #pytorchcon China. Topics span #ai, infrastructure, #kubernetes, #ml systems, #opensource leadership & more.
🗓 Submit your proposal by 3 May. 👉 www.lfopensource.cn/kubecon-cloudnativecon-openinfra-summ… -
PyTorch
@PyTorch
Recover more than 70% accuracy degradation from 4-bit quantization using TorchAO’s (github.com/pytorch/ao?hss_channel=tw-776585502606721024) Quantization-Aware Training (QAT), now available through fine-tuning in Unsloth and Axolotl!
Following the previous TorchAO QAT blog(pytorch.org/blog/quantization-aware-training/?hss_channel…), the PyTorch team at @Meta extended the TorchAO QAT flow to support an end-to-end GPU server flow, targeting fast CUDA kernels for fast inference in @vllm_project, and integrated this flow into popular fine-tuning frameworks like Unsloth and Axolotl.
Read our latest blog: pytorch.org/blog/quantization-aware-training-in-torchao-i…
#pytorch #vllm #opensourceai #torchao -
PyTorch
@PyTorch
⏰ Clock’s ticking!
Registration for #pytorchcon Europe goes up €100 after 20 March.
Also less than a week left to RSVP for onsite child care 👶
7–8 April | Paris
🎟 Register: events.linuxfoundation.org/pytorch-conference-europe/regi…
👶 Child care info: events.linuxfoundation.org/pytorch-conference-europe/atte… -
PyTorch
@PyTorch
#pytorch trains the models that power AI agents. This @openinfradev Live episode on March 5th at 10 AM CT is about securing the environments those agents run in
OpenInfra Foundation
@openinfradev
How can we securelty contain #ai?. In this live discussion, experts will explore why traditional container isolation falls short for agent-based systems & what changes when agents have persistent memory, filesystem access, GPUs, or external execution authority
-
PyTorch reposted
Cerebral Valley
@cerebral_valley
Do you want to demo your project at the Meta booth during GTC? 😎
Join @Meta and @nvidia, in partnership with CV, for a full-day hackathon at @SHACK15sf, writing high-performance GPU kernels with Helion, PyTorch's new kernel authoring DSL that delivers higher performance in fewer lines of code with autotuning.
📅 March 14th — Right before NVIDIA GTC. The perfect warm-up.
🏆 Prizes & perks:
> Nvidia GPUs and Nvidia DGX Spark
> Demo your project at the Meta booth during GTC
> GTC conference passes
> Ray-Ban Meta glasses
> Mentoring from Meta AI researchers & NVIDIA engineers
📍 Fully in-person | Teams of up to 4 | Rolling review, limited spots
Register below 👇 -
PyTorch
@PyTorch
New to the PyTorch Ecosystem Landscape: Kubetorch.
Kubetorch enables ML research and development on Kubernetes across training, inference, RL, evals, data processing, and more, in a simple and unopinionated package.
Learn more: pytorch.org/blog/kubetorch-joins-the-pytorch-ecosystem-la…
#pytorch #kubernetes #mlops #aiinfrastructure -
PyTorch
@PyTorch
Are you tired of hand-tuning each model you develop?
What if you could describe the architecture once and let a system apply graph transformations and optimized kernels?
NVIDIA TensorRT LLM AutoDeploy marks a shift toward approaching inference optimization as a compiler and runtime responsibility rather than a burden on the model author. This approach enables faster experimentation, broader model coverage, and a cleaner separation between model design and deployment.
Learn more from our documentation, examples scripts, and the blog, ‘Automating Inference Optimizations with NVIDIA TensorRT LLM AutoDeploy’
Read the full post: developer.nvidia.com/blog/automating-inference-optimizati…
#pytorch #opensourceai #ai #inference #innovation -
PyTorch
@PyTorch
Our February PyTorch Foundation newsletter is live:
Inside: leadership and membership announcements, live schedule for PyTorch Conference Europe 2026 in Paris, a recap of PyTorch Day India 2026, ambassador highlights, and recent technical blogs from across the ecosystem.
📨 Subscribe for updates delivered directly to your inbox: pytorch.org/newsletter/?hss_channel=tw-776585502606721024
👉 Read: pytorch.org/newsletter/february-2026/?hss_channel=tw-7765…
#pytorch #pytorchcon #aiinfrastructure #opensourcea -
PyTorch
@PyTorch
⏰ Final hours. Early bird rates for #pytorchcon Europe end TODAY at 23:59 CET.
Join us 7-8 April in Paris. Technical sessions, poster presentations, community expo, and the Flare Party. 🔥
Schedule: events.linuxfoundation.org/pytorch-conference-europe/prog…
Register: events.linuxfoundation.org/pytorch-conference-europe/regi… -
PyTorch
@PyTorch
🚨 Prices for #pytorchcon Europe go up tomorrow, 27 Feb at 23:59 CET!
Register for just €449 and join us from 7-8 April in Paris. Two days of #genai, large-scale training, performance engineering, and real-world #pytorch deployments.
Secure your pass now! -
PyTorch
@PyTorch
Matt White will speak at Dubai AI Festival, joining a panel discussion on who powers the global AI infrastructure.
The session brings together leaders shaping the systems, platforms, and governance models that underpin AI at scale. As General Manager of AI at Linux Foundation, Matt will share perspectives from the open ecosystem driving AI development and deployment worldwide.
📍 Dubai World Trade Centre
📅 April 7–8, 2026
🔗 Learn more: dubaiaifestival.com?hss_channel=tw-776585502606721024
#pytorch #aiinfrastructure #opensourceai -
PyTorch
@PyTorch
New @DeepSpeedAI updates make large-scale multimodal training simpler and more memory-efficient.
Our latest blog introduces a PyTorch-identical backward API that helps code multimodal training loops easy, plus low-precision model states (BF16/FP16) that can reduce peak memory by up to 40% when combined with torch.autocast.
🖇️ Read the full post for details: pytorch.org/blog/enhancing-multimodal-training-and-memory…
#deepspeed #pytorch #memoryefficiency #multimodaltraining #opensourceai -
PyTorch reposted
Cerebral Valley
@cerebral_valley
🚀 Announcing the @PyTorch OpenEnv Hackathon with CV and @SHACK15sf
Build RL environments, post-train models, and tackle 5 major RL + agentic orchestration challenges
💰 $100K+ cash in prizes
👥 Teams up to 4
📍 In-person in San Francisco
Top judges, mentors, and speakers from: @Meta @huggingface @UCBerkeley @UnslothAI @fleet_ai @SnorkelAI @PatronusAI @mercor @HalluminateAI @scale_AI @CoreWeave @OpenPipeAI @northflank @cursor_ai and Scaler AI Labs
Register below 👇 -
PyTorch
@PyTorch
⏳ 3 days left to save! Spend only €449 on your #pytorchcon Europe ticket if you regsiter by 27 February. Join researchers, developers, and #ai engineers from 7-8 April in Paris and help shape #pytorch in production.
Schedule: events.linuxfoundation.org/pytorch-conference-europe/prog…
Register: -
PyTorch
@PyTorch
The CFP is live 🎤
Speak at #kubecon + #cloudnativecon + #openinfrasummit + #pytorchcon China 2026, happening 8-9 September in Shanghai.
Got insights on #cloudnative, #ai, infra, or #opensource? Submit by 3 May.
Apply now: www.lfopensource.cn/kubecon-cloudnativecon-openinfra-summ… -
PyTorch
@PyTorch
PyTorch Foundation Announces New Members as Agentic AI Demand Grows
We welcomed nine new members since December 2025, adding five Silver and four Associate organizations spanning AI startups, leading universities, and global governments.
New Silver members include Clockwork Systems, Inc., Emmi AI, National IT Industry Promotion Agency, @nota_ai, and yasp. New Associate members include @CarnegieMellon, CommonAI CIC, Monash University, and @uniofleicester.
Membership growth underscores rising demand for open, community-driven, production-ready AI tooling as agentic AI accelerates, strengthening the ecosystem around PyTorch Foundation projects, including PyTorch, @vllm_project, @DeepSpeedAI, and @raydistributed.
“From training frameworks like PyTorch and optimization systems like DeepSpeed that create capabilities such as advanced tool calling, to inference engines and orchestration layers like vLLM and Ray that operationalize them, the Foundation hosts critical layers of the open source AI stack. The growth of our membership reflects a shared recognition that these capabilities must be built collaboratively in a vendor-neutral environment.”
– Mark Collier (@sparkycollier), GM of AI at The Linux Foundation and Executive Director of the PyTorch Foundation
🔗 Read the full announcement: pytorch.org/blog/pytorch-foundation-announces-new-members…
#pytorch #aiinfrastructure #opensourceai -
PyTorch
@PyTorch
Helion's autotuner has been a powerful tool for optimizing ML kernels, but it came with a challenge: long autotuning sessions that could take 10+ minutes, sometimes even hours. The PyTorch team at Meta set out to solve this bottleneck using machine learning itself
🖇️ Read here how they did it: pytorch.org/blog/accelerating-autotuning-in-helion/?hss_c…
Spoiler alert: Using Likelihood-Free Bayesian Optimization Pattern Search, they achieved a 36.5% reduction in autotuning time for NVIDIA B200 kernels while improving kernel latency by 2.6%. For AMD MI350 kernels, they saw a 25.9% time reduction with 1.7% better latency. Some kernels showed even more dramatic improvements—up to 50% faster autotuning and >15% latency gains.
✍️ Ethan Che, Oguz Ulgen, Maximilian Balandat, Jongsok Choi, Jason Ansel (Meta)
#pytorch #helion #machinelearning #bayesianoptimization #opensourceai #performance -
PyTorch
@PyTorch
⏰ 5 days left! Early bird pricing for #pytorchcon Europe ends 27 February. Save €200 when you register now.
ICYMI the schedule is live! Start planning your 7-8 April in Paris: events.linuxfoundation.org/pytorch-conference-europe/prog…
Register: events.linuxfoundation.org/pytorch-conference-europe/regi… -
PyTorch
@PyTorch
Trying to tune your Expert Parallel (EP) communication for hyperscale mixture-of-experts (MoE) models?
This post, ‘Optimizing Communication for Mixture-of-Experts Training with Hybrid Expert Parallel’, details an efficient MoE EP communication solution, Hybrid-EP, and its use in the NVIDIA Megatron family of frameworks, on NVIDIA Quantum InfiniBand and NVIDIA Spectrum-X Ethernet platforms. It also dives into the effectiveness of Hybrid-EP in real-world model training.
Read the full post:
developer.nvidia.com/blog/optimizing-communication-for-mi…
#pytorch #opensourceai #ai #inference #innovation -
PyTorch
@PyTorch
The schedule for #pytorchcon Europe is live! 💥
Join us 7-8 April in Paris for 2 days of research breakthroughs, production #ai & #pytorch ecosystem innovation.
Explore the full agenda: events.linuxfoundation.org/pytorch-conference-europe/prog…
Secure your pass today: events.linuxfoundation.org/pytorch-conference-europe/regi… -
PyTorch
@PyTorch
Agentic RL and Environments with @matthew_d_white, @bhutanisanyam1 (@Meta), @danielhanchen (@UnslothAI), @ben_burtenshaw (@huggingface), and @joespeez (@Meta).
Notebook-first RL environment workflows using OpenEnv, @vllm_project /Llama flows, and Hugging Face Hub submission, plus a walkthrough of torchtitan and torchforge. Virtual workshop with live Q&A.
🔗 Tomorrow, 10am PT: luma.com/e9s47x0q?hss_channel=tw-776585502606721024
#pytorch #opensourceai #agenticai -
PyTorch
@PyTorch
PyTorch Day India 2026 session recordings are now available.
On February 7, 460 builders gathered in Bengaluru for a full day of technical talks focused on kernels, compilers, inference, and production-grade AI systems. Co-hosted by IBM, NVIDIA, Red Hat, and PyTorch Foundation, the event highlighted heterogeneous compute, platform stability, and end-to-end performance from edge to data center.
🔗 Full event playlist: www.youtube.com/playlist?list=PL_lsbAsL_o2C8ncbPwxdpKh32P…
#pytorch #aiinfrastructure #opensource -
PyTorch
@PyTorch
Matt White (@matthew_d_white) will speak at #nearcon 2026 in San Francisco, Feb 23–24.
Autonomous Systems In Practice examines how #autonomousystems are built, evaluated, constrained, secured, and made reliable beyond demos. Mon, Feb 23, 11:20–11:50 AM PT.
With Sergey Astretsov (@sergeiest), @near_ai; Nalin Mittal, @Google; Noëlle Becker Moreno (@1stNoL), @@edgeandnode.
Agenda: nearcon.org/agenda?hss_channel=tw-776585502606721024 -
PyTorch
@PyTorch
Train smarter. 🦾 Deploy faster. 💨 Eat better croissants. 🥐
Early bird pricing for #pytorchcon Europe saves you €200 if you register by 27 February.
See you in Paris, 7-8 April.
👉 events.linuxfoundation.org/pytorch-conference-europe/regi… -
PyTorch
@PyTorch
Do you want to accelerate your AI Physics Development?
If you are ascientific machine learning (SciML) developer, a Physics AI researcher, or an AI practitioner, NVIDIA PhysicsNeMo is a powerful tool in your arsenal to ease and extend your PyTorch stack. Instead of building everything from scratch, you can import PhysicsNeMo modules to develop enterprise scale Physics AI solutions with unprecedented speed and simplicity.
Learn more with our tutorial blog, ‘Accelerating AI Physics development with PyTorch and PhysicsNeMo’.
🖇️ Read the full post:
nvidia.github.io/physicsnemo/blog/2025/09/22/accelerate-a…
#pytorch #opensourceai #ai #inference #innovation -
PyTorch
@PyTorch
Your models deserve a Parisian vacation. 🥐🤖
Join #pytorchcon Europe, 7-8 April, and save €200 with early bird pricing by 27 February.
Talks, demos & real lessons from the #pytorch community.
Register now 👉 events.linuxfoundation.org/pytorch-conference-europe/?hss… -
PyTorch reposted
vincent sunn chen
@vincentsunnchen
Our ability to measure AI has been outpaced by our ability to develop it, and this evaluation gap is one of the most important problems in AI.
Today we're launching Open Benchmarks Grants — a $3M commitment to fund open benchmarks for frontier AI and close the evaluation gap.
Grateful to be partnering with @HuggingFace, @togethercompute, @PrimeIntellect, Factory HQ, @harborframework, and @PyTorch to back the teams building these benchmarks! 🚀
vincent sunn chen
@vincentsunnchen
-
PyTorch
@PyTorch
We’re excited to welcome Mooncake to the PyTorch Ecosystem!
Mooncake is designed to solve the “memory wall” in LLM serving. By integrating Mooncake’s high performance KVCache transfer and storage capabilities with PyTorch native inference engines like SGLang, vLLM, and TensorRT-LLM, it unlocks new levels of throughput and scalability for large language model deployments.
Mooncake enables prefill decode disaggregation, global KVCache reuse, elastic expert parallelism, and serves as a fault tolerant PyTorch distributed backend.
🔗 pytorch.org/blog/mooncake-joins-pytorch-ecosystem/?hss_ch…
#pytorch #opensourceai #llm #aiinfrastructure -
PyTorch
@PyTorch
PyTorch now uses Pyrefly for type checking across the core repository, along with Helion, TorchTitan, and Ignite. The migration replaces MyPy across IDE, CLI, and CI environments.
In recent benchmarking, type checking PyTorch took 50.6 seconds using MyPy and 5.5 seconds using Pyrefly (v44.1). The transition also introduces a single unified configuration, improves consistency across development environments, and has already led to the discovery and resolution of bugs in the codebase.
🔗 Read more in the latest blog from PyTorch and Pyrefly Teams at Meta: pytorch.org/blog/pyrefly-now-type-checks-pytorch/?hss_cha…
#pytorch #opensource #aiinfrastructure -
PyTorch
@PyTorch
Need a cleaner, easy-to-use, and scalable sparse tensor ecosystem that facilitates the introduction of novel storage schemes without explicit coding, and including PyTorch operability?
The Universal Sparse Tensor (UST) decouples a tensor’s sparsity from its memory storage representation. The UST uses a domain-specific language (DSL) to describe how a tensor should be represented in memory.
Learn more about how developers can use the UST to define sparse storage formats, each tailored to specific properties of the sparse tensors that occur in their application.
🖇️ Read the full post: developer.nvidia.com/blog/establishing-a-scalable-sparse-…
#pytorch #opensourceai #ai #inference #innovation -
PyTorch
@PyTorch
Mark Collier (@sparkycollier) joins PyTorch Foundation as Executive Director and outlines his commitment to serving the communities behind foundational technologies in AI, including PyTorch, @vllm_project, @DeepSpeedAI, and @raydistributed.
“Training. Inference. Orchestration. The critical layers of the AI stack live under one roof,” Mark writes.
He sets a clear priority: serve the communities that call this foundation home and keep the path open for the widest possible participation and impact.
🔗 Read Mark’s announcement: pytorch.org/blog/why-im-joining-the-pytorch-foundation/?h…
#pytorch #aiinfrastructure #opensource -
PyTorch
@PyTorch
Over the past two years, PyTorch Foundation has evolved into an umbrella foundation hosting PyTorch, @vllm_project, @DeepSpeedAI & @raydistributed, with expanded governance, global programs, and production-grade infrastructure supporting open source AI at scale.
Under Matt White’s (@matthew_d_white) leadership as Executive Director, PyTorch Foundation strengthened cross-project technical coordination, scaled international conferences and community programs, and advanced multi-cloud CI. Now, our leadership structure is evolving: Matt will serve as CTO of PyTorch Foundation, alongside his role as Global CTO of AI at Linux Foundation. Mark Collier (@sparkycollier) joins as Executive Director of PyTorch Foundation.
“As the scope grows, there is a straightforward operational reality: leadership capacity must scale so that organizational throughput, not leadership bandwidth, sets our pace,” writes Matt.
🖇️ Read Matt’s full announcement: pytorch.org/blog/pytorch-foundation-the-next-chapter-toge…
#pytorch #aiinfrastructure #opensource -
PyTorch
@PyTorch
Paris in April. #pytorch on stage. 🗼🔥
Save €200 with early bird pricing for #pytorchcon Europe, 7-8 April.
Two days of PyTorch, ML systems, & the people building what ships next.
Early bird registration ends 27 February.
👉 events.linuxfoundation.org/pytorch-conference-europe/?hss… -
PyTorch
@PyTorch
PyTorch Day India 2026 brought the open source AI community to Bengaluru for a full day of technical talks and discussion, with 460 in-person attendees.
Opening remarks from @RaghuGanti and keynotes from @matthew_d_white, Stephen Watt (@RedHat), Sriram Raghavan (@IBM), and Niket Agarwal (NVIDIA).
🔗 pytorch.org/blog/pytorch-day-india-2026-recap/?hss_channe…
#pytorch #aiinfrastructure #opensourceai #pytorchdayindia -
PyTorch
@PyTorch
Agentic RL and Environments with @matthew_d_white, @bhutanisanyam1 (@Meta), @danielhanchen (@UnslothAI), @ben_burtenshaw (@huggingface), and @joespeez (@Meta).
Notebook-first RL environment workflows using OpenEnv, @vllm_project /Llama flows, and Hugging Face Hub submission, plus a walkthrough of torchtitan and torchforge. Virtual workshop with live Q&A.
🔗 Feb 18, 11am PT: luma.com/linux-pytorch-workshop?tk=lYs9OY
#pytorch #opensourceai #agenticai
UC Berkeley RDI
@BerkeleyRDI
🧰 Workshop w/ Linux / PyTorch Foundation
📅 Wed Feb 18 | 🕚 11–12 PT
🔗 luma.com/linux-pytorch-workshop
If you’re building for the AgentX–AgentBeats competition and want your project to shine, don’t miss this!
The @LinuxFoundation and @PyTorch Foundation are hosting this workshop, where you can expect a showcase of open-source projects creating the future of agentic AI development and live Q&A with PyTorch & Linux experts!
🎟️ Make sure to RSVP right now by clicking the link above! See you there! -
PyTorch
@PyTorch
⌛ Final hours.
The #pytorchcon Europe #callforproposals closes TODAY at 23:59 CET. If you want to speak in Paris 7-8 April, now is your moment.
🎤 events.linuxfoundation.org/pytorch-conference-europe/prog… -
PyTorch
@PyTorch
🚨 #callforproposals closes tomorrow, 8 Feb at 23:59 CET.
Last chance to submit your talk for #pytorchcon Europe, 7-8 April in Paris.
👉 events.linuxfoundation.org/pytorch-conference-europe/prog… -
PyTorch
@PyTorch
Ever wondered how accumulators work inside GPU GEMM engines — and whether they cost you accuracy?
This blog explores matrix multiplication accumulators in modern AI accelerators, using NVIDIA FP8 Tensor Cores as an example. It shows how to emulate and validate accumulator precision with Triton, enabling systematic studies of reduced-precision accumulation and its impact on accuracy, and offering insights to guide future AI hardware design.
🖊️ @IBM: Chi-Chun Liu, Monodeep Kar, @RaghuGanti, Mudhakar Srivatsa, Naigang Wang
🔗 pytorch.org/blog/some-matrix-multiplication-engines-are-n…
#pytorch #aiinfrastructure #opensourceai #machinelearning -
PyTorch
@PyTorch
Our latest blog explains how a fused Triton kernel accelerates the Mamba-2 SSD module by combining five SSD kernels into a single launch, delivering 1.50×–2.51× speedups on NVIDIA A100 and H100 GPUs.
It walks through the fusion approach, remaining bottlenecks, benchmark results, accuracy tradeoffs, and plans to release the fused kernel as open source.
🖊️ Adnan Hoque (@IBM), Tri Dao, Rishi Astra
🔗 pytorch.org/blog/accelerating-mamba2-with-kernel-fusion/?…
#pytorch #aiinfrastructure #gpucomputing #opensourceai -
PyTorch
@PyTorch
⏰ 3 days left to submit to speak at #pytorchcon Europe.
Do not wait to share your #pytorch insights in Paris, 7-8 April.
🎤 Deadline: 8 February
events.linuxfoundation.org/pytorch-conference-europe/prog… -
PyTorch
@PyTorch
Discover the work behind a highly efficient inference pipeline for recommendation systems built with PyTorch.
Our latest blog breaks down a production-grade inference system for large-scale recommender workloads.
🔗 pytorch.org/blog/building-highly-efficient-inference-syst…
✍️ Lu Fang, Shiyan Deng (@dsyDaniel), Ilina Mitra (@ilina_mitra), Zinnia Zheng (@moonsilverstone)
#recommendationsystems #inference -
PyTorch
@PyTorch
#pytorchdayindia is sold out, but you can still tune in to our livestream for free on 7 February! 💻 Get the details + sign up: events.linuxfoundation.org/pytorch-day-india/program/live…
-
PyTorch
@PyTorch
Need to simplify development by managing memory under the hood without sacrificing performance?
By replacing a verbose two-phase pattern with a streamlined single-call interface, NVIDIA CUB offers a modern API that eliminates boilerplate without adding overhead. Simplify your codebase and fully harness the computational power of your GPU.
🖇️ Read the full post: developer.nvidia.com/blog/streamlining-cub-with-a-single-…
#pytorch #opensourceai #ai #inference #innovation -
PyTorch
@PyTorch
Your #pytorch work deserves a spotlight. ✨
Share it at #pytorchcon Europe, 7-8 April in Paris. #callforproposals deadline is 8 February.
➡️ events.linuxfoundation.org/pytorch-conference-europe/prog…
Register: events.linuxfoundation.org/pytorch-conference-europe/regi… -
PyTorch
@PyTorch
We've featured Helion, a new domain-specific and PyTorch-based language to make the development of high-performing but portable kernels easier, on this channel before. Now, researchers at @IBM have embarked on a challenge to implement paged attention, the performance-critical core of @vllm_project, in Helion.
Read here how it went: pytorch.org/blog/portable-paged-attention-in-helion/?hss_…
Spoiler alert: Already with a naive implementation and Helion still in beta, paged attention in Helion achieves 97% end-to-end vs. the highly optimized Triton attention backend.
#vllm #pytorch #helion #opensourceai #performance -
PyTorch
@PyTorch
We're excited to announce that @nota_ai has joined PyTorch Foundation as a Silver Member to advance open source AI 🎉
Nota AI will support the PyTorch community with model compression, quantization, and hardware-aware optimization, from edge to cloud.
#pytorch #opensourceai #aioptimization -
PyTorch
@PyTorch
Excited to share our latest deep-dive on @NVIDIA's DGX Spark AI-PC! Discover how we unlocked advanced reasoning in Llama 8B through full fine-tuning—entirely offline, thanks to DGX Spark’s unified 128GB memory.
Learn how synthetic data and chain-of-thought prompts are pushing the boundaries of local LLMs.
🖇️ Read the full recipe and results on the PyTorch Foundation blog: pytorch.org/blog/unlock-reasoning-in-llama-3-1-8b-via-ful…
👥 @bhutanisanyam1 (PyTorch Meta), Hamid Shojanazeri (PyTorch Meta), Clement Anthonioz Blanc (Meta)
#pytorch #dgxspark #ai #llm #finetuning -
PyTorch
@PyTorch
Help set the tone for #pytorchcon Europe. 🎶
Submit a proposal on research, applications, tooling, performance, or community topics by 8 February.
📍 Paris | 7-8 April
Speak: events.linuxfoundation.org/pytorch-conference-europe/prog…
Register: events.linuxfoundation.org/pytorch-conference-europe/regi… -
PyTorch
@PyTorch
🚨 Last chance.
The SUPER Early Bird rate for #pytorchcon Europe ends today at 23:59 CET.
Save €350 before prices go ⬆️!
📍 Paris | 7-8 April
🎟️ events.linuxfoundation.org/pytorch-conference-europe/regi… -
PyTorch
@PyTorch
Working with #pytorch in the real world? 🚀
Bring your experience to #pytorchcon Europe, 7-8 April in Paris. #callforproposals closes 8 February.
🎤 events.linuxfoundation.org/pytorch-conference-europe/prog…
Register for €299 by 30 Jan: events.linuxfoundation.org/pytorch-conference-europe/regi… -
PyTorch
@PyTorch
⏰ Early bird pricing ends TOMORROW (31 January) for #pytorchdayindia! Don't miss your chance to save on this incredible day of PyTorch innovation in Bengaluru on 7 February. Secure your spot now ➡️ events.linuxfoundation.org/pytorch-day-india/register/?hs…
-
PyTorch
@PyTorch
SqueezeSAM on-device, accelerated 🚀
With ExecuTorch and Arm SME2, SqueezeSAM image segmentation achieves up to 3.9× faster inference, reducing FP16 latency from over one second to ~300 ms on a single CPU core.
This makes responsive, interactive on-device AI practical on mobile CPUs, no GPU required, while preserving headroom for richer user experiences.
A strong example of how hardware-aware optimization and operator-level profiling can materially change what’s possible for on-device ML.
🔗 Read the blog: pytorch.org/blog/accelerating-on-device-ml-inference-with…
👥 Gian Marco Iodice, Damien Dooley, Tyler Mullenbach, Jason Zhu
hashtag#PyTorch hashtag#ExecuTorch hashtag#OnDeviceAI hashtag#OpenSourceAI hashtag#MachineLearning -
PyTorch
@PyTorch
⏰ Almost gone.
The SUPER Early Bird rate for #pytorchcon Europe ends tomorrow, 30 January at 23:59 CET.
Save €350 and join us 7-8 April in Paris. 🇫🇷
🎟️ Register now: events.linuxfoundation.org/pytorch-conference-europe/regi… -
PyTorch
@PyTorch
#pytorchdayindia keynote speakers announced from Red Hat, NVIDIA, and IBM. View their sessions: pytorchdayindia2026.sched.com/overview/type/Keynote?hss_c… See full schedule: events.linuxfoundation.org/pytorch-day-india/program/sche… Register now to save your seat for 7 February in Bengaluru: events.linuxfoundation.org/pytorch-day-india/register/?hs…
-
PyTorch
@PyTorch
Watch Jana van Greunen, Tristan Rice (@rice_fry), and Edward Yang (@ezyang) of @Meta talk about building PyTorch in the open, hearing from users, and why work on fault tolerance and communication is paying off. youtu.be/pp8v3dJJKLo #pytorch #opensourceai
This media couldn't be displayed. See it on the original post. -
PyTorch
@PyTorch
yasp has joined PyTorch Foundation as a Silver Member 🎉
PyTorch Foundation is a community-driven, vendor-neutral home for open source AI projects and collaboration across the AI lifecycle. Our membership reflects an alignment with these principles and engagement with the open source AI ecosystem.
The yasp Agentic AI Compiler optimizes model training and inference across diverse hardware with a single API call, significantly accelerating time-to-market. No recoding needed, the Compiler is helping avoid vendor lock-in and boost performance for high-volume tasks without sacrificing accuracy.
“We joined the PyTorch Foundation because open ecosystems are essential for scaling AI across hardware while preserving developer freedom and avoiding vendor lock-in. Open source AI, for us, means giving developers the freedom to run and optimize their models wherever they need, while sharing progress back with the community. PyTorch embodies that spirit, and we’re excited to contribute to it.”
— Stefan Krassin, Co-Founder & CEO, yasp
#pytorch #opensourceai #yasp -
PyTorch
@PyTorch
From research wins to lessons learned in production, #pytorchcon Europe wants to hear from you! 💡
Submit your proposal to speak at the 7-8 April event in Paris by 8 February.
👉 events.linuxfoundation.org/pytorch-conference-europe/prog…
Register: events.linuxfoundation.org/pytorch-conference-europe/regi… -
PyTorch
@PyTorch
TOMORROW: We’re hosting a live Q&A on the PyTorch 2.10 release, covering updates across performance, numerical debugging, packaging, and platform support, with time for community questions.
Andrey Talaman (Meta), Nikita Shulga (Meta), Shangdi Yu (Meta), and Ashok Emani (Intel) will walk through what’s new in 2.10, including TorchScript deprecation, Python 3.14 support in torch.compile, DebugMode and tlparse, wheel variant support, CUDA and platform updates, TorchAudio migration finalization, and Intel GPU support.
🔗 Register: pytorch.org/event/pytorch-2-10-release-live-qa/?hss_chann…
#pytorch #opensourceai #machinelearning -
PyTorch
@PyTorch
Registration for #pytorchcon Europe is live. 🔥
Join us 7-8 April in Paris & act fast to lock in the SUPER Early Bird rate. 💸
⏰ This special rate expires at 23:59 CET on 30 January. Blink and you’ll miss it !👀
🎟️ Register now: events.linuxfoundation.org/pytorch-conference-europe/regi… -
PyTorch
@PyTorch
📣 ICYMI: The full schedule for #pytorchdayindia is live! Join us 7 February in Bengaluru for sessions on optimized kernels, efficient AI through approximate computing, compiler design & more. View schedule: events.linuxfoundation.org/pytorch-day-india/program/sche…
Early bird pricing ends 1 February—register now: events.linuxfoundation.org/pytorch-day-india/register/?hs… -
PyTorch
@PyTorch
Agentic RL and Environments with @matthew_d_white, @bhutanisanyam1 (@Meta), @danielhanchen (@UnslothAI), @ben_burtenshaw (@huggingface), and @joespeez (@Meta).
Notebook-first RL environment workflows using OpenEnv, vLLM/Llama flows, and Hugging Face Hub submission, plus a walkthrough of torchtitan and torchforge. Virtual workshop with live Q&A.
🔗Feb 18, 11am PT: luma.com/linux-pytorch-workshop?tk=lYs9OY
#pytorch #opensourceai #agenticai
UC Berkeley RDI
@BerkeleyRDI
🧰 Workshop w/ Linux / PyTorch Foundation
📅 Wed Feb 18 | 🕚 11–12 PT
🔗 luma.com/linux-pytorch-workshop
If you’re building for the AgentX–AgentBeats competition and want your project to shine, don’t miss this!
The @LinuxFoundation and @PyTorch Foundation are hosting this workshop, where you can expect a showcase of open-source projects creating the future of agentic AI development and live Q&A with PyTorch & Linux experts!
🎟️ Make sure to RSVP right now by clicking the link above! See you there! -
PyTorch
@PyTorch
🇫🇷 Paris. PyTorch. Your ideas on stage.
Submit your talk for #pytorchcon Europe, 7-8 April, and help shape the program.
🎤 CFP deadline is 8 February. Submit today: events.linuxfoundation.org/pytorch-conference-europe/prog… -
PyTorch
@PyTorch
#pytorch 2.10 includes updates focused on performance and numerical debugging. Next week, Andrey Talaman, Nikita Shulga, and Shangdi Yu (Meta) will provide a brief update on the release and answer questions in a live Q&A.
Topics include TorchScript deprecation, torch.compile support for Python 3.14, DebugMode and tlparse, continued support for wheel variants in 2.10, Volta deprecation for CUDA 12.8 builds starting in PyTorch 2.11, Linux aarch64 CUDA binaries available since PyTorch 2.9, and torchaudio 2.10.0.
Register here: pytorch.org/event/pytorch-2-10-release-live-qa/?hss_chann…
#opensourceai #machinelearning #aiinfrastructure -
PyTorch
@PyTorch
📣 NEW: See what’s on the agenda for #pytorchdayindia in Bengaluru on 7 February! We’ve announced the full schedule and speakers: events.linuxfoundation.org/pytorch-day-india/program/sche… Reserve your pass before 1 February & save: events.linuxfoundation.org/pytorch-day-india/register/?hs…
-
PyTorch
@PyTorch
January PyTorch newsletter is out. Get updates on #pytorchconferenceeurope CFPs, #pytorchdayindia registration, a 2025 year-in-review, and new technical blogs on scalable RL, FlexAttention, and more.
Read: pytorch.org/newsletter/january-2026/?hss_channel=tw-77658…
Subscribe: pytorch.org/newsletter/?hss_channel=tw-776585502606721024
#pytorch #opensourceai -
PyTorch
@PyTorch
We're excited to welcome Feast to the PyTorch Ecosystem!
Feast is an open source feature store designed to eliminate training-serving skew by ensuring models see consistent data from training through production. Paired with PyTorch, it helps teams move from experimentation to reliable deployment with confidence.
Learn how Feast enhances production PyTorch workflows and see a hands-on demo.
🔗 pytorch.org/blog/feast-joins-the-pytorch-ecosystem/?hss_c…
#pytorch #opensourceai #mlops #aiinfrastructure -
PyTorch
@PyTorch
Got a #pytorch story worth sharing? 🎤 Submit a proposal for #pytorchcon Europe, happening 7-8 April in Paris. Research, tooling, performance, use cases & more are all welcome.
Proposals due 8 February ➡️ events.linuxfoundation.org/pytorch-conference-europe/prog… -
PyTorch
@PyTorch
PyTorch 2.10 is now available, with updates focused on performance, determinism, and numerical debugging for modern training and post-training workflows.
Highlights include Python 3.14 support for torch.compile(), reduced kernel launch overhead in TorchInductor, a new varlen_attn() op for variable-length sequences, and improved tools for tracking numerical divergence.
🖇️ 🔥 Read the PyTorch 2.10 release blog and release notes: pytorch.org/blog/pytorch-2-10-release-blog/?hss_channel=t…
#pytorch #opensourceai #aiinfrastructure -
PyTorch
@PyTorch
In our latest PyTorch Foundation Spotlight, Matt White, Executive Director of PyTorch Foundation, explains how the Foundation serves as a vendor-neutral home for PyTorch and projects like vLLM, DeepSpeed, and Ray.
Matt shares what joining PyTorch Foundation entails, including opportunities to collaborate, get closer access to developers, gain early insight into roadmaps, and help shape what comes next.
🎥 Watch the Spotlight: youtu.be/9t3OSFD-Qw8
#pytorch #opensourceai #aiinfrastructureThis media couldn't be displayed. See it on the original post. -
PyTorch
@PyTorch
Looking to speed up LLM and diffusion model workloads on GPU-powered PCs?
This NVIDIA blog explores how recent upgrades across open source AI tools, including PyTorch-CUDA, help accelerate inference and performance for PC-class applications running on NVIDIA RTX GPUs.
🖇️ Read the full post: developer.nvidia.com/blog/open-source-ai-tool-upgrades-sp…
#pytorch #opensourceai #ai #inference #innovation -
PyTorch
@PyTorch
PyTorch Conference Europe 2026 is set for Paris on 7–8 April 2026. Call for Proposals is now open!
The event brings together researchers, developers, practitioners, and academics to share real-world systems, emerging research, and production lessons from across the PyTorch ecosystem.
We're inviting technically deep, practical talks covering areas such as framework development, training and inference systems, performance optimization, tooling, research breakthroughs, and real-world applications across industries.
🔗 Submit a proposal or learn more: pytorch.org/blog/pytorch-conference-europe-2026-cfp-now-o…
CFP deadline: Sunday, 8 February 2026, 11:59 pm CEST
#pytorchcon #pytorch #opensourceai #machinelearning -
PyTorch
@PyTorch
#pytorchcon Europe 2026 #callforproposals is open! 🎤 Submit to speak by 8 February for sessions at the Paris event, 7-8 April. Share your #pytorch insights on research, applications, tooling, best practices, performance, community building, or innovative use cases. ➡️ Submit now: events.linuxfoundation.org/pytorch-conference-europe/prog…
-
PyTorch
@PyTorch
🎯 Secure your spot at early bird rates! #pytorchdayindia is going live 7 February in Bengaluru. Dive deep into #pytorch with industry experts, cutting-edge demos & real-world #ai applications. Limited early bird pricing available until 31 January ➡️ events.linuxfoundation.org/pytorch-day-india/register/?hs…
-
PyTorch
@PyTorch
2025 was a defining year for PyTorch Foundation. We expanded into an umbrella foundation, welcomed foundation-hosted projects vLLM, DeepSpeed, and Ray, added 16 new members, and strengthened our portfolio across training, inference, and distributed compute
As we look ahead to 2026, we set priorities for the year with perspectives from @matthew_d_white, @joespeez (@Meta), and Luca Antiga (@LightningAI).
🖇️ Read it here: pytorch.org/blog/pytorch-foundation-in-2025-a-year-in-rev…
#pytorch #opensourceai #aiinfrastructure -
PyTorch
@PyTorch
TorchAO Quantized Gemma-3 Models Now Available on HuggingFace 🚀
TorchAO quantized Gemma-3 models (4b, 12b and 27b) are now available in multiple quantized formats (FP8, INT4, AWQ-INT4, HQQ-INT8-INT4, QAT-INT4) on HuggingFace Hub! Our models:
* Run efficiently on A100/H100 GPUs (with vLLM) & mobile devices (with ExecuTorch)
* Deliver faster inference, big memory savings, and minimal accuracy loss compared to BF16 model
* Include reproducible quantization recipes for your own models, including algorithms like AWQ, HQQ and QAT
🖇️ Check out the collection: huggingface.co/collections/pytorch/torchao-quantized-gemm…
#llm #pytorch #torchao #executorch #vllm #quantization #gemma3 #huggingface #edgeai -
PyTorch
@PyTorch
NVIDIA TensorRT LLM provides a high-level Python LLM API, with its PyTorch-native architecture enabling developers to experiment with the runtime or extend functionality.
Learn how these latest TensorRT-LLM optimizations boost reasoning inference performance in our recent blog post.
🖇️ developer.nvidia.com/blog/delivering-massive-performance-…
#pytorch #opensourceai #ai #inference #innovation -
PyTorch
@PyTorch
📣 ICYMI: #pytorchdayindia is coming to Bengaluru on 7 February! Register NOW & reserve your seat for a full day of #pytorch technical talks, discussions & networking with #ai & #ml leaders ➡️ events.linuxfoundation.org/pytorch-day-india/register/?hs…
-
PyTorch reposted
GPU MODE
@GPU_MODE
We have a mini conference lined up for you Wednesday, January 14, 2026 at 9:05 AM on Reinforcement Learning, Agents & OpenEnv with a heavyweight lineup of speakers from @PyTorch @huggingface and @UnslothAI
See you tomorrow!
www.youtube.com/watch?v=jMSCJZAEYR8 -
PyTorch
@PyTorch
Prabha Ganapathy (@awscloud) shares how contributing optimizations back to the #opensource community benefits the broader ecosystem and why serving on the #pytorch Foundation board matters.
🔗youtu.be/oBxVrIEKkTw #pytorch #opensourceaiThis media couldn't be displayed. See it on the original post. -
PyTorch
@PyTorch
This @IBM tutorial shows how to build a spam text classifier from scratch using #pytorch.
AI Engineer and Developer Advocate Anna Gutowska walks through the full NLP workflow, from text preprocessing and #tokenization to training an LSTM model that reaches ~97% accuracy in a few epochs.
📖 Read and try it yourself:
www.ibm.com/think/tutorials/text-classification-pytorch?h…
#opensourceai #machinelearning -
PyTorch
@PyTorch
Scaling RL for LLMs is hard. The #pytorch team at Meta open sourced torchforge and shares #reinforcementlearning lessons from evaluating it with Weaver on a 512 GPU cluster.
🔗 pytorch.org/blog/supercharging-llms-scalable-rl-with-torc… -
PyTorch
@PyTorch
The Triton team at Meta shares a working implementation of warp specialization in the #triton compiler, along with the current design and upcoming roadmap, and invites community feedback from the #pytorch and open source AI community.
🔗pytorch.org/blog/warp-specialization-in-triton-design-and…
#aiinfrastructure #opensource -
PyTorch
@PyTorch
PyTorch Day India 2026 is coming to Bengaluru on 7 February 2026, bringing together the PyTorch community for a full day of technical talks, discussions, and poster sessions focused on open source AI and machine learning.
Hosted by PyTorch Foundation and co-hosted with @IBM, @nvidia, and @RedHat, the event is designed for PyTorch users, machine learning engineers, AI researchers, and industry professionals working across the ecosystem.
🖇️ Register today: pytorch.org/blog/pytorch-day-india-2026/
#pytorch #aiinfrastructure #opensourceai -
PyTorch
@PyTorch
FlexAttention has been adopted across popular #llm ecosystem projects, including Hugging Face, vLLM, and SGLang, reducing the effort required to adapt and experiment with newer attention variants in modern LLMs.
🔗 Read our latest blog from @Intel #pytorch & Triton Teams: pytorch.org/blog/pytorch-2-9-flexattention-optimization-p…
#aiinfrastructure #opensourceai -
PyTorch
@PyTorch
🔥 #pytorchdayindia is coming to Bengaluru on 7 February! Register NOW and save your seat for a full day of #pytorch technical talks, discussions & networking with #ai & #ml leaders. Act fast! This event is just a month away! Register: events.linuxfoundation.org/pytorch-day-india/register/?hs…
-
PyTorch
@PyTorch
Need to accelerate inference for math problem solving?
Large language models can solve challenging math problems. However, making them work efficiently at scale requires the right serving stack, quantization strategy, and decoding methods—often spread across different tools.
This @nvidia blog post shows how to build a fast, reproducible inference pipeline with the NVIDIA NeMo-Skills library to manage NVIDIA TensorRT-LLM.
🔗developer.nvidia.com/blog/how-to-achieve-4x-faster-infere…
#pytorch #opensourceai #ai #inference #innovation -
PyTorch
@PyTorch
IBM’s Christian Jacobi (@IBM Fellow and CTO, IBM Systems Development) on why the PyTorch community matters for AI today, the role of open source, and what he’s hearing from clients deploying AI in core IT and business processes. 🎥 youtu.be/Y_R4JMg2Vwo
This media couldn't be displayed. See it on the original post. -
PyTorch
@PyTorch
Everything PyTorch Foundation does is shaped by the people who build, maintain, use, and support our projects. From contributors and maintainers to researchers, practitioners, and partners, your work continues to move the ecosystem forward.
We’re grateful for the collaboration that defined the past year and look forward to what we’ll build together in the year ahead. ❤️ ❤️🔥 🔥
🔗 Learn more and get involved: pytorch.org?hss_channel=tw-776585502606721024
#pytorch #opensource #aiinfrastructure -
PyTorch
@PyTorch
The @linuxfoundation 2025 Annual Report highlights a milestone year for PyTorch Foundation, including its transition to an umbrella foundation and continued growth of the PyTorch ecosystem.
The report reflects PyTorch Foundation’s role within the Linux Foundation as a neutral home for open source AI, supporting widely adopted infrastructure and a growing portfolio of hosted projects.
🔗 Read here: www.linuxfoundation.org/resources/publications/linux-foun…
#pytorchfoundation #pytorch #vllm #ray #deepspeed #opensourceai -
PyTorch reposted
vLLM
@vllm_project
vLLM delivers even more inference performance with the same GPU platform.
In just 1 month, we've worked with NVIDIA to increase @nvidia Blackwell maximum throughput per GPU by up to 33% -- significantly reducing cost per token -- while also enabling even higher peak speed for the most latency-sensitive use cases powered by deep PyTorch integration and collaboration. -
PyTorch
@PyTorch
Transformers v5 going all-in on PyTorch, new ecosystem projects, and major moments from NeurIPS 2025 headline the December PyTorch newsletter.
Catch up on the latest from the PyTorch community, including ecosystem updates, PyTorch Conference 2025 recaps, and recent member and community blogs.
🔗 Read the full newsletter: pytorch.org/newsletter/december-2025/?hss_channel=tw-7765…
📨 Subscribe to receive the PyTorch newsletter directly in your inbox: pytorch.org/newsletter/?hss_channel=tw-776585502606721024
#pytorch #aiinfrastructure #opensourceai -
PyTorch
@PyTorch
New from @Arm + PyTorch 👇
Train smarter for the edge:
• Hardware–software co-design
• Extreme + QAT quantization
• Mixture-of-Experts for lower latency
Runs even faster on Arm with KleidiAI + ExecuTorch.
👉 Blog + 10 hrs of notebooks: pytorch.org/blog/deploying-smarter-hardware-software-co-d…
#pytorch #executorch #arm #kleidiai #qat -
PyTorch
@PyTorch
NVIDIA Blackwell introduces Cluster Launch Control to enable dynamic scheduling, allowing kernels to launch as many threadblocks as needed while improving load balance through hardware-driven work distribution. Our latest blog shows how to write TLX kernels that use CLC in practice and introduces TLX as the first DSL in the industry with dedicated support for Cluster Launch Control.
By Daohang Shi, Hongtao Yu, and Manman Ren
🔗 pytorch.org/blog/enabling-cluster-launch-control-with-tlx…
#pytorch #gpu #aiinfrastructure #opensource -
PyTorch
@PyTorch
The PyTorch Ecosystem continues to grow with projects that improve performance, scalability, and developer workflows across training, inference, AI infrastructure, and scientific machine learning.
Our latest ecosystem update highlights new additions including FlagGems, Kubeflow Trainer, LMCache, DeepInverse, Feast, NeuralOperator, PINA, and verl. It also spotlights sc2bench, a project under consideration that could benefit from broader community review and contributions.
🔗 pytorch.org/blog/pytorch-ecosystem-working-group-update-q…
#pytorch #opensource #aiinfrastructure #machinelearning -
PyTorch
@PyTorch
Watch @richliaw (@anyscalecompute) explain why Ray joined PyTorch Foundation, citing the ecosystem forming around PyTorch, DeepSpeed, and vLLM, and what this move signals about Ray’s role in the AI infrastructure stack.
🔗 youtu.be/wLpXAyDyN9E
#pytorch #ray #aiinfrastructureThis media couldn't be displayed. See it on the original post. -
PyTorch
@PyTorch
We had a strong presence at NeurIPS 2025, contributing across the week with workshops, talks, posters, a co-hosted community reception, and ongoing engagement with researchers, engineers, and maintainers from across the AI community.
Our recap highlights PyTorch-led workshops on agentic development, on-device and edge AI, a technical session on modular agents and open agentic protocols, poster presentations at Regulatable ML and LLM evaluation workshops, and the Open Source AI Reception co-hosted with @CloudNativeFdn and supported by @anyscalecompute, @FeatherlessAI, @huggingface, and @UnslothAI.
We spent the week connecting with the community around PyTorch, @vllm_project, @DeepSpeedAI, Ray, and other ecosystem projects, discussing practical deployment, performance optimization, and what’s ahead.
🔗 Read our NeurIPS 2025 recap: pytorch.org/blog/pytorch-foundation-at-neurips-2025/?hss_…
👥 Workshops & Technical Sessions: @joespeez (Meta), Davide Testuggine (Meta), Aksel Joonas Reedi (Hugging Face), @zkwentz (Meta), @danielhanchen (@UnslothAI), @bhutanisanyam1 (Meta), Cagatay Bilgin (Meta), Matthias Lecher, Andrey Tovchigrechko (Meta), @AKAvkkhare (@NimbleEdgeInc), @profvjreddi (Harvard), @krandiash (@cartesia ), @miitesh_patel, (@nvidia)
#pytorch #neurips2025 #opensourceai #aiinfrastructure -
PyTorch
@PyTorch
NeuralOperator is now part of the #pytorch Ecosystem, bringing a PyTorch-native library for learning neural operators and modeling mappings between function spaces for AI-driven science and engineering.
🔗 pytorch.org/blog/neuraloperatorjoins-the-pytorch-ecosystem/
@JeanKossaifi @AnimaAnandkumar @davehpitt
#aiinfrastructure #opensourceai -
PyTorch
@PyTorch
Zhipeng (Jason) Wang, PhD (@PKUWZP) explains how @DeepSpeedAI supports ML training research and why joining PyTorch Foundation benefits researchers and developers working on AI training workloads.
🔗youtu.be/67719mlOSp0 #pytorch
#deepspeed #opensourceai #aiinfrastructureThis media couldn't be displayed. See it on the original post. -
PyTorch
@PyTorch
Today’s "Inside Helion Live Q&A" brought the #pytorch community together with Jason Ansel, @oguz_ulgen, @weifengpy, and Jongsok Choi from @Meta’s PyTorch Compiler and Helion teams. The discussion explored how Helion approaches kernel authoring, #aiinfrastructure performance, and autotuning at scale.
🖇️ Watch the full recording: www.youtube.com/live/_gIyr1BVUJk
More from Jason Ansel at #pytorch Conference 2025: youtu.be/BW-Ht-5IxgM
Read the Helion blog: pytorch.org/blog/helion/ -
PyTorch
@PyTorch
Want to scale biology transformer models with PyTorch?
@nvidia BioNeMo Recipes can simplify and accelerate this process by lowering the barrier to entry for large-scale model training. Using step-by-step guides built on familiar frameworks like PyTorch and Hugging Face.
In this blog post, we demonstrate how to accelerate transformer-style AI models for biology.
developer.nvidia.com/blog/scale-biology-transformer-model…
#pytorch #opensourceai #ai #inference #innovation -
PyTorch
@PyTorch
TOMORROW: Inside Helion: Live Q&A with Jason Ansel, @oguz_ulgen, @weifengpy, and Jongsok Choi from @Meta’s PyTorch Compiler and Helion teams. Hear how the Python-embedded DSL compiles to Triton, accelerates kernels, and what’s ahead for Helion.
🔗 pytorch.org/event/inside-helion-live-qa/ #pytorch #aiinfrastructure #opensourceai -
PyTorch
@PyTorch
New #pytorch Foundation Spotlight with @joespeez (@meta). He shares why open source is the best path to learn, collaborate, and build, the momentum around RL, agentic APIs, and kernel development, and how #pytorch serves as a platform for boundaryless innovation.
🖇️This media couldn't be displayed. See it on the original post. -
PyTorch
@PyTorch
Need to accelerate Large-Scale Mixture of Experts Training?
With @nvidia NeMo Automodel, an open source library within NVIDIA NeMo framework, developers can now train large-scale MoE models directly in PyTorch using the same familiar tools they already know.
Learn how to make MoE training of massive models simple and efficient by reading NVIDIA’s developer blog:
📎 developer.nvidia.com/blog/accelerating-large-scale-mixtur…
#pytorch #moe #opensourceai -
PyTorch
@PyTorch
If you're building or experimenting with GenAI on Arm devices, there’s a great learning session coming up next week!
Join Gian Marco Iodice, Principal Software Engineer at @Arm, and Digant Desai, Software Engineer at @Meta, as they unpack the latest updates to ExecuTorch, including SME2 integration and the OpenSmall model. They’ll walk you through how these additions make it easier to run GenAI workloads consistently across edge, mobile, and cloud environments.
Expect practical examples, code walkthroughs, and open discussion with the engineers who work on this every day.
📎 Dec 11, 9 am (next Thursday): discord.gg/w5EBUG3fau?event=1443197346627321909
#pytorchfoundation #opensourceai #executorch -
PyTorch
@PyTorch
In this new PyTorch Foundation Spotlight, Ankit Patel (@nvidia) shares how their teams build on PyTorch, from using it across projects to extending it into new areas like Tensor TLLM for inference optimization and Physics NeMo for physics neural networks.
He also reflects on the energy and mix of newcomers and maintainers collaborating across the PyTorch community, and how this innovation is happening with and on PyTorch.
🎥 Watch the Spotlight: youtu.be/H3n1otZ5VYI
#pytorch #opensourceai #aiinfrastructureThis media couldn't be displayed. See it on the original post. -
PyTorch
@PyTorch
Next Thursday’s Inside Helion: Live Q&A is hosted by Jason Ansel, @oguz_ulgen, @weifengpy, and Jongsok Choi from @Meta's PyTorch Compiler and Helion teams. It’s a chance to hear directly from the developers shaping Helion.
Helion is a Python-embedded DSL that compiles to Triton, raises the level of abstraction for kernel authoring, and uses large-scale autotuning to surface the fastest implementations across hardware. This session will walk through the design philosophy, performance model, and what’s ahead on the roadmap.
🔗 pytorch.org/event/inside-helion-live-qa/
#pytorch #aiinfrastructure #opensourceai -
PyTorch
@PyTorch
Runhouse and Curavoice were recognized in the 2025 PyTorch Startup Showcase, with @DonnyGreenberg presenting for @runhouse_ and Shrey Modi presenting for @CuraVoice. Their work reflects the depth of innovation across AI infrastructure and applied AI in the PyTorch ecosystem.
Thank you to our Startup Showcase MC @chappyasel (@_ai_collective) and our judges Irving Hsu (@MayfieldFund), Radhika Malik (Dell Technologies Capital), Kevin Crosby (GitHub), @denise_teng25 (@GradientVC), and @simontiu (@VertexVUS) for their thoughtful evaluation and support.
💡 Learn more about the 2025 Showcase winners and their work: pytorch.org/blog/celebrating-the-2025-pytorch-startup-sho…
#pytorchcon #pytorch #opensourceai #aiinfrastructure -
PyTorch
@PyTorch
Our latest PyTorch community blog from the SGLang Team covers how SGLang advances hybrid Mamba plus Attention models with improved memory efficiency, prefix caching, speculative decoding, and serving performance.
🖇️Read the blog: pytorch.org/blog/hybrid-models-meet-sglang-more-than-full… #pytorch #aiinfrastructure #sglang #llm -
PyTorch
@PyTorch
At #neurips2025, @danielhanchen (@UnslothAI ), Davide Testuggine (@Meta), @joespeez (Meta), and @bhutanisanyam1 (Meta) led a focused discussion on how environments are shaping the next stage of agentic AI and reinforcement learning.
Their session examined why environments are central to how agents act, learn, and are evaluated across simulated and real-world settings, covering scalable RL environment frameworks, safety and robustness benchmarks, high-performance simulators for heterogeneous hardware, and how environments integrate with trainers, inference engines, and post-training workflows that support alignment and deployment.
📸 More updates from #pytorch at NeurIPS coming soon #aiinfrastructure #reinforcementlearning -
PyTorch
@PyTorch
Our latest PyTorch Foundation Spotlight features @RedHat's Joseph Groenenboom and Stephen Watt on the importance of optionality, open collaboration, and strong governance in building healthy and scalable AI ecosystems.
In this Spotlight filmed during PyTorch Conference 2025, they share how PyTorch serves as the nucleus of Red Hat’s generative AI stack. They discuss the role of @vllm_project in their inference work and why equitable contributions and clear governance standards are essential to a healthy open source community.
🔗 Watch the Spotlight: youtu.be/uwpKK9gut4c
#pytorch #opensourceai #opensource #aiinfrastructureThis media couldn't be displayed. See it on the original post. -
PyTorch
@PyTorch
PyTorch Foundation is on site at NeurIPS 2025 with workshops, sessions, and community programming throughout the week. Stop by our joint booth with @CNCF and meet contributors at the Open Source AI Reception with @CloudNativeFdn, @anyscalecompute , @FeatherlessAI, @huggingface, and @UnslothAI
Connect with PyTorch maintainers and ecosystem contributors throughout the conference this week:
TODAY: Workshop: Agentic Development at the Frontier
December 2, 4:00–5:00 PM PT
Featuring @joespeez, Davide Testuggine, Aksel Joonas Reedi, @zkwentz, @danielhanchen, @bhutanisanyam1, and Aakanksha Choudhery
🔗 nips.cc/virtual/2025/loc/san-diego/128662
TOMORROW: Open Source AI Reception
December 3, 6:00–9:00 PM
Hosted by PyTorch Foundation & CNCF with Anyscale, Featherless, Hugging Face, and Unsloth at Union Kitchen and Tap Gaslamp in San Diego
🔗 Register to secure your spot: linuxfoundation.regfox.com/open-source-ai-reception-2025
Workshop: On Device/Edge AI
December 3, 12:00–1:30 PM PT
Featuring Cagatay Bilgin, Matthias Lecher, Andrey Tovchigrechko, @AKAvkkhare, @profvjreddi, @krandiash, and Mitesh Patel
🔗 neurips.cc/virtual/2025/loc/san-diego/128674
Talk: Modular Agents and Orchestrated Coordination using Open Agentic Protocols
December 4, 10:45–10:57 AM PT
Featuring @matthew_d_white
🔗 neurips.cc/virtual/2025/loc/san-diego/talk/12780
Booth: Meet with Us in the Exhibit Sponsor Hall
We’re proud to be a Diamond sponsor of NeurIPS 2025 alongside CNCF. Come visit us in the Exhibit Sponsor Hall A/B - Booth #723
#neurips2025 #neurips #opensource #opensourceai #pytorch -
PyTorch
@PyTorch
PyTorch Foundation is heading to NeurIPS 2025 with a full program of workshops, sessions, and community events, including our joint booth with Cloud Native Computing Foundation (CNCF) and the Open Source AI Reception with CNCF, Anyscale, Featherless AI, Hugging Face, and Unsloth AI.
Connect with PyTorch maintainers and ecosystem contributors throughout the conference this week. What to expect:
Workshop: Agentic Development at the Frontier
December 2, 4:00–5:00 PM PT
Featuring Joseph Spisak, Davide Testuggine, Aksel Joonas Reedi, Zach Wentz, Daniel Han, Sanyam Bhutani, and Aakanksha Choudhery
🔗 nips.cc/virtual/2025/loc/san-diego/128662?hss_channel=tw-…
Workshop: On Device/Edge AI
December 3, 12:00–1:30 PM PT
Featuring Cagatay Bilgin, Matthias Lecher, Andrey Tovchigrechko, Varun Khare, Vijay Janapa Reddi, Karan Goel, and Mitesh Patel
🔗 neurips.cc/virtual/2025/loc/san-diego/128674?hss_channel=…
Evening Event: Open Source AI Reception
December 3, 6:00–9:00 PM PT
Hosted by PyTorch Foundation & CNCF with Anyscale, Featherless, Hugging Face, and Unsloth at Union Kitchen and Tap Gaslamp in San Diego
🔗 Register to secure your spot: www.regfox.com
Talk: Modular Agents and Orchestrated Coordination using Open Agentic Protocols
December 4, 10:45–10:57 AM PT
Featuring Matt White
🔗 neurips.cc/virtual/2025/loc/san-diego/talk/127800?hss_cha…
Booth: Meet with Us in the Exhibit Sponsor Hall
We’re proud to be a Diamond sponsor of NeurIPS 2025 alongside CNCF. Come visit us in the Exhibit Sponsor Hall A/B - Booth #723
#neurips2025 #neurips #opensource #opensourceai #pytorch
PyTorch
@PyTorch
Join us for the Open Source AI Reception hosted
@CloudNativeFdn & PyTorch Foundation with @anyscalecompute, @FeatherlessAI, @huggingface
@UnslothAI
🔗 linuxfoundation.regfox.com/open-source-ai-reception-2025 -
PyTorch
@PyTorch
Training massive Mixture-of-Experts (MoE) models like DeepSeek-V3 and Llama 4-Scout efficiently is one of the challenges in modern AI. These models push GPUs, networks, and compilers to their limits.
To tackle this, AMD and Meta’s PyTorch teams joined forces to tune TorchTitan and Primus-Turbo, AMD’s open source kernel library, for the new Instinct MI325X GPUs. Together, they reached near-ideal scaling across 1,024 GPUs, showing that efficiency and scale don’t have to be a trade-off.
📎 Read our latest blog: pytorch.org/blog/efficient-moe-pre-training-at-scale-with…
#pytorchfoundation #opensourceai #torchtitan #moe -
PyTorch
@PyTorch
With its v5 release, Transformers is going all in on #pytorch. Transformers acts as a source of truth and foundation for modeling across the field; we've been working with the team to ensure good performance across the stack. We're excited to continue pushing for this in the future across training, inference, and deployment. - @matthew_d_white Executive Director, @PyTorch Foundation / GM of AI, @linuxfoundation
Lysandre
@LysandreJik
Transformers v5's first release candidate is out 🔥 The biggest release of my life.
It's been five years since the last major (v4). From 20 architectures to 400, 20k daily downloads to 3 million.
The release is huge, w/ tokenization (no slow tokenizers!), modeling & processing. -
PyTorch
@PyTorch
Open source is not just about code. It's also about the collaboration and the trust.
Our latest PyTorch Foundation Spotlight features PyTorch Ambassador @Zesheng_Zong who is working to make the community better and who recently received a 2025 PyTorch Contributor Award for Outstanding PyTorch Ambassador.
🎥 Watch the PyTorch Foundation Spotlight with Zesheng Zong on the PyTorch YouTube channel: youtu.be/4AHJjbsgfq8
#opensource #pytorch #opensourceai #pytorchambassadorThis media couldn't be displayed. See it on the original post. -
PyTorch
@PyTorch
📸 Scenes from the Future of Inferencing! PyTorch ATX, the @vllm_project community, and @RedHat brought together 90+ AI builders at Capital Factory back in September, to dive into the latest in LLM inference -> from quantization and PagedAttention to multi-node deployment.
Amazing energy, collaboration, and innovation from Austin’s growing AI community. 💡💪 Read more about it: pytorch.org/blog/the-future-of-inference-pytorch-atx-even…
Featuring sessions by @jasonmeaux @wattsteve @luka_govedic @root_fs Greg Pereira
#pytorchatx #vllm #redhat #aicommunity #llm #austintech #inferenceoptimization -
PyTorch
@PyTorch
Torch Ignite is coming to Patra, Greece on 28 November 2025 for a 3-hour, hands-on introduction to PyTorch. This workshop is built for beginners who want practical experience with tensors, autograd, optimization, and training a first neural network.
Participants will work directly in Google Colab, follow guided tutorials, and leave with runnable notebooks and a complete beginner-level model.
Event: Torch Ignite: From Tensors to Your First Neural Net
📆 November 28, Patra, Greece 🇬🇷
🔗 Register: docs.google.com/forms/d/e/1FAIpQLSdrF4YqDN4yLS9s-y39Kac5E…
#pytorch #opensourceai #aiinfrastructure #aibuilders -
PyTorch
@PyTorch
At NeurIPS next week? Join us at our Open Source AI Reception, an evening focused on open source collaboration hosted by @CloudNativeFdn and @PyTorch with @anyscalecompute, @FeatherlessAI, @huggingface, and @UnslothAI
Join AI enthusiasts, developers, and researchers for an evening of networking and conversation outside NeurIPS 2025. Drinks and light bites provided.
🔗 Register to secure your spot: www.regfox.com
Wednesday, December 3, 6:00–9:00 PM PT
Union Kitchen and Tap Gaslamp, San Diego, California, USA
#pytorch #neurips2025 #neurips #opensourceai -
PyTorch
@PyTorch
OpenReg introduces a self-contained simulator that provides a stable reference for integrating new accelerators with PyTorch through the PrivateUse1 DispatchKey. It functions as a test backend, an integration example, and a source of matching documentation.
The blog covers the CPU-based simulator, CI integration, operator registration, runtime support, and cross-platform availability, along with planned work in distributed computing, ONNX support, and compiler enhancements.
🔗 Read our latest blog from Jiahao Chen (Huawei), Jiawei Li (Huawei), and Zesheng Zong (Huawei): pytorch.org/blog/openreg-a-self-contained-pytorch-acceler…
#pytorch #aiinfrastructure #opensourceai #pytorchecosystem -
PyTorch
@PyTorch
AI innovation at AMD starts with solving challenges across the full stack, from the behavior of large foundation models to ensuring core operators run quickly and reliably at the hardware level.
In this PyTorch Conference conversation, Niles Burbank (Director, Solutions Architecture at AMD) explains how AMD provides hardware and software that accelerate basic operations to support the vision and promise of larger models, and shares why the event brings together users, practitioners, and developers across the AI spectrum in a way few others do.
📎 youtu.be/Eu7diYYI1oM
#pytorch #pytorchcon #amd #aiinfrastructureThis media couldn't be displayed. See it on the original post. -
PyTorch
@PyTorch
Our November newsletter is out now. This issue highlights the latest across the PyTorch community, including the PyTorch Conference 2025 recap, new ecosystem projects, 2.9 release, and upcoming events.
📨 Subscribe: pytorch.org/newsletter/?hss_channel=tw-776585502606721024
👉 pytorch.org/newsletter/november-2025/?hss_channel=tw-7765…
#pytorch #opensourceai #pytorchcon -
PyTorch
@PyTorch
Need to optimize applications with large models and stretched memory resources?
Learn how to accelerate large-scale LLM inference and Cache Offload with CPU-GPU Memory Sharing in NVIDIA’s recent developer tech blog:
📎: developer.nvidia.com/blog/accelerate-large-scale-llm-infe…
#pytorch #opensourceai #ai #inference #innovation -
PyTorch
@PyTorch
PINA has joined the PyTorch Ecosystem, bringing a unified framework for Scientific Machine Learning to researchers and engineers.
PINA is an open source Python library built on PyTorch, PyTorch Lightning, and compatible with PyTorch Geometric. It streamlines SciML workflows for modelling physical systems, solving PDEs, building machine learning force fields, simulating dynamics, and more. Its modular structure spans problem definition, model design, solver selection, and training, offering both flexibility and reproducibility.
🔗 Learn more and explore how to get involved: pytorch.org/blog/pina-joins-the-pytorch-ecosystem-a-unifi…
#pytorch #opensourceai #sciml #machinelearning -
PyTorch
@PyTorch
Hear directly from Dwarak Rajagopal (Vice President of AI Engineering and Research, @Snowflake on why @Snowflake chose premier membership with the PyTorch Foundation and how open source collaboration shapes their approach to enterprise AI.
In this video, Dwarak explains how PyTorch powers the Snowflake AI Research Team’s applied research, connects innovation to production, and enables Snowflake to contribute training and inference optimizations back to the community.
“PyTorch plays a critical role in our research, bridging the gap between open innovation and enterprise AI,” said Rajagopal.
Watch to learn how Snowflake is advancing open source AI and driving the future of secure, scalable AI research and deployment, and check out Snowflake's blog post to learn more about Snowflake's sessions at PyTorch Conference.
📹 youtu.be/RQkwxpUXyv0
🔗 Snowflake's blog: www.snowflake.com/en/engineering-blog/pytorch-conference-…
#pytorch #aiinfrastructure #opensourceai #aibuildersThis media couldn't be displayed. See it on the original post. -
PyTorch
@PyTorch
Our latest PyTorch Foundation Spotlight features PyTorch Ambassador Ankita Guha, whose work with neural networks and survival analysis led to finding PyTorch and the community behind it.
In the video, Ankita talks about learning through experimentation, realizing the scale of the PyTorch community, and plans to help foster local communities in Michigan and beyond so people can learn and contribute together.
🎥 Watch the PyTorch Foundation Spotlight with Ankita Guha: youtu.be/-tv3U8GKf7c
#pytorch #opensourceai #aiinfrastructure #pytorchambassadorThis media couldn't be displayed. See it on the original post. -
PyTorch
@PyTorch
Enable fast and scalable simulation of atomic systems for chemistry and materials science research by integrating PyTorch-based MLIPs into the LAMMPS MD package through the ML-IAP-Kokkos interface.
Learn more about how developers can simplify the process of interfacing community models and scale MD simulations in NVIDIA’s developer blog:
🔗 developer.nvidia.com/blog/enabling-scalable-ai-driven-mol…
#pytorch #opensourceai #ai #inference #innovation -
PyTorch
@PyTorch
Our latest community blog explores how sparsity can unlock new efficiency for LLM inference in PyTorch. As model sizes and compute needs grow, sparsity offers a clear path to faster, more energy-efficient deployment.
In this post, Kira Selby and Varun Khare (@AKAvkkhare), @NimbleEdgeInc, share techniques like CETT thresholding, Relufication, weight caching, and statistical top-k that enable up to 6x faster inference and advance a unified framework for sparse inference.
🔗 Read the blog: pytorch.org/blog/beyond-quantization-bringing-sparse-infe…
#pytorch #aiinfrastructure #edgeai #opensource -
PyTorch
@PyTorch
In addition to PyTorch itself, the PyTorch Foundation hosts projects like vLLM, DeepSpeed, and Ray, a clear signal that PyTorch is becoming the foundational language of AI.
For Luca Antiga, @LightningAI CTO and the first PyTorch Foundation TAC Chair, the PyTorch Conference was about connecting with the community driving PyTorch forward, including the millions of developers building with PyTorch Lightning.
Part of what makes the event so remarkable is that you bump into people that are building on top of PyTorch to create amazing things.
🎥 View the video on YouTube: youtu.be/GKtRctlviDQ
#pytorchfoundation #pytorchcon #pytorch #opensourceai #lightningaiThis media couldn't be displayed. See it on the original post. -
PyTorch reposted
Anush Elangovan
@AnushElangovan
vLLM x Meta x AMD meetup full house - great to see the momentum build around a fully open source software ecosystem.
-
PyTorch
@PyTorch
PyTorch Conference 2025 brought together over 3,000 developers, researchers, and innovators from more than 1,000 organizations across the global AI ecosystem for keynotes, sessions, and collaboration in San Francisco.
Read the full conference recap on the PyTorch blog for highlights from keynotes, co-located summits, new PyTorch-native technologies, and major ecosystem updates, including new Premier Members and hosted projects that expand the reach of open source AI.
🔗 pytorch.org/blog/pytorch-conference-2025-recap/
🎥 Watch the recap video to experience the event in motion
#pytorch #pytorchcon #aiinfrastructure #opensourceaiThis media couldn't be displayed. See it on the original post. -
PyTorch
@PyTorch
Today at AI Summit & Seoul Expo 2025, Matt White presents “From Code to Agency: Open Source and Standards for the Next Generation of AI Agents” from 2:00–2:45 PM (GMT +9)
The session explores how open source, open standards, and new licensing models like OpenMDW address gaps in traditional software licenses across the AI lifecycle. It also highlights emerging protocols such as Model Context Protocol (MCP), Agent-to-Agent (A2A) communication, and the AGNTCY framework that enable interoperability, governance, and accountability for autonomous systems built on shared values.
🔗 Learn more: www.aisummitseoul.com?hss_channel=tw-776585502606721024
#pytorch #opensourceai #aistandards #aiinfrastructure -
PyTorch
@PyTorch
More than 3,000 developers, researchers, and innovators came together in San Francisco for #pytorchcon 2025 for two days of keynotes, technical sessions, and community connection across the global AI ecosystem.
The recap video captures the collaboration and energy that defined this year’s event. Watch the highlights below and explore all session recordings from the conference and co-located events on the PyTorch YouTube channel.
🖇️ PyTorch Conference Sessions: youtube.com/playlist?list=PL_lsbAsL_o2BUUxo6coMBFwQE31U4Eb2q
📷 Open Agent Summit: youtube.com/playlist?list=PL_lsbAsL_o2DOrjInFJM13UlgR1yaMVdc
💡 Measuring Intelligence Summit: youtube.com/playlist?list=PL_lsbAsL_o2BzTJK8AMHjpgXQmqmTis2Y
🎬 AI Infra Summit: youtube.com/playlist?list=PL_lsbAsL_o2AxTov75-rA39hcZEYWOMH_
🎥 Watch the recap video below
Thank you to our Planning Committee, Program Chairs, Program Committee, and Sponsors for making PyTorch Conference 2025 possible.
🔗 More on the incredible people and organizations who made PyTorch Conference 2025 possible: events.linuxfoundation.org/pytorch-conference/program/mee…
#pytorchcon #pytorch #opensourceai #aiinfrastructureThis media couldn't be displayed. See it on the original post. -
PyTorch
@PyTorch
At PyTorch Conference 2025, Annie Tallund (Arm) showed how developers can train, fine-tune, and deploy neural graphics models using the PyTorch ecosystem.
The new Model Training Gym, part of Arm’s open source Neural Graphics Development Kit, supports the full ML lifecycle for real-time rendering, from PyTorch-based training to deployment with ExecuTorch.
📖 Read Arm's blog to see how neural graphics is shaping the future of game development and start building today: developer.arm.com/community/arm-community-blogs/b/mobile-…
#pytorchcon #pytorch #aiinfrastructure #opensourceai #neuralgraphics -
PyTorch
@PyTorch
As the #opensourceai ecosystem matures, defining what “open” truly means has become increasingly complex.
In this clip from today's webinar, IBM Research’s Mo McElaney explains why the community may need two complementary approaches: one grounded in open science for transparency and research, and another in #opensource for practical implementation and governance.
🔗 Watch the full recording: www.youtube.com/live/Av9lXbSenTk
#pytorch #vllm -
PyTorch reposted
Anush Elangovan
@AnushElangovan
vLLM + Meta + AMD Meetup: luma.com/omyx0f33
-
PyTorch
@PyTorch
KernelFalcon achieves 100% correctness across all 250 KernelBench L1–L3 tasks through a deep agent architecture that structures the problem instead of prompting harder.
The system combines hierarchical task decomposition, deterministic orchestration, grounded execution, and parallel verification to generate GPU kernels that compile to PTX, execute on real hardware, and preserve PyTorch semantics.
💡Read our latest blog from @LaurawlyLaura and collaborators at Team PyTorch:
pytorch.org/blog/kernelfalcon-autonomous-gpu-kernel-gener…
#pytorch #kernelfalcon #aiinfrastructure #opensourceai -
PyTorch
@PyTorch
Hybrid models like Qwen3-Next, Nemotron Nano 2 and Granite 4.0 are now fully supported in vLLM! Check out our latest blog from the vLLM team at IBM to learn how the vLLM community has elevated hybrid models from experimental hacks in V0 to first-class citizens in V1.
🔗 pytorch.org/blog/hybrid-models-as-first-class-citizens-in…
#vllm #pytorch #opensourceai #hybridmodels -
PyTorch
@PyTorch
Tomorrow, IBM Research’s Mo McElaney leads The Free Puppy: How to Responsibly Leverage #opensourceai, a webinar exploring how to assess and adopt open source #ai responsibly.
The session covers definitions of openness, licensing considerations, community health, transparency, and explainability.
🔗 Register: pytorch.org/event/the-free-puppy-how-to-responsibly-lever…
#pytorch #ospo -
PyTorch
@PyTorch
DeepInverse has joined the PyTorch Ecosystem, making imaging with deep learning easier and more reproducible across research and industry.
DeepInverse is an open source framework for solving imaging inverse problems in medical imaging, computational photography, remote sensing, astronomical imaging, microscopy and more. DeepInverse makes imaging with deep learning easy and is developed by a passionate community of researchers, practitioners and engineers.
🔗 Learn more & explore how to get involved: pytorch.org/blog/deepinverse-joins-pytorch-ecosystem/?hss…
#pytorch #opensourceai #deepinverse #imaging #deeplearning -
PyTorch
@PyTorch
Matt White speaks @ScaleByTheBay's #aibythebay (Nov 17–19, Oakland) on “Beyond Open Weights” — how open source and open standards are shaping the next wave of agentic #ai.
Hear from Peter Norvig (Stanford), Lisa N. Cao (Databricks), Danica Fine (Snowflake), Mihai Maruseac (Google), Angie Jones (Block), and Vasanth Mohan (SambaNova).
🎟️ Register & learn more: ai.bythebay.io?hss_channel=tw-776585502606721024
#pytorch #opensourceai -
PyTorch
@PyTorch
🎉 Congrats to the 2025 #pytorch Contributor Award winners & nominees!
🏅 Winners: Vincent Moens, Mingfei Ma, Eikan Wang, Irakli Salia, Jiawei Li, Aaron Gokaslan, Justin Silver, Jonathan Dekhtiar, Xuehai Pan, Zingo Andersen, Zesheng Zong.
Nominees: Abdulsalam Yazid Bande, ghostspiders, Muhammed Tolga Cangöz, Yu Guangye, Masahiro Hiramori, Xu Han, Kaichao You, Simon Mo, Ralf Gommers, Logan Thomas, Sayak Paul, Hussain.
🔗 Read the announcement for more: pytorch.org/blog/pytorch-contributor-awardees-2025/?hss_c…
#pytorchfoundation #pytorch #opensourceai -
PyTorch
@PyTorch
LMCache joins the #pytorch Ecosystem, advancing scalable #llm inference through integration with @vllm_project.
Developed at the University of Chicago, LMCache reuses and shares KV caches across queries and engines, achieving up to 15× faster throughput.
🔗 pytorch.org/blog/lmcache-joins-pytorch-ecosystem/?hss_cha…
#opensourceai #aiinfrastructure -
PyTorch
@PyTorch
Anyscale has contributed Ray to #pytorch Foundation, joining #pytorch, vLLM, and DeepSpeed under open governance to advance scalable, distributed AI infrastructure.
@janakiramm (@Forbes) on how this model reduces fragmentation and fosters transparent collaboration ⬇️ -
PyTorch
@PyTorch
As #opensourceai adoption accelerates, clarity around what “open” truly means is critical. Mo McElaney, Open Source Developer Programs Lead at IBM Research, will explore how to evaluate licensing, transparency, and community health for responsible AI adoption.
🔗 -
PyTorch
@PyTorch
A new #lfresearch study with @Meta explores how #opensourceai adoption across 11 APEC economies is boosting innovation, productivity, and local capacity. See how open models and tools like #pytorch are shaping growth across key sectors.
🔗 www.linuxfoundation.org/research/open-source-ai-apec?hss_… -
PyTorch
@PyTorch
At #aiinvestmentsummit Berkeley 2025, #pytorch Executive Director Matt White joins the panel “Designing AI-Native Products — Innovation and Data Feedback Loops” to discuss why #opensourceai is key to sustainable, interoperable innovation.
🔗 luma.com/summit_berkeley?hss_channel=tw-776585502606721024
#opensourceai -
PyTorch
@PyTorch
Next in our PyTorch Compiler Video Series, Sayak Paul introduces Diffusers, a Python library for state-of-the-art video, image, and audio generation, highlighting its optimization with torch.compile for performance benefits like offloading, LoRA, and quantization.
▶️ Watch the full video on YouTube: www.youtube.com/watch?hss_channel=tw-776585502606721024&v… -
PyTorch reposted
Lightning AI ⚡️
@LightningAI
Distributed training shouldn’t feel like DevOps work. @Meta’s Monarch runs @PyTorch across clusters with the same speed and UX as a single notebook.
And now, Monarch and Lightning AI are bringing large-scale PyTorch training directly into Lightning Studio.
This launch sets a new standard for cluster-scale development, giving you the same fast, notebook-like experience, now distributed across GPUs with zero setup.
Train, debug, and scale, all from one familiar tool.
lightning.ai/meta-ai/environments/large-scale-interactive… -
PyTorch
@PyTorch
Why PyTorch Won 🎥 At #pytorchcon, @thenewstack spoke with @lantiga, PyTorch Foundation TAC Chair, on how PyTorch became the framework for researchers & developers worldwide 🌐
See the full interview 👉 thenewstack.io/why-pytorch-won/ -
PyTorch
@PyTorch
🎉 Congrats to the #pytorch Contributor Award 2025 winners! 🎉
Honoring community members who power innovation, collaboration, and the PyTorch spirit🔥
🏅 Zesheng Zong — Outstanding PyTorch Ambassador
🏅 Zingo Andersen — PyTorch Review Powerhouse
🏅 Xuehai Pan — PyTorch Problem Solver
🏅 Jonathan Dekhtiar — PyTorch Innovator
🏅 Justin Silver — PyTorch Trail Blazer
🏅 Aaron Gokaslan — PyTorch Rock Turner
🏅 Jiawei Li — PyTorch Ecosystem Champion
🏅 Irakli Salia — PyTorch Newcomer
🏅 Eikan Wang — PyTorch Pacesetter
🏅 Mingfei Ma — PyTorchbearer
🏅 Vincent Moens — PyTorch Superhero
#opensourceai #pytorchcommunity -
PyTorch
@PyTorch
Thank you to everyone who made PyTorch Conference 2025 such a success. The collaboration, energy, and ideas shared in San Francisco showed the strength of our community and the momentum behind open source AI.
We’re already looking forward to next year — PyTorch Conference 2026 will take place in San Jose, October 20–21, 2026. Expect more opportunities to connect, learn, and shape the future of AI together.
🔥 Many more highlights from this week's conference to come! Stay tuned.
#pytorchcon #pytorch #opensourceai #aiinfrastructure -
PyTorch
@PyTorch
Continuing the afternoon keynotes at #pytorchcon: Eric Xing of MBZUAI, CMU, and Genbio AI presents “An OPEN Path to Super Intelligence.”
Exploring the future of open collaboration and research driving the next era of intelligent systems.
🔗 Watch remaining PyTorch Conference keynotes here: events.linuxfoundation.org/pytorch-conference-north-ameri…
#opensourceai #pytorchlive -
PyTorch
@PyTorch
Up next in the afternoon keynotes at #pytorchcon: “Hardware & Accelerators.”
A discussion with Dylan Patel (SemiAnalysis), Sharon Zhou (AMD), Peter Salanki (CoreWeave), and Nitin Perumbeti (Crusoe Energy), moderated by Mark Saroufim of Meta, on scaling compute and innovation across the AI hardware ecosystem.
🔗 Watch the rest of day 2 keynotes live: events.linuxfoundation.org/pytorch-conference-north-ameri…
#aiinfrastructure #pytorchlive -
PyTorch
@PyTorch
Continuing the afternoon keynotes at #pytorchcon: Jeremy Howard of www.fast.ai?hss_channel=tw-776585502606721024 in conversation with Anna Tong of Forbes.
A discussion on the state of open source AI, model transparency, and the pathways to broader AI literacy and accessibility.
🔗 Watch live: events.linuxfoundation.org/pytorch-conference-north-ameri…
#aiinfrastructure #pytorchlive -
PyTorch
@PyTorch
Kicking off the afternoon keynotes at #pytorchcon: Dawn Song of UC Berkeley presents “Towards Building Safe and Secure Agentic AI.”
Exploring approaches to ensuring reliability, safety, and trust in the next generation of intelligent systems.
🔗 Watch live: events.linuxfoundation.org/pytorch-conference-north-ameri…
#opensourceai #pytorchlive -
PyTorch
@PyTorch
Congratulations to Curavoice, winner of the PyTorch Startup Showcase Community Choice Award at #pytorchcon!
Presented by Shrey Modi, this award celebrates one of the participating AI startups from Tuesday's live showcase, sponsored by Dell Technologies Capital and Mayfield.
#pytorch #startupshowcase #opensourceai -
PyTorch
@PyTorch
Congratulations to Runhouse, winner of the PyTorch Startup Showcase Award at #pytorchcon!
Presented by Donny Greenberg, this award recognizes a standout AI startup from Tuesday's live showcase, sponsored by Dell Technologies Capital and Mayfield.
#pytorch #startupshowcase #opensourceai -
PyTorch
@PyTorch
Wrapping up the morning keynotes at #pytorchcon: Sergey Levine of UC Berkeley presents “Robot Foundation Models.”
A forward look at how #pytorch research in robotics and embodied intelligence is shaping the next frontier of AI development.
🔗 Watch live streams of afternoon keynotes starting at 1:35 pm PST: events.linuxfoundation.org/pytorch-conference-north-ameri…
#opensourceai #aiinfrastructure #pytorchlive -
PyTorch
@PyTorch
Continuing the morning keynotes at #pytorchcon: “Signal vs. Noise: Betting on AI’s Next Wave.”
Joe Spisak of Meta moderates a panel with Sarah Catanzaro (Amplify Partners), Sarah Guo (Conviction), Brian Zhan (Striker Venture Partners), and Peter Deng (Felicis) on investing in AI’s next chapter.
🔗 Watch live: events.linuxfoundation.org/pytorch-conference-north-ameri…
#opensourceai #pytorchlive
PyTorch
@PyTorch
More from this star-studded panel moderated by @joespeez, ft @sarahcat21, @saranormous, @brianzhan1, @pxd
-
PyTorch
@PyTorch
Morning keynotes continue at #pytorchcon with Percy Liang of Stanford University and Together presenting “Marin: An Open Lab for Frontier AI.”
A look at how open, community-driven research environments accelerate responsible innovation in #opensourceai.
🔗 Watch live: events.linuxfoundation.org/pytorch-conference-north-ameri…
#aiinfrastructure #pytorchlive -
PyTorch
@PyTorch
Day two of #pytorchcon is underway. Joe Spisak of Meta and Lysandre Debut of Hugging Face are on stage now to kick off the morning with a keynote spotlighting open collaboration and the evolving role of the #pytorch ecosystem in #opensourceai.
🔗 Watch live: events.linuxfoundation.org/pytorch-conference-north-ameri…
#aiinfrastructure #pytorchlive -
PyTorch
@PyTorch
Final day of #pytorchcon! 🎉
Post your moments or takeaways from PyTorchCon or this week’s co-located events with #pytorchcon + #pytorchlive and tag @PyTorch for a chance to win PyTorch gear.
🏆 Winners announced today at 3 PM PT (Room 3000 – 3012) during the closing keynote. -
PyTorch
@PyTorch
Explore new ideas at the #pytorchcon 2025 Poster Presentations.
Meet speakers, ask questions, and learn about the latest work in open source AI.
🗓️ Wed, Oct 22 | 6:00–7:30 PM
📍 Exhibit Hall
🔗 events.linuxfoundation.org/pytorch-conference-north-ameri… -
PyTorch
@PyTorch
The final afternoon session at #pytorchcon is underway: the Agentic AI keynote panel.
Aparna Dhinakaran (Arize AI), Jerry Liu (LlamaIndex), Adam Jones (Anthropic), and Samuel Colvin (Pydantic), moderated by Ben Lorica, explore the evolving role of agentic systems in open source AI.
🔗 Livestream this and upcoming keynotes here: events.linuxfoundation.org/pytorch-conference-north-ameri…
#pytorchlive #pytorch #opensourceai -
PyTorch
@PyTorch
Jeff Gehlhaar, @Qualcomm, discusses how the company is unlocking AI at scale for PyTorch developers in today’s sponsored keynote.
📸 Livestream final Day 1 keynotes here: events.linuxfoundation.org/pytorch-conference-north-ameri…
#pytorchlive #pytorch #opensourceai -
PyTorch
@PyTorch
Happening now: Alban Desmaison, Peng Wu, Mark Saroufim, and Edward Yang (Meta) share a PyTorch Technical Deep Dive on framework development since last year’s conference.
🔗 Watch the livestream here: events.linuxfoundation.org/pytorch-conference-north-ameri…
#pytorchcon #pytorchlive #opensourceai -
PyTorch
@PyTorch
Anush Elangovan, @AMD, shares how AMD and #pytorch are empowering developers to build AI anywhere with ROCm software — from cloud to client.
📸 Livestream afternoon PyTorch sessions: events.linuxfoundation.org/pytorch-conference-north-ameri…
#pytorchlive #opensourceai -
PyTorch
@PyTorch
Afternoon keynotes continue with Animashree (Anima) Anandkumar's, Bren Professor of Computing and Mathematical Sciences at Caltech, session, “Foundations for AI+Science.” Clip below 🎥
📸 Happening now at #pytorchcon.
#pytorchlive #pytorch #opensourceai -
PyTorch
@PyTorch
Welcome back to the afternoon keynote sessions at #pytorchcon!
Executive Director Matt White takes the stage with special guest Joe Spisak, Product Director at Meta, to continue a full day of keynotes and conversations advancing open source AI.
📸 Happening now.
#pytorchlive #pytorch #opensourceai -
PyTorch
@PyTorch
Integrate Monarch, a distributed execution engine for PyTorch designed to deliver a high-quality, notebook-like user experience at cluster scale, as an offering Lightning Studio.
The focus will be on seamless compatibility with Lightning’s Studio (and Fabric APIs as a stretch TBC) , enabling researchers and engineers to leverage Monarch’s distributed capabilities with minimal code changes, both within Lightning AI Studio.
By PyTorch Team at Meta & Lightning AI: pytorch.org/blog/integration-idea-monarch/?hss_channel=tw…
#pytorch #monarch #opensourceai #pytorchcon -
PyTorch
@PyTorch
#pytorchcon Day 1 is buzzing 🔥
Keep posting your favorite talks, takeaways, and photos from PyTorchCon or co-located events with #pytorchcon + #pytorchlive and tag @PyTorch.
We’ll pick our favorite posts — winners announced Thu Oct 23 during the closing keynote. -
PyTorch
@PyTorch
Come say hello to the PyTorch Foundation team as you explore the exhibit hall and connect with projects, partners, and community members driving the future of open source AI.
The PyTorch booth (G13) is open — stop by to learn more about the foundation and its hosted projects.
📸 Photos from the booth below.
#pytorchcon #opensourceai #pytorchlive -
PyTorch
@PyTorch
Bring a piece of PyTorch Conference 2025 home with you. The PyTorch Gear Store features exclusive conference merch including hoodies, tees, stickers, and more. Available in the Exhibit Hall throughout the event.
🔗 events.linuxfoundation.org/pytorch-conference-north-ameri…
#pytorchcon #pytorch #opensourceai #ai -
PyTorch
@PyTorch
Kernel authoring is a key to unlocking the full performance of AI on modern hardware accelerators. Helion, a new kernel authoring language, makes authoring a highly performant custom kernel feel a lot like writing regular PyTorch code.
Read the blog from the PyTorch Team at Meta: pytorch.org/blog/helion/?hss_channel=tw-776585502606721024
Contributors include: @jansel0, @oguz_ulgen, @yfengus, @JongsokC
#pytorch #opensourceai #helion #pytorchcon -
PyTorch
@PyTorch
A big thank-you to our morning keynote speakers for kicking off #pytorchcon with insights spanning infrastructure, distributed compute, reasoning models, and robotics — all driving the future of open source AI.
After Matt White got the party started, we heard from:
🎤 Eli Uriegas, Meta – Recognizing the PyTorch Foundation CICD Infrastructure Community
🎤 Simon Mo, UC Berkeley / vLLM & Tunji Ruwase, Snowflake – vLLM & DeepSpeed Updates
🎤 Robert Nishihara, Anyscale & Ion Stoica, UC Berkeley / Anyscale / Databricks / Conviva – Ray: A Distributed Compute Engine for AI
🎤 Jim Fan, NVIDIA – The Physical Turing Test: Solving General Purpose Robotics
🎤 Christian Jacobi, IBM – From Transactions to Transformers: Hardware Built for Enterprise AI
🎤 Nathan Lambert, AI2 – Olmo-Thinking: Training a Fully Open Reasoning Model
📸 Photos from the keynotes below.
🔗 Schedule for rest of Day 1: events.linuxfoundation.org/pytorch-conference-north-ameri…
#pytorch #opensourceai #pytorchlive -
PyTorch
@PyTorch
After a full first day at #pytorchcon 2025, relax at the Flare Party sponsored by neptune.ai?hss_channel=tw-776585502606721024.
Enjoy music, drinks, and networking in the Exhibit Hall (6–9 PM) — plus Poster Sessions from 6–7:30 PM with speakers sharing their latest #pytorch work.
🔥 -
PyTorch
@PyTorch
Announcing torchcomms – a new PyTorch API for distributed programming designed to support scalability, fault tolerance, heterogeneity, and extensibility. Torchcomms makes it easier for developers to leverage innovations in existing and new collective communications backends like NCCL, RCCL, and NCCLX.
Read the full blog from Team torchcomms at Meta here: pytorch.org/blog/torchcomms/?hss_channel=tw-7765855026067…
#torchcomms #pytorch #api #opensourceai #pytorchcon -
PyTorch
@PyTorch
🚀 Excited to announce the release of ExecuTorch 1.0! Now, you can deploy PyTorch models seamlessly to edge devices—mobile, embedded, or desktop—without conversion or rewriting. ExecuTorch supports a wide range of hardware backends and model types, making on-device AI more accessible than ever.
🔗 Read the full blog from the PyTorch Team at Meta here: pytorch.org/blog/introducing-executorch-1-0/?hss_channel=…
#executorch #pytorch #opensourceai #ai #pytorchcon -
PyTorch
@PyTorch
Meet leading AI authors at #pytorchcon 2025.
Join Chip Huyen (Wed) and Sebastian Raschka (Thu) for book signings in the Expo Hall—connect, learn, and take home a signed copy.
🗓️ Oct 22–23
🔗 events.linuxfoundation.org/pytorch-conference-north-ameri… -
PyTorch
@PyTorch
Keynote sessions are underway! Executive Director Matt White opens #pytorchcon with a look back at the PyTorch Foundation’s remarkable year of growth.
As an umbrella foundation, PyTorch Foundation connects developers, researchers, and industry pioneers to accelerate collaboration, spark innovation, and build the future of open source AI.
Now on stage, Meta's @_seemethere! #pytorchlive
🔗 Find the full schedule here: events.linuxfoundation.org/pytorch-conference-north-ameri…
#pytorchcon #pytorch #opensourceai -
PyTorch
@PyTorch
Today Meta announced torchforge, a brand-new PyTorch-native library that makes it easy to use reinforcement learning (RL) to train AI agents.
Forge provides high-performance building blocks and ready-to-use examples, so you can focus on what’s novel about your use case rather than reinventing infrastructure. Built by the PyTorch team at Meta, Forge integrates seamlessly with environments, trainers, and deployment systems—bridging the gap between RL research and scalable, production-ready agentic development.
Read our blog to learn more: pytorch.org/blog/introducing-torchforge/?hss_channel=tw-7…
#forge #pytorch #opensourceai -
PyTorch
@PyTorch
And so it begins! Welcome to PyTorch Conference 2025 🔥 #pytorchcon #pytorchlive
-
PyTorch
@PyTorch
We’re excited to welcome Ray to the PyTorch Foundation 👋 @raydistributed is an open source distributed computing framework for #ai workloads, including data processing, model training and inference at scale. By contributing Ray to the @PyTorch Foundation, @anyscalecompute reinforces its commitment to open governance and long-term sustainability for Ray and open source AI. ➡️ Read the announcement: pytorch.org/blog/pytorch-foundation-welcomes-ray-to-deliv… #pytorchcon
-
PyTorch
@PyTorch
We’re excited to welcome @DellTech as a Premier Member of the PyTorch Foundation 🎉
👉 Read the announcement: pytorch.org/blog/dell-technologies-joins-the-pytorch-foun…
#pytorch #dell #opensource -
PyTorch
@PyTorch
Day 1 of #pytorchcon starts now in SF! 🎉
Share your moments, photos, or takeaways from PyTorchCon or this week’s co-located events with #pytorchcon + #pytorchlive and tag @PyTorch.
PyTorch gear up for grabs — winners announced Thu Oct 23 at the closing keynote. -
PyTorch
@PyTorch
Today’s the day! #pytorchcon is LIVE in San Francisco! 🎉
Get ready for ✌️ days of groundbreaking sessions, hands-on learning & community energy you can’t find anywhere else.
Meet us at the epicenter of #ai innovation - you still have time to register! events.linuxfoundation.org/pytorch-conference-north-ameri… -
PyTorch
@PyTorch
Today Meta announced #monarch, a new framework for distributed programming that delivers scalability without sacrificing performance.
Monarch can be used to drive, or even debug, a large cluster in a notebook. It can also orchestrate large, fault tolerant model pre-training or highly asynchronous and heterogenous reinforcement learning jobs.
🔗 Read the blog from the PyTorch Team at Meta: pytorch.org/blog/introducing-pytorch-monarch/?hss_channel…
Contributors include: @marius, @joespeez
#pytorch #opensourceai #pytorchcon -
PyTorch
@PyTorch
The Startup Showcase is happening now at PyTorch Conference 2025, where AI startups are pitching live to top VCs.
Startups presenting: Graphsignal, Runhouse, NimbleEdge, XOR, Snapshot AI, Node One, BrightOnLABS, Okahu AI, CuraVoice, Seer Systems, KnowNext, and Backfield AI.
Judges: Chappy Asel (The GenAI Collective), Irving Hsu (Mayfield), Radhika Malik (Dell Technologies Capital), Kevin Crosby (GitHub), Denise Teng, and Simon Tiu.
Sponsored by Dell Technologies Capital and Mayfield.
Stay tuned for more!
🔗 Learn more: events.linuxfoundation.org/archive/2024/pytorch-conferenc…
#pytorchcon #pytorch #startupshowcase -
PyTorch
@PyTorch
The Reinforcement Learning track at #pytorchcon highlights new directions for RL with #pytorch.
Hear Chenyang Zhao (UCLA) on optimizing long-tail and MoE challenges in RL with SGLang, and Daniel Han (Unsloth) on maximizing luck in reinforcement learning.
🔗 Explore sessions: -
PyTorch
@PyTorch
#vllm V1 now runs on AMD GPUs. Teams from IBM Research, Red Hat & AMD collaborated to build an optimized attention backend using Triton kernels, achieving state-of-the-art performance.
🔗 Read: pytorch.org/blog/enabling-vllm-v1-on-amd-gpus-with-triton…
#pytorch #opensourceai -
PyTorch
@PyTorch
The PyTorch in Academia track at #pytorchcon shows how #pytorch is driving advances in research and education, from space science to climate modeling.
Hear from speakers at NASA JPL, University of Cambridge, University of Toronto, LSU, Couchbase, and SSPS.
🔗 Explore sessions: -
PyTorch
@PyTorch
Live from the AI Infra Summit, co-located with #pytorchcon — Tianqi Chen (@nvidia) explores how shared ML foundations can advance interoperability across compilers, libraries, DSLs, and frameworks, while unifying workloads across edge and cloud.
🔗 aiinfrasummit2025.sched.com?hss_channel=tw-77658550260672…
#aiinfrasummit #opensourceai #aiinfrastructure -
PyTorch
@PyTorch
Our LLMs track at #pytorchcon explores the latest in large language models with #pytorch, from cutting-edge architectures to training optimizations and real-world applications.
Hear from experts at Meta, NVIDIA, Arm, IBM Research, LMSYS Org, Tep Studio, Hugging Face, ByteDance, Union ai, Moonshot AI, and more.
🔗 Explore sessions: pytorchconference.sched.com/overview/type/LLMs?iframe=no&… -
PyTorch
@PyTorch
Our Foundation Projects and Ecosystem track at PyTorch Conference 2025 delivers updates and roadmaps from PyTorch, vLLM, and DeepSpeed, plus integration insights from Hugging Face, Anyscale, Amazon, Intel, BAAI, and more.
Who should attend: PyTorch users, contributors, and ecosystem developers.
What you’ll learn: project roadmaps, integration strategies, and best practices for working across the PyTorch ecosystem.
Sessions will include speakers Robert Nishihara (Anyscale), Simon Mo (vLLM), Yonghua Lin (BAAI), Lysandre Debut (Hugging Face), Arthur Zucker (Hugging Face), Tristan Rice (Meta), Yahav Biran (Amazon), Fan Zhou (Intel), Eikan Wang (Intel), Daniel Vega-Myhre (Meta), Ke Wen (Meta), Natalia Gimelshein (Meta), Tunji Ruwase (Snowflake), and Aurick Qiao (Snowflake).
📅 October 22–23, 2025 • San Francisco
🔗 Explore the sessions: pytorchconference.sched.com/overview/type/Foundation+Proj…
#pytorchcon #pytorch #opensourceai #aiinfrastructure -
PyTorch
@PyTorch
Happening now at #pytorchcon — the PyTorch Associate Training. Participants are building real-world #pytorch skills through hands-on labs, guided instruction, and projects aligned with the upcoming PyTorch Certified Associate exam.
🔗 events.linuxfoundation.org/pytorch-conference-north-ameri…
#opensourceai -
PyTorch
@PyTorch
NVIDIA is on the ground at #pytorchcon during #opensourceaiweek—celebrating the innovation and collaboration driving #opensourceai.
PyTorch runs on @nvidia CUDA, now with first-class #python support to boost developer access to #gpu acceleration. 🔗
blogs.nvidia.com/blog/open-source-ai-week/?ncid=so-link-1…
#pytorch -
PyTorch
@PyTorch
#pytorchcon Measuring Intelligence Summit features @polynoamial of @OpenAI discussing reasoning, planning, & inference time scaling with @joespeez of @Meta #opensource #ai
This media couldn't be displayed. See it on the original post. -
PyTorch
@PyTorch
We’re live from the Open Agent Summit, kicking off PyTorch Conference week in San Francisco. Matt White opened the day, followed by Dawn Song, Professor at UC Berkeley, with a keynote on building safe and secure agentic AI.
🔗 Explore the full summit schedule: openagentsummit2025.sched.com?hss_channel=tw-776585502606…
#pytorchcon #pytorch #opensourceai -
PyTorch
@PyTorch
It’s almost time! #pytorchcon kicks off TOMORROW in San Francisco! 🎉
Join us for 2️⃣ days of groundbreaking sessions, hands-on learning & unforgettable networking.
Pro tip: Attend the Keynote Sessions daily for your chance to win epic raffle prizes. Must be present to win 👀
🔗 Register now: events.linuxfoundation.org/pytorch-conference-north-ameri… -
PyTorch
@PyTorch
Measuring Intelligence Summit at #pytorchcon kicks off with keynote by @joespeez introducing the central themes of evaluation, benchmarking, & the future of measuring progress in machine reasoning
-
PyTorch
@PyTorch
Birds of a Feather (BoF) sessions at #pytorchcon 2025 bring attendees together to discuss shared topics in AI, ML, and PyTorch. Join conversations on edge AI, DevSecOps, and responsible AI.
📍 Exhibit Hall, BoF Lounge
🗓️ Oct 22–23
🔗 events.linuxfoundation.org/pytorch-conference-north-ameri… -
PyTorch
@PyTorch
ML practitioners and infrastructure engineers can dive into distributed training, parallelism, and large-scale deployment in the PyTorch at Scale track at #pytorchcon.
Learn strategies for training and serving #pytorch models at production scale with experts from Meta, NVIDIA, AMD, Pinterest, Snowflake, Lambda Labs, www.crusoe.ai?hss_channel=tw-776585502606721024, Grafana Labs, Google, and more.
🔗 Explore sessions: pytorchconference.sched.com/overview/type/PyTorch+at+Scal… -
PyTorch
@PyTorch
Poster Sessions at #pytorchcon are an interactive showcase of #pytorch projects, use cases, and research.
Explore applied AI, compilers, edge, generative models, PyTorch Core, responsible AI, and more. Connect directly with presenters and peers.
🔗 Explore sessions: -
PyTorch
@PyTorch
The Edge track at #pytorchcon shows how #pytorch powers AI on mobile, embedded, and IoT devices.
All Edge sessions run Wednesday, Oct 22, covering deployment, model compression and on-device optimization with experts from Meta, Arm, TikTok, MathWorks, Microsoft and LinkedIn.
🔗 Explore sessions: pytorchconference.sched.com/overview/type/Edge?iframe=no&… -
PyTorch
@PyTorch
Explore the Deep Learning Compilers, Kernel Authoring & Accelerators track at #pytorchcon. Discover how to extend #pytorch, optimize kernels, and boost accelerator performance with sessions from Meta, NVIDIA, Modular, Google, Spotify, Lightning AI, AMD, IBM, Intel, Huawei, Rebellions, & LinkedIn.
🔗 pytorchconference.sched.com/overview/type/DLCs+%26+Kernel…
#opensourceai -
PyTorch
@PyTorch
Get face time with the people building #pytorch.
Join small-group Meet the Experts sessions at #pytorchcon 2025 to talk directly with engineers behind PyTorch Compiler, Dev Infra, Module Maintainers, and vLLM.
📍 Oct 22–23
🔗 events.linuxfoundation.org/pytorch-conference-north-ameri… -
PyTorch
@PyTorch
The PyTorch in Industry track at #pytorchcon highlights real-world applications of #pytorch driving innovation.
Sessions cover production deployments, multimodal training, and LLM inference at scale, with speakers from Mutt Data, NVIDIA, Meta, OpenTeams, Luma AI, IBM Research, and Google.
🔗 Explore sessions: pytorchconference.sched.com/overview/type/PyTorch+in+Indu… -
PyTorch
@PyTorch
At #pytorchcon or one of this week’s co-located events in SF? Share your moments, photos, or takeaways for a chance to win PyTorch gear 🎁
Post with #pytorchcon + #pytorchlive and tag @PyTorch.
Winners announced during the closing keynote Thu, Oct 23 — must be present to claim. -
PyTorch
@PyTorch
⚙️ Final sessions at #pytorchcon 2025 AI Infra Summit bring it all together:
Panel - @marksaroufim (GPU Mode), Mostafa Hagog (Modular), @RobertTLange (SakanaAI), @simran_s_arora (Stanford), @natolambert (Allen Institute)
Talks from @danielhanchen (Unsloth), @ajitmaths (Meta), @tqchenml (NVIDIA)
Where infra meets intelligence → events.linuxfoundation.org/pytorch-conference-north-ameri…
#pytorchcon #aiinfra #aisummit #agi -
PyTorch
@PyTorch
🌍 Multi-agent systems & the open future @ #openagentsummit #pytorchcon 2025
🎙️ @jparello (Cisco) | @matthew_d_white (PyTorch) | @dawnsongtweets (UC Berkeley)
Topics: AGNTCY • Open Agents • Safe AI
🔗 events.linuxfoundation.org/pytorch-conference/
🗓️ openagentsummit2025.sched.com?hss_channel=tw-776585502606…
#openagentsummit #pytorchcon #agenticai -
PyTorch
@PyTorch
#pytorchcon kicks off in just 3️⃣ days in SF! 🔥
Want to level up your experience? Add an Oct 21 co-located event to your registration!
➕ Explore co-located events: events.linuxfoundation.org/pytorch-conference-north-ameri…
🎟️ Register now: events.linuxfoundation.org/pytorch-conference-north-ameri… -
PyTorch
@PyTorch
AI Infra Summit at #pytorchcon 2025:
• Bowen Peng (Nous Research) – Multimodal Transformers
• Will Brown (Prime Intellect) – RL Infrastructure
• Andy Zhang (Berkeley / Stanford) – Cyber Benchmarks
Infra meets innovation → events.linuxfoundation.org/pytorch-conference-north-ameri…
#pytorchcon #aiinfra #rl -
PyTorch
@PyTorch
⚙️ Engineering for scale and speed. Next-gen RL libraries are redefining how agents learn and interact.
🎤 Open Agent Summit Speakers:
• @sumanthrh (Anyscale) – “SkyRL: A Modular RL Library for LLM Agents”
• @tyler_griggs_ (UC Berkeley) – “Lessons in Agentic RL Modeling and Infrastructure”
• @Chenan3_Zhao (SGLang) – “Optimizing Multi-Turn RL and High-Performance Inference in Agents”
Explore reinforcement learning systems that bridge research and production for multi-agent intelligence.
✅ Register → events.linuxfoundation.org/pytorch-conference-north-ameri…
📋 Agenda → openagentsummit2025.sched.com
#openagentsummit #pytorchcon #agenticai #rl -
PyTorch
@PyTorch
🌍 Scale meets strategy at #pytorchcon 2025’s AI Infra Summit!
💡 Panel: Training & Inference at Planet Scale w/ @robertnishihara (Anyscale), @suospeaks (Meta), @simon_mo_ (vLLM), @lm_zheng (xAI), @dzhulgakov (Fireworks AI)
Keynotes: @joespeez + @tqchenml
See how the next AI infrastructure gets built → events.linuxfoundation.org/pytorch-conference-north-ameri… #pytorchcon #aiinfra -
PyTorch
@PyTorch
A round of applause for our #pytorchcon platinum sponsor @snowflake. Join us October 22-23 in San Francisco & discover the framework behind today's most groundbreaking #ai innovations. Register: events.linuxfoundation.org/pytorch-conference-north-ameri… Schedule: events.linuxfoundation.org/pytorch-conference-north-ameri…
-
PyTorch
@PyTorch
🗣 Shoutout to our #pytorchcon platinum sponsor @nvidia. Be part of the #ai revolution & connect with developers, researchers, $ visionaries in San Francisco, October 22-23. Register: events.linuxfoundation.org/pytorch-conference-north-ameri… Schedule: events.linuxfoundation.org/pytorch-conference-north-ameri…
-
PyTorch
@PyTorch
🎉 THANK YOU to our #pytorchcon platinum sponsor @LambdaAPI. Join us Oct 22-23 in San Francisco for 3 days of #ai excellence with an expanded program including specialized infrastructure & intelligence summits. Register: events.linuxfoundation.org/pytorch-conference-north-ameri… Schedule: events.linuxfoundation.org/pytorch-conference-north-ameri…
-
PyTorch
@PyTorch
Only 5️⃣ days until #pytorchcon, Oct 22-23 in SF! 🔥
Time to pack your bags but leave room for exclusive PyTorch gear 👕🧢
Hoodies, tees, stickers & more await at the #pytorch Gear Store. Rep PyTorch long after the event ends!
🎟️ Register now: events.linuxfoundation.org/pytorch-conference-north-ameri… -
PyTorch
@PyTorch
🌐 Open ecosystems & real-world agents @ #openagentsummit #pytorchcon 2025
🎙️@samuelcolvin (Pydantic) | Adam Jones (Anthropic) | @mgoin_ (Red Hat)
💬 Panel w/ @yujian_tang (OSS4AI), @andrewwhoh (Lastmile AI), @diamondbishop (DataDog), Mahdi Ghodsi (AMD),@yina_arenas (Microsoft)
PyTorch
@PyTorch
Register events.linuxfoundation.org/pytorch-conference/
🗓️ Agenda openagentsummit2025.sched.com
#openagentsummit #pytorchcon #agenticai -
PyTorch
@PyTorch
We ❤️ our #pytorchcon platinum sponsor @intel. Join us October 22-23 in San Francisco & explore new frontiers in #ai assessment & benchmarking. Register: events.linuxfoundation.org/pytorch-conference-north-ameri… Schedule: events.linuxfoundation.org/pytorch-conference-north-ameri…
-
PyTorch
@PyTorch
Excited to have Microsoft join us at #pytorchcon! 🔥
📍 Stop by their booth to see Agent Workflows demos
💡 Don’t miss the opportunity to meet with MSFT experts on Oct 22 | 1 PM to 5PM
Come to the booth, connect with experts & explore AI innovation with PyTorch + Azure.
👉 Register: events.linuxfoundation.org/pytorch-conference-north-america/
#azure #aicommunity -
PyTorch
@PyTorch
Curious about the future of AI hardware?Catch @realSharonZhou VP of AI at @AMD on the Hardware & Accelerators keynote panel at #pytorchconference — a lively discussion with top industry voices. 📅 Thu, Oct 23 · 1:59–2:29pm PDT📍 Room 3000–3012Add to schedule → pytorchconference.sched.com/event/28TOS
-
PyTorch
@PyTorch
Powering the PyTorch ecosystem at #pytorchcon! Learn to deploy Llama 3 models with high-throughput vLLM serving on Google Cloud GPUs. Boost your inference performance today. docs.cloud.google.com/gemini-enterprise-agent-platform/mo…
Register: events.linuxfoundation.org/pytorch-conference-north-ameri…
Schedule: events.linuxfoundation.org/pytorch-conference-north-ameri… -
PyTorch
@PyTorch
How do we really measure AI?
At #pytorchcon 2025’s Measuring Intelligence Summit:
• @achowdhery (Reflection AI) — Agentic Intelligence & RL
• @ml_angelopoulos (LMArena) — Real-world evaluation
• Yifan Mai (Stanford) — HELM framework
PyTorch
@PyTorch
Redefining benchmarks → events.linuxfoundation.org/pytorch-conference
-
PyTorch
@PyTorch
🤝 Collaboration & Reliability @ #openagentsummit #pytorchcon 2025
🎙️ @sandi_besen (IBM) | Chitra Venkatesh (Google) | Tuana Çelik (LlamaIndex)
Topics: BeeAI Reliability • Agent2Agent Protocol • Open Workflows
🔗 Register events.linuxfoundation.org/pytorch-conference-north-ameri…
🗓️ Agenda openagentsummit2025.sched.com?hss_channel=tw-776585502606… -
PyTorch
@PyTorch
🔥It begins! The Measuring Intelligence Summit kicks off Oct 21 at #pytorchcon 2025.
🎙️Fireside Chat: @polynoamial (OpenAI) + @joespeez (Meta)
💡Panel: “Are We Measuring Intelligence or Just Benchmarks?”
Join the conversation redefining AI evaluation → events.linuxfoundation.org/archive/2023/pytorch-conferenc… -
PyTorch
@PyTorch
🚀 Kicking off #openagentsummit at #pytorchcon 2025!
🎤 @dawnsongtweets (UC Berkeley), @Chi_Wang_ (DeepMind), @_yutaroyamada (Sakana AI)
💬 Panel w/ @yujian_tang (OSS4AI), @DavideCrapis (Ethereum Foundation), Mitesh Patel (NVIDIA), Bradley Axen (Block), @Zhou_Yu_AI (Columbia U)
PyTorch
@PyTorch
📅 Oct 21 | 📍 SF
🔗 events.linuxfoundation.org/pytorch-conference/
🗓️ openagentsummit2025.sched.com
#agenticai -
PyTorch
@PyTorch
🚀 Big ideas incoming from @jeremyphoward, Founding Researcher at fast ai, live on the #pytorchcon keynote stage.
Join the AI & ML community in San Francisco October 22–23.
👀 Speakers: events.linuxfoundation.org/pytorch-conference-north-ameri…
🎟️ events.linuxfoundation.org/pytorch-conference-north-ameri… -
PyTorch
@PyTorch
🤠 Hats off to our #pytorchcon platinum sponsor @CrusoeAI. Join us October 22-23 in San Francisco & transform your #ai career with new #pytorch training & certification opportunities. Register: events.linuxfoundation.org/pytorch-conference-north-ameri… Schedule: events.linuxfoundation.org/pytorch-conference-north-ameri…
-
PyTorch
@PyTorch
PyTorch 2.9 is now available, introducing key updates to performance, portability, and the developer experience.
This release includes a stable libtorch ABI for C++/CUDA extensions, symmetric memory for multi-GPU kernels, expanded wheel support to include ROCm, XPU, and CUDA 13, and enhancements for Intel, Arm, and x86 platforms.
With 3,216 commits from 452 contributors, PyTorch 2.9 continues to advance open source AI for developers worldwide.
🔗 Read the full release blog: pytorch.org/blog/pytorch-2-9/?hss_channel=tw-776585502606…
#pytorch #opensourceai #ai #performance -
PyTorch
@PyTorch
Your guide to #pytorchcon 2025 is here. Explore keynotes, technical sessions, and community events shaping the future of #opensourceai in San Francisco.
🔗 Read the full guide: pytorch.org/blog/your-guide-to-pytorch-conference-2025/
🎥 Watch 2024 highlights
#pytorch #aiThis media couldn't be displayed. See it on the original post. -
PyTorch
@PyTorch
High 5️⃣ to our #pytorchcon platinum sponsor @baseten. Join us October 22-23 in San Francisco for specialized tracks on a variety of topics including measuring intelligence & #ai infrastructure. Register: events.linuxfoundation.org/pytorch-conference-north-ameri… Schedule: events.linuxfoundation.org/pytorch-conference-north-ameri…
-
PyTorch
@PyTorch
☀️ Day 1: Deep learning.
🌚 Night 1: Fire dancing.
🎉 The Flare Party at #pytorchcon is where code meets community. Grab a drink, catch the DJ & celebrate with #pytorch peers in San Francisco.
👉 Register: events.linuxfoundation.org/pytorch-conference-north-ameri… -
PyTorch
@PyTorch
A round of applause for our #pytorchcon platinum sponsor @AWSOpen. Join visionary leaders for keynotes & sessions that will shape the future of #ai October 22-23 in San Francisco. Register: events.linuxfoundation.org/pytorch-conference-north-ameri… Schedule: events.linuxfoundation.org/pytorch-conference-north-ameri…
-
PyTorch reposted
OpenSSF
@openssf
Heading to #pytorchcon 2025? Don’t miss our BoF on Applying DevSecOps Lessons to MLSecOps (Oct 23 | 10:30 AM PDT).
Join Jeff Diecks + @MihaiMaruseac as we explore secure AI/ML development with the OpenSSF AI/ML Security WG.
👉 pytorchconference.sched.com/event/27QQG -
PyTorch
@PyTorch
How do we make AI more efficient, scalable & sustainable? At #pytorchcon, @Arm’s Sharbani Roy, VP of AI Services will explore how engineers can harness small language models (SLMs) and vision models to optimize inference and build responsible AI systems. Oct 22 | 12:10 | Room 2014–2016
Register: events.linuxfoundation.org/pytorch-conference-north-ameri…
Schedule: events.linuxfoundation.org/pytorch-conference-north-ameri… -
PyTorch
@PyTorch
🚀 Witness the future of AI at the #pytorch Startup Showcase!
Tuesday, Oct 21 | 5–8 PM | #pytorchcon in San Francisco
Watch #ai startups pitch live to top VCs, connect with engineers & discover breakthrough ideas shaping the AI ecosystem. Don’t miss it!
Register now 👉 events.linuxfoundation.org/pytorch-conference-north-ameri… -
PyTorch
@PyTorch
Webinar: The Free Puppy – How to Responsibly Leverage #opensourceai
Mo McElaney of #ibmresearch explores what truly defines #opensource, how to assess project health and licensing, and why transparency and community are key to responsible #ai adoption.
🔗 pytorch.org/event/the-free-puppy-how-to-responsibly-lever…
#pytorch -
PyTorch
@PyTorch
🤖 The Open Agent Summit at #pytorchcon, Oct 22-23 in SF, is where the future of #ai takes shape.
From frameworks to real-world use cases, join this important & exciting conversation!
📍 Oct 21 | San Francisco
🔗 Learn more + register: events.linuxfoundation.org/pytorch-conference-north-ameri… -
PyTorch
@PyTorch
🎉 THANK YOU to our #pytorchcon platinum sponsor @akashnet. Join us October 22-23 in San Francisco & connect with the brightest minds in #ai working on groundbreaking technical insights. Register: events.linuxfoundation.org/pytorch-conference-north-ameri… Schedule: events.linuxfoundation.org/pytorch-conference-north-ameri…
-
PyTorch
@PyTorch
Innovate today. Shape tomorrow.
Unleash limitless possibilities with Microsoft Azure – proud sponsor of #pytorchcon and powering the future for developers and innovators worldwide.
Register: events.linuxfoundation.org/pytorch-conference-north-ameri…
Schedule: events.linuxfoundation.org/pytorch-conference-north-ameri…
#azure #pytorch #ai #innovation -
PyTorch
@PyTorch
Qualcomm is taking the stage at #pytorchcon 2025! Hear from Jeff Gehlhaar in our 5-min keynote: “Unlocking AI at Scale for PyTorch Developers”—discover how to run AI inference on Qualcomm from edge to cloud. Visit Booth D3 for live demos, workshops, and to meet our experts. See you at Moscone West, Oct 22–23! #pytorch #ai #qualcomm #speakership
Session: pytorchconference.sched.com/event/290zx
Register: events.linuxfoundation.org/pytorch-conference-north-ameri… -
PyTorch
@PyTorch
🎙️ Mic check: Andrew Ling, Head of ML Compilers at Groq, is bringing the 🔥 to the keynote stage at #pytorchcon!
Get ready for big ideas & deeper learning October 22–23 in SF.
👀 Speakers: events.linuxfoundation.org/pytorch-conference-north-ameri…
🎟️ events.linuxfoundation.org/pytorch-conference-north-ameri… -
PyTorch
@PyTorch
The countdown is heating up 🔥
Only 10 days until #pytorchcon lights up San Francisco with innovation, insight & community energy!
Don’t just hear about it later. Be there. There’s still time to register 👉 events.linuxfoundation.org/pytorch-conference-north-ameri… -
PyTorch
@PyTorch
🤝 We’re thrilled to welcome @OpenTeams as a Diamond Sponsor for PyTorch Conference 2025. Since the early 2000s, founder Travis Oliphant released SciPy, NumPy, and Numba to the world. These became the bedrock of modern AI—and shook computing forever. It's time for an update. And you’ll be in the room. Come see how they’re building the foundations for the next decade of superintelligent systems. Catch @ Travis Oliphant’s session “Superintelligent Infrastructure: What’s Next.”
Register: events.linuxfoundation.org/pytorch-conference-north-ameri…
Schedule: events.linuxfoundation.org/pytorch-conference-north-ameri…
#pytorchcon #opensource #aiinfrastructure -
PyTorch
@PyTorch
Visit @IBM and @RedHat in our exhibit booth to see the IBM Spyre Accelerator — the first system-on-a-chip designed to enable future IBM Z systems to perform AI inferencing at scale. We’ll also be showing demos of vLLM and llm-d.
For more information and our full presentation schedule visit: research.ibm.com/events/pytorch-2025
Register: events.linuxfoundation.org/pytorch-conference-north-ameri… -
PyTorch
@PyTorch
🤠 Hats off to our #pytorchcon diamond sponsor @Meta. Join us October 22-23 in San Francisco & be part of the community creating the #ai revolution – don't just witness it, help build it! Register: events.linuxfoundation.org/pytorch-conference-north-ameri… Schedule: events.linuxfoundation.org/pytorch-conference-north-ameri…
-
PyTorch reposted
NVIDIA AI Developer
@NVIDIAAIDev
NVIDIA + Open Source AI Week 2025 – powered by partnerships, events, and community 👏
We’re excited to bring together technology, community, and collaboration at Open Source AI Week 2025, hosted by @linuxfoundation.
From informal meetups to hackathons, panels to poster sessions, here’s the scoop on where you can join us in to advance open-source AI 👇
🥤 AI Dev Night with @UnslothAI & @MistralAI — Join us for boba and talks on training & deployment with RTX AI PCs.
🧩Trivia & Community with @DeepInfra & @vllm_project — A fun, interactive quiz night to connect engineers, practitioners, and open-source devs.
🧑💻 GPU MODE IRL Hackathon — Over 215 networked NVIDIA B200 GPUs, we are joining other mentors from Thinking Machines, @UnslothAI, @PyTorch, @periodiclabs, @Mobius_Labs, @GoogleDeepMind, and more — courtesy of @nebiusai.
🙌 @PyTorch Conference 2025 — NVIDIA-led sessions, posters, meetups, and panels aligned with the flagship event.
🤖 Open Agent Summit — NVIDIA Developer Advocate Mitesh Patel will join a panel on The Future of Agents & Human-Agent Collaboration.
🧠 Measuring Intelligence Summit — Vivienne Zhang (Senior PM, Generative AI Software) will speak on reasoning models, benchmarks, and superintelligence
🤓 Technical Sessions & Posters — Covering topics like Lightweight, High-Performance FSDP on NVIDIA GPU, Scaling KV Caches for LLMs, and more.
🔗 Stay in the loop — bookmark our event page for updates as we add more → nvda.ws/4h1FIlZ -
PyTorch
@PyTorch
A round of applause for our #pytorchcon Startup Showcase Sponsors. Join us for the Startup Showcase on Oct 21 from 5:00-8:00 PM PT, where #ai startups pitch live to top VCs. This is your chance to witness innovation at its most exciting stage! Learn more: events.linuxfoundation.org/archive/2024/pytorch-conferenc… Register: events.linuxfoundation.org/pytorch-conference-north-ameri…
-
PyTorch
@PyTorch
🎤 The stage is set and the spotlight’s on Dr. Christian Jacobi, Fellow & CTO at IBM Systems Development, a #pytorchcon keynote speaker!
Join the minds moving #opensource #ai and ML forward.
📍 San Francisco | 📅 October 22–23
👀 Keynotes: events.linuxfoundation.org/pytorch-conference-north-ameri…
🎟️ Register: events.linuxfoundation.org/pytorch-conference-north-ameri… -
PyTorch
@PyTorch
Our October newsletter is out now. Read the latest updates and subscribe to stay connected with the #pytorchfoundation community.
See what’s new across our projects, including #pytorchcon 2025, #opensourceai Week, & more ecosystem updates.
👉 pytorch.org/newsletter/october-2025/
📨 pytorch.org/newsletter/ -
PyTorch
@PyTorch
🌍 We’re proud to welcome the first-ever PyTorch Ambassadors!
💡 31 leaders
🗺️ 21 countries
🤝 5 continents
They’ll host events, create content, and mentor new users to grow the PyTorch community worldwide. 👏 Meet the 2025 PyTorch Ambassadors: pytorch.org/blog/meet-the-2025-pytorch-ambassadors/
@alenunezarroyo, @dreyupc, @ArunBha78090222, @LFSolisNavarro, @mshrh3, @machine_quest, @NaeemKhoshnevis, @pacymugisho, @sp_zala, @yoshitomo_cs, @azaynul123, @zhiqingxiao -
PyTorch
@PyTorch
SuperOffload boosts large-scale #llm training efficiency on tightly coupled GPU/CPU Superchips—up to 4× faster on GH200 vs prior approaches. Built on DeepSpeed ZeRO Stage 3 by @Alexlian0806 @toh_tana @_Minjia_Zhang_ & Tunji Ruwase
Read #pytorchfoundation's latest blog: pytorch.org/blog/superoffload-unleashing-the-power-of-lar…
#pytorch #opensourceai -
PyTorch
@PyTorch
Got questions? The experts have answers. 💡
At #pytorchcon, our Meet the Experts sessions connect you directly with #pytorch leaders & contributors shaping the future of AI. Ask, learn & get inspired straight from the source.
👥 Join us Oct 22–23 in SF
More info 👉 events.linuxfoundation.org/pytorch-conference-north-ameri…
Register 👉 events.linuxfoundation.org/pytorch-conference-north-ameri… -
PyTorch
@PyTorch
🗣 Shoutout to our #pytorchcon gold sponsors. Join us October 22-23 in San Francisco for technical sessions covering every layer of #ai development. Register: events.linuxfoundation.org/pytorch-conference-north-ameri… Schedule: events.linuxfoundation.org/pytorch-conference-north-ameri…
-
PyTorch
@PyTorch
🎉 THANK YOU to our #pytorchcon platinum sponsor @snowflake. From startup founders to seasoned researchers, PyTorch Conference brings together every corner of the #ai ecosystem, Oct 22-23 in San Francisco. Register: events.linuxfoundation.org/pytorch-conference-north-ameri… Schedule: events.linuxfoundation.org/pytorch-conference-north-ameri…
-
PyTorch
@PyTorch
The best ideas take flight at the Birds of a Feather (BoF) sessions! 🐦
Join open discussions with #pytorch community, share insights & collaborate on topics that matter most.
Don’t miss #pytorchcon, Oct 22–23 in SF.
Learn more 👉 events.linuxfoundation.org/pytorch-conference-north-ameri…
Register now 👉 events.linuxfoundation.org/pytorch-conference-north-ameri… -
PyTorch
@PyTorch
Open Agent Summit, co-located with #pytorchcon in San Francisco on Oct 21, brings together experts from @GoogleDeepMind, @UCBerkeley, @SakanaAILabs, @IBM, @Google, @llama_index, OSS4AI, Ethereum Foundation, @nvidia, Block, @Columbia, Pydantic, @AnthropicAI, @RedHat, @vllm_project, @Cisco, @anyscalecompute, @sgl_project, @Microsoft, @datadoghq, @AMD & @LastMile.
📎Explore the full agenda and register by adding #openagentsummit to your PyTorch Conference registration: pytorch.org/blog/open-agent-summit-at-pytorch-conference/ -
PyTorch
@PyTorch
We ❤️ our #pytorchcon platinum sponsor @nvidia. Join us October 22-23 in San Francisco for interactive workshops on #ai benchmarking & scaling. Register: events.linuxfoundation.org/pytorch-conference-north-ameri… Schedule: events.linuxfoundation.org/pytorch-conference-north-ameri…
-
PyTorch
@PyTorch
🎉 THANK YOU to our #pytorchcon platinum sponsor @AWSOpen. Join us October 22-23 in San Francisco for deep dives into agent layers and application development. Register: events.linuxfoundation.org/pytorch-conference-north-ameri… Schedule: events.linuxfoundation.org/pytorch-conference-north-ameri…
-
PyTorch
@PyTorch
Interested in learning #pytorch and #deeplearning fundamentals? 🇫🇷 Introduction à PyTorch is a free online session by our Ambassador community in France on Oct 15—covering tensors, neural nets & live Q&A.
🔗 www.meetup.com/paris-python-machine-learning-deep-learnin…
#opensourceai -
PyTorch
@PyTorch
🤠 Hats off to our #pytorchcon platinum sponsor @intel. Join us October 22-23 in San Francisco to network with #ai pioneers shaping tomorrow's technology. Register: events.linuxfoundation.org/pytorch-conference-north-ameri… Schedule: events.linuxfoundation.org/pytorch-conference-north-ameri…
-
PyTorch
@PyTorch
❄️ We’re excited to welcome @Snowflake as a Premier Member of the PyTorch Foundation 🎉 Snowflake’s AI Research Team is advancing open source AI with #pytorch, from inference optimizations to training breakthroughs. 👉 Read the announcement: pytorch.org/blog/snowflake-joins-the-pytorch-foundation-a…
-
PyTorch
@PyTorch
Only 15 days until #pytorchcon lights up San Francisco! 🔥
Join us October 22–23 for two days of #ai innovation, community & can’t-miss sessions — and don’t forget the legendary Flare Party. 🎉 events.linuxfoundation.org/pytorch-conference-north-ameri…
Secure your spot now: events.linuxfoundation.org/pytorch-conference-north-ameri… -
PyTorch
@PyTorch
Quantization alone reaches its limits in compressing large language models. Combining it with 2:4 sparsity enables greater compression and efficient, hardware-accelerated deployment while maintaining accuracy.
Our latest community blog from Mohammad Mozaffari, Jesse Cai, and Supriya Rao explores the advantages of hybrid compression, key results on LLaMA models, and the software gaps that must be addressed to fully unlock its potential.
🔗 pytorch.org/blog/when-quantization-isnt-enough-why-24-spa…
#pytorch #opensourceai #llms #llama -
PyTorch
@PyTorch
🎤 The stage is set and the spotlight’s on Nitin Perumbeti, Chief Technology Officer at Crusoe, a #pytorchcon keynote speaker!
Join the minds moving #opensource #ai and ML forward.
📍 San Francisco | 📅 October 22–23
👀 Keynotes: events.linuxfoundation.org/pytorch-conference-north-ameri…
🎟️ Register: -
PyTorch
@PyTorch
dAGI Summit on Oct 24 in San Francisco brings together researchers, engineers & founders advancing #opensourceai, agentic systems & AI-native economies.
#pytorch Foundation ED Matt White joins the speaker lineup. Use code MATT for 20% off → dagihouse.com?hss_channel=tw-776585502606721024
More: events.linuxfoundation.org/open-source-ai-week/?hss_chann… -
PyTorch
@PyTorch
Thank you to #pytorchcon platinum sponsor @akashnet. Join us October 22-23 in San Francisco & learn how to run your #pytorch App on Akash's Open Source infrastructure for Open Source builders. Register: events.linuxfoundation.org/pytorch-conference-north-ameri… Schedule: events.linuxfoundation.org/pytorch-conference-north-ameri…
-
PyTorch reposted
AI at AMD
@AIatAMD
Join the Synthetic Data AI Agents Challenge!
🚀A two-day virtual hackathon, hosted by @UnslothAI, AMD and @PyTorch, to build and battle AI agents! Did we mention the top team can win $3,000!
📆 When? October 18–20
Finals, judging, and award ceremony will be held during AI DevDay so be sure to register!
Hackathon Sign Up: luma.com/4i64p3ec
AI DevDay Registration: www.amd.com/en/corporate/events/amd-ai-dev-day.html -
PyTorch
@PyTorch
Don't miss PyTorch Foundation Executive Director @matthew_d_white's sessions on open source AI next week at #allthingsopen 🧑🚀
Matt White
@matthew_d_white
Thrilled to be opening #allthingsopen (Oct 12–14, Raleigh) with a keynote: “The Good, the Bad & the Ugly of Open Source AI.”
I’ll unpack how open source is driving AI innovation — and what risks and tensions lie beneath the surface.
I’ll also lead a 45-min session: “From Code to Agency: Open Source & Standards for Next-Gen AI Agents”, diving into interoperability, controllability, and emerging open specs like A2A and MCP.
Let’s explore how open ecosystems can support safe, consistent, and interoperable agents 🎯
See you at ATO!
#opensourceai #agenticai #aistandards @AllThingsOpen -
PyTorch reposted
NVIDIA AI Developer
@NVIDIAAIDev
Don't miss the keynote by @DrJimFan at #pytorchcon.
🤖The Physical Turing Text: Solving General Purpose Robotics.
➡️pytorchconference.sched.com/event/28zpb
📆October 22 in San Francisco
NVIDIA AI Developer
@NVIDIAAIDev
We’ll be at #pytorchcon with keynote, sessions, panels, and workshops with the @PyTorch developer community on topics including fast inference with Dynamo + TensorRT-LLM and efficient FSDP on GPUs.
📆 Oct 22–23 in San Francisco.
🔗 www.nvidia.com/en-us/events/pytorch/?ncid=so-twit-679776
We will see you there. 🙌 -
PyTorch
@PyTorch
Advance your career in AI with our new PyTorch Associate Training at #pytorchcon 2025. This in-person, instructor-led course builds ML/DL skills, helps you optimize models, and prepares you for the PTCA exam with a $250 voucher. Register by Oct 15.
🔗 pytorch.org/blog/take-our-new-pytorch-associate-training-… -
PyTorch
@PyTorch
🚀 Big ideas incoming from Ben Lorica (@bigdata), Host, Data Exchange Podcast & Editor at Gradient Flow, live on the #pytorchcon keynote stage.
Join the AI & ML community in San Francisco October 22–23.
👀 Speakers: events.linuxfoundation.org/pytorch-conference-north-ameri…
🎟️ events.linuxfoundation.org/pytorch-conference-north-ameri… -
PyTorch
@PyTorch
A round of applause for our #pytorchcon diamond sponsor @Meta. Interactive workshops on scaling & benchmarking models await you at PyTorch Conference, October 22-23 in San Francisco. Register: events.linuxfoundation.org/pytorch-conference-north-ameri… Schedule: events.linuxfoundation.org/pytorch-conference-north-ameri…
-
PyTorch
@PyTorch
Come see the future of #ai in action at the Startup Showcase during #pytorchcon! 🚀
🗓 October 21 | 5–8 PM
Watch AI startups pitch live to top VCs, network with peers & discover the next big ideas.
More info: events.linuxfoundation.org/archive/2024/pytorch-conferenc…
Register now: events.linuxfoundation.org/pytorch-conference-north-ameri… -
PyTorch
@PyTorch
🙏 A heartfelt thank you to our #pytorchcon platinum sponsor @LambdaAPI. Join the community driving #ai innovation forward, where collaboration meets cutting-edge technology, Oct 22-23 in San Francisco. Register: events.linuxfoundation.org/pytorch-conference-north-ameri… Schedule: events.linuxfoundation.org/pytorch-conference-north-ameri…
-
PyTorch
@PyTorch
Join the Women & Non-Binary in #pytorch Lunch at #pytorchcon on October 23. Connect, collaborate & celebrate community while enjoying a meal together. 🍴✨ More info: events.linuxfoundation.org/pytorch-conference-north-ameri…
Register now to attend October 22-23 in San Francisco: events.linuxfoundation.org/pytorch-conference-north-ameri… -
PyTorch
@PyTorch
Google Cloud is proud to sponsor #pytorchcon! Accelerate your development with our optimized PyTorch Deep Learning VMs. Get a pre-configured instance up and running in minutes. docs.cloud.google.com/deep-learning-vm/docs/pytorch_start…
Register: events.linuxfoundation.org/pytorch-conference-north-ameri…
Schedule: events.linuxfoundation.org/pytorch-conference-north-ameri… -
PyTorch
@PyTorch
Collaboration. Innovation. Inspiration.
That’s what you’ll find at #opensourceaiweek, Oct 18–26 in San Francisco.
A week of 15+ in-person #ai events you won’t want to miss.
☑️ Check it out & register: events.linuxfoundation.org/open-source-ai-week/?hss_chann… -
PyTorch
@PyTorch
🎙️ Mic check: Adam Jones, Member of Technical Staff at Anthropic, is bringing the 🔥 to the keynote stage at #pytorchcon!
Get ready for big ideas & deeper learning October 22–23 in SF.
👀 Speakers: events.linuxfoundation.org/pytorch-conference-north-ameri…
🎟️ events.linuxfoundation.org/pytorch-conference-north-ameri… -
PyTorch
@PyTorch
A round of applause for our #pytorchcon platinum sponsor @CrusoeAI. Join us October 22-23 in San Francisco where ethical #ai development takes center stage with special tracks addressing the industry's most critical challenges. Register: events.linuxfoundation.org/pytorch-conference-north-ameri… Schedule:
-
PyTorch
@PyTorch
🎤 The stage is set and the spotlight’s on @samuelcolvin, Founder at Pydantic, a #pytorchcon keynote speaker!
Join the minds moving #opensource #ai and ML forward.
📍 San Francisco | 📅 October 22–23
👀 Keynotes: events.linuxfoundation.org/pytorch-conference-north-ameri…
🎟️ Register: events.linuxfoundation.org/pytorch-conference-north-ameri… -
PyTorch
@PyTorch
NVIDIA’s TensorRT LLM 1.0 adds #pytorch model authorship for rapid development, a modular #python runtime, and a stable LLM API, advancing #opensourceai with simpler, faster, more efficient #llm inference.
🔗 nvda.ws/46zUXxy
NVIDIA AI Developer
@NVIDIAAIDev
⚡ Easier. Faster. Open. TensorRT LLM 1.0
Simple deployment, #opensource, and extensible – all while pushing the frontier of inference performance.
With record-setting 8X inference performance improvement, TensorRT LLM v1.0 makes it simple to deliver real-time, cost-efficient LLMs on our GPUs.
📥 Just released on GitHub: github.com/NVIDIA/TensorRT-LLM/releases/tag/v1.0.0
🔥 What’s new
@PyTorch model authorship for rapid development
Modular #python runtime for flexibility
Stable LLM API for seamless deployment
👩💻 Join our livestream to learn more: www.addevent.com/event/oX26320276
📅 Sept. 25, 5-6 pm (PDT) -
PyTorch
@PyTorch
🗣 Shoutout to our #pytorchcon platinum sponsor @baseten. Interactive sessions on the future of #ai await experienced professionals October 22-23 in San Francisco. Register: events.linuxfoundation.org/pytorch-conference-north-ameri… Schedule: events.linuxfoundation.org/pytorch-conference-north-ameri…
-
PyTorch
@PyTorch
🎉 It’s officially event month for #pytorchcon!
Get ready for 2️⃣ days of innovation, community, and… llamas. 🦙
That’s right—join us for Llama Palooza, the ultimate AI-meets-fun mashup.
📍 Oct 22–23 | San Francisco
🔗 Register: events.linuxfoundation.org/pytorch-conference-north-ameri… -
PyTorch
@PyTorch
Join us ahead of #pytorchcon for an informal meetup with @Arm experts and AI engineers. Connect, share ideas, and explore the future of AI together. #opensourceaiweek📍 One Yerba Buena, San Francisco | Oct 21, 18:30
Learn more: events.linuxfoundation.org/open-source-ai-week/?hss_chann…
Register for PyTorch Con: -
PyTorch
@PyTorch
🚀 Big ideas incoming from @dawnsongtweets, Professor at UC Berkeley, live on the #pytorchcon keynote stage.
Join the AI & ML community in San Francisco October 22–23.
👀 Speakers: events.linuxfoundation.org/pytorch-conference-north-ameri…
🎟️ events.linuxfoundation.org/pytorch-conference-north-ameri… -
PyTorch
@PyTorch
🤖 The Open Agent Summit at #pytorchcon, Oct 22-23 in SF, is where the future of #ai takes shape.
From frameworks to real-world use cases, join this important & exciting conversation!
📍 Oct 21 | San Francisco
🔗 Learn more + register: events.linuxfoundation.org/pytorch-conference-north-ameri… -
PyTorch
@PyTorch
🤠 Hats off to our #pytorchcon diamond sponsor @Qualcomm. San Francisco becomes the global #ai hub October 22-23 for PyTorch Conference, featuring the framework behind today's biggest breakthroughs. Register: events.linuxfoundation.org/pytorch-conference-north-ameri… Schedule: events.linuxfoundation.org/pytorch-conference-north-ameri…
-
PyTorch
@PyTorch
🤝 @Openteams is a Diamond Sponsor for PyTorch Conference 2025! AI runs on projects built by communities—like PyTorch. And OpenTeams helps support the talent, the ideas, and the human networks that make it all possible. Thank you for helping create a space where the PyTorch community can connect and grow. That’s how we drive innovation forward.
Register: events.linuxfoundation.org/pytorch-conference-north-ameri…
Schedule: events.linuxfoundation.org/pytorch-conference-north-ameri…
#pytorchcon #opensource #openteams #ownyourai -
PyTorch
@PyTorch
🎙️ Mic check: @DrJimFan, Director & Distinguished Research Scientist at NVIDIA, is bringing the 🔥 to the keynote stage at #pytorchcon!
Get ready for big ideas & deeper learning October 22–23 in SF.
👀 Speakers: events.linuxfoundation.org/pytorch-conference-north-ameri…
🎟️ events.linuxfoundation.org/pytorch-conference-north-ameri… -
PyTorch
@PyTorch
💻 Scale smarter at the #ai Infra Summit, co-located with #pytorchcon, Oct 22-23 in SF.
Dive into infrastructure challenges and solutions powering next-gen AI systems.
📍 Oct 21 | San Francisco
🔗 Details + register: events.linuxfoundation.org/pytorch-conference-north-ameri… -
PyTorch
@PyTorch
🎉 THANK YOU to our #pytorchcon diamond sponsor @AMD. Join the world's premier #ai event at PyTorch Conference, October 22-23 in San Francisco, where groundbreaking innovations come to life. Register: events.linuxfoundation.org/pytorch-conference-north-ameri… Schedule: events.linuxfoundation.org/pytorch-conference-north-ameri…
-
PyTorch
@PyTorch
👥 Big ideas spark bigger conversations at #pytorchcon, Oct 22-23 in San Francisco.
Join Birds of a Feather sessions to connect on niche topics then dive deeper with Meet the Experts for 1:1 guidance.
ℹ️ Activities: events.linuxfoundation.org/pytorch-conference-north-ameri…
🔗 Register: events.linuxfoundation.org/pytorch-conference-north-ameri… -
PyTorch
@PyTorch
🏭 From prototypes to production, #pytorch is powering business innovation. At #pytorchcon (Oct 22–23, SF), dive into the PyTorch in Industry Track for real-world use cases and success stories.
🔗 events.linuxfoundation.org/pytorch-conference-north-ameri…
🎟 events.linuxfoundation.org/pytorch-conference-north-ameri… -
PyTorch
@PyTorch
Advance your career in AI with our new PyTorch Associate Training at #pytorchcon 2025. This in-person, instructor-led course builds ML/DL skills, helps you optimize models, and prepares you for the PTCA exam with a $250 voucher. Register by Oct 15.
🔗 pytorch.org/blog/take-our-new-pytorch-associate-training-… -
PyTorch
@PyTorch
Ideas worth sharing, research worth spotlighting.
Poster Presentations at #pytorchcon showcase cutting-edge projects from across the community. See what your peers are building and spark new collaborations.
📍 Oct 22-23 | San Francisco
More info: events.linuxfoundation.org/pytorch-conference-north-ameri…
🔗 Register: events.linuxfoundation.org/pytorch-conference-north-ameri… -
PyTorch
@PyTorch
🚀 Big ideas incoming from @brianzhan1, Principal at CRV, live on the #pytorchcon keynote stage.
Join the AI & ML community in San Francisco October 22–23.
👀 Speakers: events.linuxfoundation.org/pytorch-conference-north-ameri…
🎟️ events.linuxfoundation.org/pytorch-conference-north-ameri… -
PyTorch
@PyTorch
🎙️ Mic check: Peter Deng (@pxd), General Partner at Felicis, is bringing the 🔥 to the keynote stage at #pytorchcon!
Get ready for big ideas & deeper learning October 22–23 in SF.
👀 Speakers: events.linuxfoundation.org/pytorch-conference-north-ameri…
🎟️ events.linuxfoundation.org/pytorch-conference-north-ameri… -
PyTorch
@PyTorch
Join us for a two-day virtual hackathon, hosted by @danielhanchen & the @UnslothAI team, AMD and PyTorch, to build and battle AI agents!
Use Unsloth with AMD MI300X GPUs to fine-tune, RL or prompt models to build agents, and then have these agents compete in a bracket-style tournament, where they will write questions and deliver answers to beat the competition.
📅 October 18–20
Register now to join the challenge. luma.com/4i64p3ec?hss_channel=tw-776585502606721024 -
PyTorch
@PyTorch
📚 From classrooms to cutting-edge labs, #pytorch is fueling discovery. At #pytorchcon (Oct 22–23, SF), explore the PyTorch in Academia Track and see how it drives research and education.
🔗 events.linuxfoundation.org/pytorch-conference-north-ameri…
🎟 events.linuxfoundation.org/pytorch-conference-north-ameri… -
PyTorch
@PyTorch
🎤 The stage is set and the spotlight’s on Joe Spisak (@joespeez), Product Director, Super Intelligence Labs at Meta, a #pytorchcon keynote speaker!
Join the minds moving #opensource #ai and ML forward.
📍 San Francisco | 📅 October 22–23
👀 Keynotes: events.linuxfoundation.org/pytorch-conference-north-ameri…
🎟️ Register: events.linuxfoundation.org/pytorch-conference-north-ameri… -
PyTorch
@PyTorch
Go big with the #pytorch at Scale Track at #pytorchcon, Oct 22-23 in San Francisco. 🚀
Learn how to build, train, and serve models at massive scale with distributed training, parallelism, and production-ready #ai.
🔗 events.linuxfoundation.org/pytorch-conference-north-ameri…
🎟 events.linuxfoundation.org/pytorch-conference-north-ameri… -
PyTorch
@PyTorch
"Globally, @linuxfoundation found that #opensource helps retain talent by providing opportunities for engagement and knowledge-sharing in leading-edge technical communities. The ubiquity of some open tools and models in global #ai stacks, such as PyTorch, means that demand will grow for engineers and scientists that are proficient in these open technologies."
The Linux Foundation
@linuxfoundation
🌍 What if open source AI could unlock $614B in growth by 2030?
New LF Research report with @Meta shows how Africa, the Middle East & Türkiye are using open models to drive innovation and opportunity.
Read more 👉 www.linuxfoundation.org/research/open-source-ai-amet?hsLa… -
PyTorch
@PyTorch
🚀 Big ideas incoming from Peter Salanki (@sorcer), Chief Technology Officer at CoreWeave, live on the #pytorchcon keynote stage.
Join the AI & ML community in San Francisco October 22–23.
👀 Speakers: events.linuxfoundation.org/pytorch-conference-north-ameri…
🎟️ events.linuxfoundation.org/pytorch-conference-north-ameri… -
PyTorch
@PyTorch
✈️ Headed to San Francisco for #pytorchcon Oct 22-23? Book your hotel before the block closes Sept 26: events.linuxfoundation.org/pytorch-conference-north-ameri…
🎟 Still need your ticket? Register now: events.linuxfoundation.org/pytorch-conference-north-ameri… -
PyTorch
@PyTorch
PyTorch now offers native quantized variants of Phi4-mini-instruct, Qwen3, SmolLM3-3B and gemma-3-270m-it through a collaboration between the TorchAO team and Unsloth! 🔎 Learn more: pytorch.org/blog/torchao-quantized-models-and-quantizatio…
PyTorch
@PyTorch
Correction: this is a collab between TorchAO team, ExecuTorch team, and Unsloth
-
PyTorch
@PyTorch
Level up your skills with the Reinforcement Learning Track at #pytorchcon, Oct 22-23 in San Francisco. 🕹️
Discover the latest RL algorithms, frameworks, & real-world applications in robotics, gaming, and optimization.
🔗 events.linuxfoundation.org/pytorch-conference-north-ameri…
🎟 Register: events.linuxfoundation.org/pytorch-conference-north-ameri… -
PyTorch
@PyTorch
🎙️ Mic check: @jgehlhaar, SVP of Engineering at Qualcomm, is bringing the 🔥 to the keynote stage at #pytorchcon!
Get ready for big ideas & deeper learning October 22–23 in SF.
👀 Speakers: events.linuxfoundation.org/pytorch-conference-north-ameri…
🎟️ events.linuxfoundation.org/pytorch-conference-north-ameri… -
PyTorch
@PyTorch
AI Infra Summit, co-located with PyTorchCon 2025, brings leading voices in AI systems to San Francisco on October 21.
This half-day program explores the infrastructure powering today’s AI advances, from scaling workloads and optimizing training to shaping the future of generative models.
Keynotes feature Joe Spisak (Meta) and Tianqi Chen (NVIDIA & CMU), with additional sessions and panels on fine tuning, decentralized training, agent sandboxes, accelerators, and more.
📅 Tuesday, October 21, 2025
🔗 Pre-registration required. Full announcement: pytorch.org/blog/ai-infra-summit-at-pytorch-conference/?h…
#pytorchcon #pytorch #opensourceai #aiinfrastructure -
PyTorch
@PyTorch
Big ideas need big models. 💡
At #pytorchcon Oct 22-23 in San Francisco, the LLMs Track dives into cutting-edge architectures, training optimizations, & real-world applications.
🔗 Explore the track: events.linuxfoundation.org/pytorch-conference-north-ameri…
🎟 Register: events.linuxfoundation.org/pytorch-conference-north-ameri… -
PyTorch
@PyTorch
Compiling large #pytorch models at Meta could take an hour+. Engineers cut PT2 compile time by 80% with parallel Triton compilation, dynamic shape marking, autotuning config pruning, and cache improvements now integrated into the stack.
🔗 pytorch.org/blog/experience-in-reducing-pt2-compilation-t… -
PyTorch
@PyTorch
🧸 Final call for child care at #pytorchcon! Bringing your kid(s) to San Fran? Complimentary onsite care is available Oct 20-23 for children up to age 12.
RSVP by Sept 19 — no late or onsite sign-ups accepted! events.linuxfoundation.org/pytorch-conference-north-ameri… -
PyTorch
@PyTorch
🎤 The stage is set and the spotlight’s on @saranormous, Founder & Investor at Conviction, a #pytorchcon keynote speaker!
Join the minds moving #opensource #ai and #ml forward.
📍 San Francisco | 📅 October 22–23
👀 Keynotes: events.linuxfoundation.org/pytorch-conference-north-ameri…
🎟️ Register: events.linuxfoundation.org/pytorch-conference-north-ameri… -
PyTorch
@PyTorch
PyTorch 2.8 delivers high-performance quantized LLM inference on Intel Xeon CPUs. With AMX/AVX-512 and optimized configs, PyTorch matches or outperforms vLLM in offline mode.
🔗 Read our latest blog from the Intel PyTorch Team: pytorch.org/blog/high-performance-quantized-llm-inference… -
PyTorch
@PyTorch
How do we measure #ai intelligence? 🧠
Join the Measuring Intelligence Summit on Oct 21 at #pytorchcon (Oct 22-23 in SF). Explore evaluating reasoning models, superintelligence, & evolving AI benchmarks.
📍 Half-day summit | $49
👉 Register: events.linuxfoundation.org/pytorch-conference-north-ameri… -
PyTorch
@PyTorch
1️⃣ week. Countless breakthroughs.
#opensourceaiweek takes over San Francisco Oct 18–26.
Be part of the global conversation shaping the future of #genai & #ml.
🔎 Explore the events & register: events.linuxfoundation.org/open-source-ai-week/?hss_chann… -
PyTorch
@PyTorch
Smarter data, stronger #ai. At #pytorchcon (Oct 22-23, San Francisco), the Data track explores intelligent pipelines and adaptive datasets for next-gen training. 🚀
Explore the track: events.linuxfoundation.org/pytorch-conference-north-ameri…
Register: events.linuxfoundation.org/pytorch-conference-north-ameri… -
PyTorch
@PyTorch
Discover the tools shaping the #pytorch ecosystem! At #pytorchcon (Oct 22-23, San Francisco), dive into updates on vLLM, Deepspeed, Huggingface, Lightning, & more. ⚡
Explore the track: events.linuxfoundation.org/pytorch-conference-north-ameri…
Register: events.linuxfoundation.org/pytorch-conference-north-ameri… -
PyTorch
@PyTorch
At #allin2025, PyTorch Foundation ED Matt White joins the panel "Open Source AI, Closed Doors? Reskilling for Inclusive Innovation" to explore how #opensource #ai accelerates innovation while raising urgent #reskilling questions.
🔗 Learn more: allinevent.ai/pages/2025-programming?hss_channel=tw-77658… -
PyTorch
@PyTorch
🧸 Parents: Sign up for complimentary child care at #pytorchcon (Oct 22-23 in SF)! RSVP by Sept 19 - no late signups allowed. Enjoy the event carefree 👉 events.linuxfoundation.org/pytorch-conference-north-ameri…
-
PyTorch
@PyTorch
🚨 Last chance! Applications for the #pytorch Startup Showcase close TODAY. Pitch live to VCs Oct 21 in San Francisco. Apply now before it’s too late!
👉 events.linuxfoundation.org/archive/2024/pytorch-conferenc… -
PyTorch
@PyTorch
⏰ Deadline is TOMORROW. #ai startups, apply to pitch live at the #pytorch Startup Showcase Oct 21 in San Francisco. Don’t miss this chance to get in front of top VCs.
👉 events.linuxfoundation.org/archive/2024/pytorch-conferenc… -
PyTorch
@PyTorch
Who else is heading to San Francisco for #pytorchcon? 🎉
See the leaders, builders, & innovators already signed up, then add your name to the list! 👀 events.linuxfoundation.org/pytorch-conference-north-ameri…
October 22-23 is your chance to be in the room where #ai moves forward.
🎟️ events.linuxfoundation.org/pytorch-conference-north-ameri… -
PyTorch
@PyTorch
Disaggregated Inference at Scale with #pytorch & #vllm:
Meta’s vLLM disagg implementation improves inference efficiency in latency & throughput vs its internal stack, with optimizations now being upstreamed to the vLLM community.
🔗 pytorch.org/blog/disaggregated-inference-at-scale-with-py… -
PyTorch
@PyTorch
⏳ Do not wait. Prices for #pytorchcon increase by $200 after TODAY. Register now to save. Oct 22-23 in San Francisco.
🎟️ events.linuxfoundation.org/pytorch-conference-north-ameri… -
PyTorch
@PyTorch
At #allin2025, PyTorch Foundation ED Matt White joins the panel "Open Source AI, Closed Doors? Reskilling for Inclusive Innovation" to explore how #opensource #ai accelerates innovation while raising urgent #reskilling questions.
🔗 Learn more: allinevent.ai/pages/2025-programming?hss_channel=tw-77658… -
PyTorch
@PyTorch
As #training jobs grow, failures like preemptions and crashes cause costly delays. Efficient distributed #checkpointing is key. #pytorch @Google built a local checkpointing solution using DCP to cut overhead, reduce rollbacks, and boost training goodput.
🔗 pytorch.org/blog/distributed-checkpoint-efficient-checkpo…
🖋️ @meta & @Google -
PyTorch
@PyTorch
📱 AI at the edge is here. At #pytorchcon, Oct 22-23 in San Francisco, explore how #pytorch powers mobile, embedded, & IoT devices.
🔎 Learn more about the Edge track: events.linuxfoundation.org/pytorch-conference-north-ameri…
🎟 Register: events.linuxfoundation.org/pytorch-conference-north-ameri… -
PyTorch
@PyTorch
🚨 Last chance alert! Registration for #pytorchcon jumps from $799 to $999 after Sept 12 (TOMORROW!). Secure your spot now for Oct 22-23 in San Francisco.
🔗 events.linuxfoundation.org/pytorch-conference-north-ameri… -
PyTorch
@PyTorch
At #gosim2025 @gosimfoundation (Sept 12–14, Hangzhou), Matt White will speak on Open Policy for the UN SDGs (Sept 13, 14:00), sharing how #opensource + #openstandards can build agentic #ai systems that advance the UN Sustainable Development Goals.
🔗 : hangzhou2025.gosim.org?hss_channel=tw-776585502606721024 -
PyTorch
@PyTorch
🎤 The stage is set and the spotlight’s on @jerryjliu0, CEO & Co-Founder at LlamaIndex, a #pytorchcon keynote speaker!
Join the minds moving #opensource #ai & ML forward.
📍 San Francisco | 📅 October 22–23
👀 Keynotes: events.linuxfoundation.org/pytorch-conference-north-ameri…
🎟️ Register: events.linuxfoundation.org/pytorch-conference-north-ameri… -
PyTorch
@PyTorch
September #pytorch newsletter: Conference 2025 updates, Oct 21 co-located events, Open Source AI Week, PyTorch 2.8 Q&A, and new blogs on inference, post-training & kernel design.
👉 pytorch.org/newsletter/september-2025/
#pytorchcon #aiinfrastructure #opensourceai -
PyTorch reposted
PyTorch
@PyTorch
Who else is heading to San Francisco for #pytorchcon? 🎉
See the leaders, builders, & innovators already signed up, then add your name to the list! October 22-23 is your chance to be in the room where #ai moves forward.
👀 events.linuxfoundation.org/pytorch-conference-north-ameri…
🎟️ events.linuxfoundation.org/pytorch-conference-north-ameri… -
PyTorch
@PyTorch
Startup founders, this is your moment. The #pytorch Startup Showcase is Oct 21. Pitch live, get noticed, & grow your #ai vision. Apply by Sept 14.
👉 events.linuxfoundation.org/archive/2024/pytorch-conferenc… -
PyTorch
@PyTorch
#pytorch Meetup Beijing takes place Sept 20, focusing on large model acceleration. Experts from Huawei, Intel, Alibaba, AMD, Infinigence AI & BAAI will cover #deepspeed training, inference optimization, RL frameworks & more.
🎫 www.huodongxing.com/event/8824514503300?hss_channel=tw-77…
#pytorchfoundation -
PyTorch
@PyTorch
Who else is heading to San Francisco for #pytorchcon? 🎉
See the leaders, builders, & innovators already signed up, then add your name to the list! October 22-23 is your chance to be in the room where #ai moves forward.
👀 events.linuxfoundation.org/pytorch-conference-north-ameri…
🎟️ events.linuxfoundation.org/pytorch-conference-north-ameri… -
PyTorch
@PyTorch
🚀 Push PyTorch performance to the max at #pytorchcon! Explore the Deep Learning Compilers, Kernel Authoring & Accelerators track to master extensibility, kernel optimization, and accelerator power. Oct 22-23 in SF.
👉 Info: events.linuxfoundation.org/pytorch-conference-north-ameri…
🎟️ Register: events.linuxfoundation.org/pytorch-conference-north-ameri… -
PyTorch
@PyTorch
Be one of the first to take the new PyTorch Associate Training Course (@linuxfoundation Education), offered in-person at #pytorchcon 2025 on Oct 21. Gain skills for the upcoming PyTorch Certified Associate exam + receive an exam voucher.
🔗 pytorch.org/blog/take-our-new-pytorch-associate-training-…
#pytorch #ai #deeplearning -
PyTorch
@PyTorch
🎙️ Mic check: @aparnadhinak, Chief Product Officer at Arize, is bringing the 🔥 to the keynote stage at #pytorchcon!
Get ready for big ideas & deeper learning October 22–23 in San Francisco.
👀 Speakers: events.linuxfoundation.org/pytorch-conference-north-ameri…
🎟️ events.linuxfoundation.org/pytorch-conference-north-ameri… -
PyTorch
@PyTorch
Only 4️⃣ days remain to save $200 on your #pytorchcon pass. Register now for $799 before rates jump to $999 after Sept 12.
🗓️ Oct 22-23 in San Francisco
Schedule: events.linuxfoundation.org/pytorch-conference-north-ameri…
🎟️ events.linuxfoundation.org/pytorch-conference-north-ameri… -
PyTorch
@PyTorch
⏳ The countdown is on! Apply for the #pytorch Startup Showcase by Sept 14. Selected startups pitch live to VCs at #pytorchcon in San Francisco on Oct 21.
Apply now ➡️ events.linuxfoundation.org/archive/2024/pytorch-conferenc… -
PyTorch
@PyTorch
🚦 Yellow Teaming with #pytorch + @Arm at WeAreDevelopers Berlin: deploying a PyTorch LLM on Graviton 4, uncovering risks like prompt injection, and exploring scalable fixes. Full blog: pytorch.org/blog/yellow-teaming-on-arm-a-look-inside-our-…
#responsibleai #llms -
PyTorch
@PyTorch
🎤 The stage is set & the spotlight’s on Percy Liang, Associate Professor of Computer Science at Stanford University, a #pytorchcon keynote speaker!
Join the minds moving #opensource #ai & ML forward.
📍 San Francisco | 📅 October 22–23
👀 Keynotes: events.linuxfoundation.org/pytorch-conference-north-ameri…
🎟️ Register: events.linuxfoundation.org/pytorch-conference-north-ameri… -
PyTorch
@PyTorch
FlashAttention in 3D? Our latest blog explores the #kernel design of 2-Simplicial #attention, modeling the algorithm with a hardware aligned design and rewriting the entire kernel in TLX (Triton Low Level Extensions).
🔗 pytorch.org/blog/fast-2-simplicial-attention-hardware-eff…
#pytorch #opensourceai -
PyTorch
@PyTorch
⏰ One week left to save $200!
Register for #pytorchcon by September 12 & lock in your pass for $799. Prices rise to $999 after the deadline.
📍Oct 22-23 | San Francisco
👉 events.linuxfoundation.org/pytorch-conference-north-ameri… -
PyTorch
@PyTorch
🚀 Big ideas incoming from Sarah Catanzaro, General Partner at Amplify, live on the #pytorchcon keynote stage.
Join the #ai and ML community in San Francisco October 22–23.
👀 Speakers: events.linuxfoundation.org/pytorch-conference-north-ameri…
🎟️ events.linuxfoundation.org/pytorch-conference-north-ameri… -
PyTorch
@PyTorch
Large Language Models (#llms) are optimized for Intel GPUs labeled as xpu in #pytorch. Learn how to speed up local inference on Intel Arc discrete, built-in, and Arc Pro GPUs, bringing advanced AI to laptops and desktops.
🔗 pytorch.org/blog/pytorch-2-8torchao-unlock-efficient-llm-…
#pytorch #llm #opensourceai -
PyTorch
@PyTorch
🎙️ Mic check: Tunji Ruwase, Lead, DeepSpeed Project & Principal Engineer at Snowflake, is bringing the 🔥 to the keynote stage at #pytorchcon!
Get ready for big ideas and deeper learning October 22–23 in San Francisco.
👀 Speakers: events.linuxfoundation.org/pytorch-conference-north-ameri…
🎟️ events.linuxfoundation.org/pytorch-conference-north-ameri… -
PyTorch
@PyTorch
PyTorch Foundation has expanded into an umbrella foundation. @vllm_project and @DeepSpeedAI have been accepted as hosted projects, advancing community-driven AI across the full lifecycle.
Supporting quotes provided by the following members: @AMD, @Arm, @AWS, @Google, @Huawei, @huggingface, @IBM, @Intel, @LightningAI, @Meta, @NVIDIA, and @Snowflake.
🔗💡 Read the full announcement: pytorch.org/blog/press-release-pytorch-foundation-expands…
#pytorchfoundation #pytorch #opensourceai #vllm #deepspeed -
PyTorch
@PyTorch
PyTorch Grows as the Dominant Open Source Framework for AI / ML 🔥 Read our #pytorch 2024 Year in Review blog: pytorch.org/blog/2024-year-in-review/
-
PyTorch
@PyTorch
From the recent GPU MODE IRL 2024 keynotes. Watch them all at: www.youtube.com/watch?v=FH5wiwOyPX4
-
PyTorch
@PyTorch
Check out this 🔥 topic at #pytorchconf, September 18-19 in San Francisco: "Pushing the Performance Envelope: an Optimization Study for 3D Generative Modelling with PyTorch" with Suvaditya Mukherjee & Shireen Chand, USC. pytorch2024.sched.com/event/1fHmW Register: events.linuxfoundation.org/pytorch-conference-north-ameri….
-
PyTorch
@PyTorch
Training MoEs at Scale with PyTorch 🔥
In our latest post, we show how we scale to over three thousand GPUs using PyTorch Distributed and MegaBlocks, an efficient open-source MoE implementation in PyTorch.
Check it out: pytorch.org/blog/training-moes/?hss_channel=tw-7765855026… -
PyTorch
@PyTorch
Introducing ExecuTorch Alpha ⚡
ExecuTorch Alpha is focused on deploying large language models and large ML models to the edge, stabilizing the API surface, and improving installation processes.
Learn more in our latest blog: pytorch.org/blog/executorch-alpha/?hss_channel=tw-7765855… -
PyTorch
@PyTorch
Announcing ExecuTorch 🚀
ExecuTorch offers a compact runtime with a lightweight operator registry to cover the PyTorch ecosystem of models, and a streamlined path to execute PyTorch programs on edge devices.
Details: pytorch.org/blog/pytorch-edge-enabling-on-device-inferenc… -
PyTorch
@PyTorch
Welcome to the PyTorch Foundation, Graphcore! 🎉
Graphcore has contributed to the PyTorch ecosystem by developing integrations to run on their IPU hardware. We look forward to their involvement in our community as the first general member!
Details: pytorch.org/blog/graphcore-joins-pytorch/?hss_channel=tw-… -
PyTorch
@PyTorch
Segment Anything as a Service with Development Seed! ✨
By leveraging SAM and Torchserve, users can integrate segment-anything-services into their workflows to help optimize compute costs.
Check out more here: developmentseed.org/blog/2023-06-08-segment-anything-serv… -
PyTorch
@PyTorch
We’re excited to share massive performance gains using the new Accelerated Transformers in PyTorch 2.0!
Check out this post to see how we achieved ~2x faster training on the nanoGPT model, and how you can apply the new SDPA operator: pytorch.org/blog/accelerating-large-language-models/?hss_… -
PyTorch
@PyTorch
Don't miss the live demo on @OctoML Profiler!
🗓️ Thursday, April 6 at 10 am PT
💻 Register: octoml.ai/cp/octoml-profiler-demo/
PyTorch
@PyTorch
@OctoML Profiler uses the latest PyTorch 2.0 compiler technology to give developers insight into ML model performance, optimize deep learning applications, and right-size hardware choices without leaving the dev environment!
Check it out 👉 medium.com/pytorch/profiling-pytorch-language-models-with… -
PyTorch
@PyTorch
@OctoML Profiler uses the latest PyTorch 2.0 compiler technology to give developers insight into ML model performance, optimize deep learning applications, and right-size hardware choices without leaving the dev environment!
Check it out 👉 medium.com/pytorch/profiling-pytorch-language-models-with… -
PyTorch
@PyTorch
PyTorch 2.0 includes Accelerated Transformers, making efficient training and deployment of state-of-the-art Transformer models practical.
This implementation was optimized to provide speed and efficiency for emerging Generative AI models.
Read more: pytorch.org/blog/accelerated-pytorch-2/ -
PyTorch
@PyTorch
At #pytorchconference, @RaghuGanti @IBMResearch spoke about scaling models with PyTorch FSDP on Ethernet. Here's a deeper technical dive into this topic showing impressive scaling efficiencies achieved over non-InfiniBand networks.
Read more: pytorch.org/blog/scaling-pytorch-fsdp-for-training-founda… + 🧵’d
1/4 -
PyTorch
@PyTorch
Two creators of passion projects that transformed the landscape of how we code today — Linus Torvalds and @soumithchintala meet for the first time, sharing a smile and a love for the open source community. #pytorchfoundation
-
PyTorch
@PyTorch
(1/2) This Schrep Tech episode celebrates PyTorch’s 5th anniversary. As we look back, learn about the two main motivations behind creating PyTorch, and then catch the full episode with host @schrep and guests @soumithchintala, @ylecun and Lin Qiao: www.youtube.com/watch?v=r7qB7mKJOFk
-
PyTorch
@PyTorch
We’re excited to announce support for GPU-accelerated PyTorch training on Mac! Now you can take advantage of Apple silicon GPUs to perform ML workflows like prototyping and fine-tuning. Learn more: pytorch.org/blog/introducing-accelerated-pytorch-training…
-
PyTorch
@PyTorch
Today marks 5 years since the public release of PyTorch! We didn't expect to come this far, but here we're🙂- 2K Contributors, 90K Projects, 3.9M lines of "import torch" on GitHub. More importantly, we're still receiving lots of love and having a great ride. Here's to the future!
-
PyTorch
@PyTorch
Introducing @PyTorchLive, an easy to use library of tools for creating on-device ML demos on Android and iOS. With Live, you can build a working mobile app ML demo in minutes. Learn more at pytorch.org/live and post your demo with #pytorchlive.
This media couldn't be displayed. See it on the original post. -
PyTorch
@PyTorch
PyTorch 1.10 is here!
Highlights include updates for:
- CUDA Graphs APIs updates
- Several frontend APIs moved to Stable
- Automatic fusion in JIT Compiler support for CPU/GPUs
- Android NNAPI now in beta
Blog: pytorch.org/blog/pytorch-1.10-released/
Release: github.com/pytorch/pytorch/releases/tag/v1.10.0 -
PyTorch
@PyTorch
The first PyTorch Developer Day is about to kick off. Join us for the full day of talks, including keynotes, PyTorch core updates, framework research, and private AI announcement starting at 8:00 AM PST.
Watch here:
www.facebook.com/pytorch/live/ -
PyTorch
@PyTorch
The team @WadhwaniAI has built a multi-task network that detects pest infestations in cotton crops. This technology is being put directly in the hands of more than 18,000 farmers across India using #pytorch Mobile, TorchServe, and Weights & Biases. medium.com/pytorch/how-wadhwani-ai-uses-pytorch-to-empowe…
-
PyTorch
@PyTorch
PyTorch/XLA, a package that lets PyTorch connect to @GCPcloud TPUs and use TPU cores as devices, is now generally available. Highlights:
- Support for Intra-Layer Model Parallelism
- Additional XLA ops
- Integrations with Colab and Kaggle notebooks
medium.com/pytorch/pytorch-xla-is-now-generally-available… -
PyTorch
@PyTorch
Welcome OpenAI to the PyTorch community!
OpenAI
@OpenAI
We're standardizing OpenAI's deep learning framework on PyTorch to increase our research productivity at scale on GPUs (and have just released a PyTorch version of Spinning Up in Deep RL): openai.com/blog/openai-pytorch/
-
PyTorch
@PyTorch
A great series of blog posts on the PyTorch C++ frontend by
@kushashwa
covering training and transfer learning, all in C++ #pytorchessentials
krshrimali.github.io/Announcing-PyTorch-CPP-Series/ -
PyTorch
@PyTorch
[v1.2.0] New TorchScript API with Improved Python Language Coverage, Expanded ONNX Export, NN.Transformer
Blog: pytorch.org/blog/pytorch-1.2-and-domain-api-release/
Release notes:
github.com/pytorch/pytorch/releases/tag/v1.2.0
Install commands on pytorch.org (the non-default installs have changed) -
PyTorch
@PyTorch
.@Mapillary does Seamless Scene Segmentation and 3D fusion across 600m+ images
A [post + code release] with tips for:
- dealing with asymmetric graphs, variable-length images and unbalanced batches
- in-place batchnorm
- distributed training
pytorch.org/blog/mapillary-research/ -
PyTorch
@PyTorch
Discovering good libraries and code might be overwhelming.
- our Ecosystem page has been curating high quality libraries
- Hub has been curating models that reproduce research and are easy to use
Read more about our recent additions and guidelines: pytorch.org/blog/pytorch-ecosystem/ -
PyTorch
@PyTorch
Try out the code at github.com/jonas-koehler/s2cnn implemented in @PyTorch and CuPy
Taco Cohen
@TacoCohen
Best paper award for our ICLR paper, "Spherical CNNs"! Read it while it's hot 🔥 arxiv.org/abs/1801.10130 🔥
-
PyTorch
@PyTorch
Do you want to ship your PyTorch models to iOS?
Read @steadicat 's experience on building a little iOS app to track the accuracy of your watch over time, powered by PyTorch, ONNX and CoreML.
attardi.org/pytorch-and-coreml/ -
PyTorch
@PyTorch
Pyro, a probabilistic programming language on top of @PyTorch from Uber AI Labs
eng.uber.com/pyro/
pyro.ai -
PyTorch
@PyTorch
PyTorch v0.2 is out: Higher order gradients, Distributed PyTorch, Broadcasting, Advanced Indexing, New Layers, more!
github.com/pytorch/pytorch/releases/tag/v0.2.0 -
PyTorch
@PyTorch
DrQA: question answering system described in "Reading Wikipedia to Answer Open-Domain Questions" from @facebook
github.com/facebookresearch/DrQA -
PyTorch
@PyTorch
Meow Generator using 5 different types of GANs by Alexia Jolicoeur-Martineau (w/ provided source code in @PyTorch ): ajolicoeur.wordpress.com/cats/
-
PyTorch
@PyTorch
SentEval: evaluate the quality of sentence embeddings on a diverse set of "transfer" tasks: github.com/facebookresearch/SentEval
-
PyTorch
@PyTorch
Researcher @RitchieNg made a @PyTorch course suitable for anyone new to DL / want a solid grounding in DL theory www.udemy.com/practical-deep-learning-with-pytorch/?coupo…

























































































































































































































































































































































































































































































































































































































































































































































































































