Blog

In this blog post, we explore the kernel design details presented in the paper Fast…

Large Language Models (LLMs) have transformed tasks across numerous industries, including drafting emails, generating code,…

tldr: 1.22x - 1.28x training acceleration with MXFP8, equivalent convergence compared to BF16. We recently…

Large Language Models (LLMs) have revolutionized how we write and consume documents. In the past…

TL;DR NJTs (Nested Jagged Tensors) boost DRAMA model inference efficiency by 1.7x-2.3x, making it more…

Introduction ZenFlow is a new extension to DeepSpeed introduced in summer 2025, designed as a…

In this post, we present an optimized Triton BF16 Grouped GEMM kernel for running training…

charliemarsh’s tweet, creator of uv PyTorch is the leading machine learning framework for developing and…

Introduction We integrate mixed and low-precision training with Opacus to unlock increased throughput and training…

Key Takeaways: ExecuTorch 0.7 now enables KleidiAI by default, delivering automatic acceleration on Arm CPUs…

TorchAO brings high-performance low-bit linear and embedding operators to Arm CPUs. In this update, we’re…

We are excited to announce the release of PyTorch® 2.8 (release notes)! This release features: …

Diffusers is the go-to library that provides a unified interface to cutting-edge and open diffusion…

Introduction and Context Opacus is making significant strides in supporting private training of large-scale models…

Summary PyTorch Distributed Checkpointing (DCP) is a versatile and powerful tool for managing model checkpoints…

Key takeaways: PyTorch and vLLM are both critical to the AI ecosystem and are increasingly…