注册并分享邀请链接,可获得视频播放与邀请奖励。

PyTorch
@PyTorch
Tensors and neural networks in Python with strong hardware acceleration. PyTorch is an open source project at the Linux Foundation. #PyTorchFoundation#
加入 September 2016
87 正在关注    500.6K 粉丝
PyTorch 2.13 is here, with 3,328 commits from 526 contributors and updates across FlexAttention, CuTeDSL, nn.LinearCrossEntropyLoss, torchcomms, FSDP2, Python 3.15 wheels, ROCm, Arm, and XPU. The release blog and notes cover FlexAttention on Apple Silicon with up to ~12x speedup over SDPA on sparse patterns, a deterministic backward path on CUDA, the CuTeDSL "Native DSL" backend for Inductor, nn.LinearCrossEntropyLoss to reduce peak GPU memory by up to 4x, torchcomms for large-cluster training, and FSDP2 communication overlap improvements. On July 22 at 11 a.m. PT, join @albanDesmaison (@Meta), Andrey Talman (@Meta), Piotr Bialecki (@NVIDIA), and Chris Gottbrath for a live 2.13 Q&A. 🔗 Read the release blog, and register for the live Q&A:
显示更多
0
5
134
16
转发到社区