Chapter 5 of DELTARUNE is now available as of June 24th!✨ Fans don't have to wait any longer for the newest installment of this game by the creator of UNDERTALE!🎮♥️ See #fanart# featuring #DELTARUNE# on #pixivision# today!👇

It's Winter, so that means another DELTARUNE NEWSLETTER! This contains a lot of fun stuff, including some concept art for Chapter 3 and 4! We're sending it now, but it'll take a while for all the emails to go out.

Gated DeltaNet-2 (GDN-2) is now a lot faster on NVIDIA GPUs 🚀 Thanks to an amazing effort by our cuDNN team, we now have full cuDNN support for GDN-2. This covers not just prefill (forward), but also a highly optimized backward pass built on CUTLASS primitives, available now as part of the CUTLASS 4.7.0 release. On GB300 (BF16, batch 4, 64 heads, d=128), compared to the FLA Triton implementation: ⚡ Forward: up to 6.4x faster ⚡ Backward: up to 2.8x faster ⚡ End-to-end: ~3x faster training Throughput stays flat across sequence lengths from 2K to 32K, meaning the kernels are compute-bound where they should be. Benchmarks below. 👇 If you are interested to know more about GDN-2, see our manuscript below:

I am happy to announce that Gated DeltaNet-2 has been accepted to NeurIPS 2026 ! 🎉 🎊🥂 Our models are the new SOTA for hybrid/linear models ! Paper: Code: