DeepSeek's open-source streak is getting absurd:
- FlashMLA: 580 TFLOPS attention on H800 - DeepEP: MoE comms - DeepGEMM: 1350+ FP8 TFLOPS matmul - 3FS: they built an entire file system - and today: the full inference engine behind V4.1-Flash, Apache 2.0
Mad respect
🚀 Introducing DeepInfer, our in-house inference framework, now fully open source!
Powering DeepSeek-V4.1-Flash at scale with high throughput and low latency. We’re sharing our production stack to help the community lower compute costs, reduce energy use, and make AI more affordable.
🔗
1/4