yetone
@yetone
Built: avante.nvim
Building:
加入 May 2010
4.6K 正在关注 105.2K 粉丝
牛啊！
DeepSeek just open sourced its high-performance, large-scale inference framework DeepInfer in Apache-2.0 license.
Supported features:
- Optimized kernels, model and sampler runtime
- Parallelism: Attention DP / balanced CP, MoE EP + EPLB
- DSpark and confidence-scheduled verification
- SWA bounded replay
- Asynchronous scheduling (zero-overhead batch scheduler)
- Batch-invariant inference
- Deterministic sampling
- Structured output
显示更多
