yetone
@yetone
Built: avante.nvim
Building:
가입 May 2010
4.6K 팔로잉 중 105.2K 팬
牛啊！
DeepSeek just open sourced its high-performance, large-scale inference framework DeepInfer in Apache-2.0 license.
Supported features:
- Optimized kernels, model and sampler runtime
- Parallelism: Attention DP / balanced CP, MoE EP + EPLB
- DSpark and confidence-scheduled verification
- SWA bounded replay
- Asynchronous scheduling (zero-overhead batch scheduler)
- Batch-invariant inference
- Deterministic sampling
- Structured output
더 보기
