yetone
@yetone
Built: avante.nvim
Building:
Joined May 2010
4.6K Following 105.2K Followers
牛啊！
DeepSeek just open sourced its high-performance, large-scale inference framework DeepInfer in Apache-2.0 license.
Supported features:
- Optimized kernels, model and sampler runtime
- Parallelism: Attention DP / balanced CP, MoE EP + EPLB
- DSpark and confidence-scheduled verification
- SWA bounded replay
- Asynchronous scheduling (zero-overhead batch scheduler)
- Batch-invariant inference
- Deterministic sampling
- Structured output
Show more
