vLLM(@vllm_project):And it's not locked to DeepSeek's checkpoints. 🧩 The Speculators library (https://t.co/pLpZP4xqfA) lets you train and package DSpark draft models in a standard, HF-compatible format that vLLM loads directly. Already validated on Qwen3-8B and GLM-5.2. Run it on vLLM nightly now: vllm serve zai-org/GLM-5.2-FP8 -tp 8 --speculative-config '{"method":"dspark","model":"RedHatAI/GLM-5.2-speculator.dspark-preview","num_speculative_tokens":7,"attention_backend":"FLASH_ATTN","draft_sample_method":"greedy"}' speculators support PR: https://t.co/ZIuOMe7zP1 Thanks to the @RedHat_AI team for the Speculators integration! 🙏

2026.07.02 04:58

And it's not locked to DeepSeek's checkpoints. 🧩 The Speculators library ( lets you train and package DSpark draft models in a standard, HF-compatible format that vLLM loads directly. Already validated on Qwen3-8B and GLM-5.2. Run it on vLLM nightly now: vllm serve zai-org/GLM-5.2-FP8 -tp 8 --speculative-config '{"method":"dspark","model":"RedHatAI/GLM-5.2-speculator.dspark-preview","num_speculative_tokens":7,"attention_backend":"FLASH_ATTN","draft_sample_method":"greedy"}' speculators support PR: Thanks to the @RedHat_AI team for the Speculators integration! 🙏