This is awesome. Claude Code and Codex running on open models with
@vllm_project, no OpenAI API in the loop.
Ask Qwen3.8 about a model released after its training cutoff and it has no idea. Give it server-side web search through the Agentic API and it finds the answer, with citations.
The Agentic API keeps the stateful parts, turn history and tool execution, outside vLLM so the engine stays a stateless inference server. Built in Rust, MVP just landed.
From
@franciscojarceo (
@RedHat_AI) and
@Rxday000 (
@EmbeddedLLM) 👇