Eric Zhang(@ekzhang1):Inspired by @typesafeai , here is a Jev-compatible public API to play with It runs a comparable open model (Qwen3.6-35B-A3B), and just uses SGLang radix cache to preserve the prefill reuse / really fast parallel systemone generation

Eric Zhang

@ekzhang1

Computer systems person, interaction designer. @thinkymachines prev founding eng @modal → dreams of: a simpler, more honest, more human sort of software

加入 June 2021

651 正在關注 23K 粉絲

Eric Zhang@ekzhang1

2026.09.17 18:22

Inspired by @typesafeai , here is a Jev-compatible public API to play with It runs a comparable open model (Qwen3.6-35B-A3B), and just uses SGLang radix cache to preserve the prefill reuse / really fast parallel systemone generation - 64 tasks in <1s.