Helping ecosystem to grow on vLLM, ex-Head of APAC ecosystem @huggingface. Ex-Googler on TFLite/micro. Ideas on my own. Interested in future tech. DM open
Here is th eQwen-Image-2.1 official 8 steps turbo model.
I know vllm-omni has been doing a lot of work to enable faster inference, but not sure about how it has been doing elsewhere. What's the fastest end to end solution now?