Andi Marafioti
@andimarafioti
leading multimodal research @huggingface (prev @unity)
671 Following 7.9K Followers
Thinking Machines just released Inkling-Small: 276B total, 12B active. A faster Inkling that matches or beats its 975B big brother in many benchmarks.
To test its speed, we plugged it into HF's speech-to-speech. Audio goes directly into the model, and it replies using faster-Qwen3TTS. Running on 8x RTX Pro 6000 Blackwell, we get audio back in under 500ms.
The normal Inkling needs 2TB of VRAM, this one fits on one node.
Because the model hears the audio instead of a transcript, it can hear your tone and emotions. You can check it in the video.
Or just go and try it in the space! Really fun model:
Show more
Talk to Gemma 4 31B with our voice app!
It sees and searches the web faster than you blink. Thanks to @cerebras’ ultra fast inference, the LLM is almost instantaneous.
The whole stack is fully open-source, and is a drop-in replacement for OpenAI's realtime API.
Demo:
Show more
