註冊並分享邀請連結,可獲得影片播放與邀請獎勵。

Xenova
@xenovacom
Bringing the power of machine learning to the web. Currently working on Transformers.js (@huggingface 🤗)
加入 December 2015
411 正在關注    21.3K 粉絲
We've just made a breakthrough: the first true omni model running 100% locally in a browser... fully end-to-end, with no separate ASR or TTS models needed. With custom WebGPU kernels, we're able to run LFM3-Omni-2B at ~280 tok/s on my M4 Max, accepting visual, audio, or text and producing interleaved text and audio tokens. Just 90 ms to the first token and 140 ms to the first audio. The future of on-device multimodal AI agents is going to be wild.
顯示更多
0
57
947
94
轉發到社區