QVAC(@qvac):We optimized NVIDIA's Parakeet 0.6B models to transcribe twice as fast on the @Snapdragon 8 Elite, a flagship @Qualcomm phone chip. We moved the work from the chip's graphics processor to its AI processor, the Hexagon NPU. On a OnePlus 13s, Parakeet CTC 0.6B now transcribes a minute of audio in 970 ms, with the same text the GPU produced. Thanks to @NVIDIAAI for Parakeet and @ggml

QVAC

@qvac

Infinite intelligence. Local. Any Hardware. Peer-to-Peer Hyper Swarm. No cloud. No compromise. QVAC is the decentralized AI platform for humans and machines.

Joined April 2025

2 Following 13.5K Followers

QVAC@qvac

2026.10.09 09:57

We optimized NVIDIA's Parakeet 0.6B models to transcribe twice as fast on the @Snapdragon 8 Elite, a flagship @Qualcomm phone chip. We moved the work from the chip's graphics processor to its AI processor, the Hexagon NPU. On a OnePlus 13s, Parakeet CTC 0.6B now transcribes a minute of audio in 970 ms, with the same text the GPU produced. Thanks to @NVIDIAAI for Parakeet and @ggml_org for the code we built on.