A new speech-to-text model of only 1.06MB can transcribe audio ~436ร faster than real time on ONE CPU thread!
No GPU.
AuroraASR-1M is a super super small local speech-recognition model with these stats
๐ง 949K parameters
๐พ FP32 โ 3.81MB
๐พ FP16 โ 1.91MB
๐พ INT8 โ 1.06MB
๐ Apache 2.0
๐ฅ๏ธ CPU or GPU
The developer measured the full end-to-end pipeline โ feature extraction + speech recognition + CTC decoding at ...
๐ฅ๏ธ 1 CPU thread โ ~436ร real time
๐ฅ RTX PRO 6000 Blackwell โ ~1,362ร real time
๐ฏSo 10 minutes of audio could be processed in about 1.4 seconds at the reported single-thread CPU rate.
So to underscore, this isn't using an external language model!
It's a tiny Conformer-CTC model trained on LibriSpeech and can run through Transformers locally.
There's a tradeoff, accuracy
AuroraASR-1M test-clean WER โ 11.43%
Whisper Tiny English โ 5.6%
So Whisper Tiny is substantially more accurate.
Aurora is also ๐บ๐ธ English only ๐ก lowercase output โ no punctuation
A 1MB model can now turn speech into text locally at hundreds of times real time on a single CPU core.
That makes completely offline transcription, voice commands and embedded voice features almost absurdly cheap.
๐ Hugging Face model in ALT.