่จปๅ†Šไธฆๅˆ†ไบซ้‚€่ซ‹้€ฃ็ต๏ผŒๅฏ็ฒๅพ—ๅฝฑ็‰‡ๆ’ญๆ”พ่ˆ‡้‚€่ซ‹็Žๅ‹ตใ€‚

David Hendrickson
@TeksEdge
CEO & Founder | PhD | Startup Advisor | @Columbia | Author Generative Software Engineering | ๐Ÿ”” Follow for AI & Vibe Coding Tips ๐Ÿ‘‡
ๅŠ ๅ…ฅ July 2023
552 ๆญฃๅœจ้—œๆณจ    12.5K ็ฒ‰็ตฒ
A new speech-to-text model of only 1.06MB can transcribe audio ~436ร— faster than real time on ONE CPU thread! No GPU. AuroraASR-1M is a super super small local speech-recognition model with these stats ๐Ÿง  949K parameters ๐Ÿ’พ FP32 โ†’ 3.81MB ๐Ÿ’พ FP16 โ†’ 1.91MB ๐Ÿ’พ INT8 โ†’ 1.06MB ๐Ÿ”“ Apache 2.0 ๐Ÿ–ฅ๏ธ CPU or GPU The developer measured the full end-to-end pipeline โ€” feature extraction + speech recognition + CTC decoding at ... ๐Ÿ–ฅ๏ธ 1 CPU thread โ†’ ~436ร— real time ๐Ÿ”ฅ RTX PRO 6000 Blackwell โ†’ ~1,362ร— real time ๐ŸŽฏSo 10 minutes of audio could be processed in about 1.4 seconds at the reported single-thread CPU rate. So to underscore, this isn't using an external language model! It's a tiny Conformer-CTC model trained on LibriSpeech and can run through Transformers locally. There's a tradeoff, accuracy AuroraASR-1M test-clean WER โ†’ 11.43% Whisper Tiny English โ†’ 5.6% So Whisper Tiny is substantially more accurate. Aurora is also ๐Ÿ‡บ๐Ÿ‡ธ English only ๐Ÿ”ก lowercase output โŒ no punctuation A 1MB model can now turn speech into text locally at hundreds of times real time on a single CPU core. That makes completely offline transcription, voice commands and embedded voice features almost absurdly cheap. ๐Ÿ”— Hugging Face model in ALT.
้กฏ็คบๆ›ดๅคš