๊ฐ€์ž… ํ›„ ์ดˆ๋Œ€ ๋งํฌ๋ฅผ ๊ณต์œ ํ•˜๋ฉด ๋™์˜์ƒ ์žฌ์ƒ ๋ฐ ์ดˆ๋Œ€ ๋ณด์ƒ์„ ๋ฐ›์„ ์ˆ˜ ์žˆ์Šต๋‹ˆ๋‹ค.

David Hendrickson
@TeksEdge
CEO & Founder | PhD | Startup Advisor | @Columbia | Author Generative Software Engineering | ๐Ÿ”” Follow for AI & Vibe Coding Tips ๐Ÿ‘‡
๊ฐ€์ž… July 2023
552 ํŒ”๋กœ์ž‰ ์ค‘    12.5K ํŒฌ
A new speech-to-text model of only 1.06MB can transcribe audio ~436ร— faster than real time on ONE CPU thread! No GPU. AuroraASR-1M is a super super small local speech-recognition model with these stats ๐Ÿง  949K parameters ๐Ÿ’พ FP32 โ†’ 3.81MB ๐Ÿ’พ FP16 โ†’ 1.91MB ๐Ÿ’พ INT8 โ†’ 1.06MB ๐Ÿ”“ Apache 2.0 ๐Ÿ–ฅ๏ธ CPU or GPU The developer measured the full end-to-end pipeline โ€” feature extraction + speech recognition + CTC decoding at ... ๐Ÿ–ฅ๏ธ 1 CPU thread โ†’ ~436ร— real time ๐Ÿ”ฅ RTX PRO 6000 Blackwell โ†’ ~1,362ร— real time ๐ŸŽฏSo 10 minutes of audio could be processed in about 1.4 seconds at the reported single-thread CPU rate. So to underscore, this isn't using an external language model! It's a tiny Conformer-CTC model trained on LibriSpeech and can run through Transformers locally. There's a tradeoff, accuracy AuroraASR-1M test-clean WER โ†’ 11.43% Whisper Tiny English โ†’ 5.6% So Whisper Tiny is substantially more accurate. Aurora is also ๐Ÿ‡บ๐Ÿ‡ธ English only ๐Ÿ”ก lowercase output โŒ no punctuation A 1MB model can now turn speech into text locally at hundreds of times real time on a single CPU core. That makes completely offline transcription, voice commands and embedded voice features almost absurdly cheap. ๐Ÿ”— Hugging Face model in ALT.
๋” ๋ณด๊ธฐ