๐๏ธAuK turns natural-language instructions into generated, edited, restored, or separated speech with one 1.5B model. ๐ MIT License.
๐ค
๐
๐ AuK delivers leading results on zero-shot and instruction-controlled speech generation, plus general speech editing benchmarks including MMAE-Speech and SpeechEditBench.
๐ฃ๏ธ Clone or design a voice, rewrite speech or lyrics, change emotion, timbre, accent, pitch, speed, and volume, or add and remove laughs, breaths, and coughs.
๐ง It also denoises and dereverberates speech, separates speakers or vocals, and extracts a target speaker from a mixture. All tasks use the same instruction interface.
๐ง Training spans 3.03B instruction-audio pairs and 1.95M hours of effective supervision.