가입 후 초대 링크를 공유하면 동영상 재생 및 초대 보상을 받을 수 있습니다.

Jon Taylor
@JonPTaylor
🧑‍💻 Conversational AI @trydaily // ᓚᘏᗢ @pipecat_ai 🎹 I have too many synths
가입 July 2008
587 팔로잉 중    1.2K 팬
Over a year ago, I posted a video where Gemini and I collaborated on an Ableton Live Session. Music AI is fun! Creating voice-native music software is something I'm really passionate about, so, here is Jamcat. Jamcat's concept is a voice controlled, generative music performance tool, designed to inspire live, in the moment jam sessions. It uses LLMs, with both text-to-audio and audio-to-audio models to create music in realtime, entirely hands-free. ➡️ Pipecat PhoneLLM Alpha 1 for session control, running on @modal. ➡️ "StemGen" routing and workload subagent. ➡️ Foundation 1, for melodic stems. ➡️ Various audio models on @fal (like the excellent @ElevenLabs Music) for vocals, drums, textures and one-shots. ➡️ ... and of course @pipecat_ai! Voice commands can be toggled via push-to-talk (or a foot pedal, if you're wielding an axe), or it can listen the entire time (diarization.) It makes some mistakes, or sometimes misses a beat, but most of the mistakes in this video were me not paying attention to the bar counts, like a true fake musician.
더 보기