Zara Zhang(@zarazhangrui):Built a "YouTube realtime copilot" browser extension using OpenAI's realtime 2 API: The agent watches the video alongside you, and can answer any question you have about what was just said via realtime voice chat. The crazy part to me is: It can differentiate the YouTube's audio stream and your voice, so it doesn't confuse the video as commands, and stays silent unless you ask something!

Zara Zhang

@zarazhangrui

Builder. Dangerously skips permissions. Harvard’17. GitHub: YouTube:

가입 May 2013

1.4K 팔로잉 중 66.4K 팬

Zara Zhang@zarazhangrui

2026.05.09 05:03

Built a "YouTube realtime copilot" browser extension using OpenAI's realtime 2 API: The agent watches the video alongside you, and can answer any question you have about what was just said via realtime voice chat. The crazy part to me is: It can differentiate the YouTube's audio stream and your voice, so it doesn't confuse the video as commands, and stays silent unless you ask something!