Ivy is the HTTP gateway.
It handles CPU-side request prep: parsing, tokenization, templating, and splitting large batches before sending them to Tulip over gRPC.
It allows us to tune request formatting and tokenization without touching the heavier inference servers.
Ivy Wolk chats with ET at the premiere of 'The Shards,' an all-new series from Ryan Murphy based on Bret Easton Ellis' best-selling novel, premiering Aug. 5 on FX on Hulu. The actress, who's broken out with performances in 'Anora,' 'If I Had Legs I'd Kick You' and 'English Teacher,' reflects on her sudden fame and the conversations that come along with it.