OPENAI SAYS ITS JALAPENO CHIP BEAT NVIDIA GB300 IN INFERENCE TESTS
OpenAI says its new Broadcom-built Jalapeno chip outperformed NVIDIA $NVDA GB300 on both throughput per watt and response latency in testing.
Jalapeno runs at roughly 700W and is expected to begin powering OpenAI models later this year, targeting lower-cost and faster inference.
Important caveat: it was not tested against NVIDIA’s newer Vera Rubin platform and is not designed for AI training.
OpenAI says a second-generation chip is already nearing tape-out, while work on a third generation has begun.
もっと見る
