Trevin Chow(@trevin):Most Jev demos get shared in a vacuum, focused on cost and speed. But mysteriously absent is any discussion about comparative quality against an LLM driving for the same outcome. Yesterday I ran Jev in a re-ranking pipeline with an eval harness. It was ~50× cheaper and ~25× faster than the LLM path. We still kept Opus. Why? Opus produced better results on that task. We’ll pay more money and more time when the ranking is better. That shouldn’t be controversial — you just never hear it next to the flashy Jev demos. The interesting part of Jev isn’t “replace your LLM.” It’s the new loops you can afford when a decision is insanely cheap, and insanely fast.

2026.09.22 04:38

Most Jev demos get shared in a vacuum, focused on cost and speed. But mysteriously absent is any discussion about comparative quality against an LLM driving for the same outcome. Yesterday I ran Jev in a re-ranking pipeline with an eval harness. It was ~50× cheaper and ~25× faster than the LLM path. We still kept Opus. Why? Opus produced better results on that task. We’ll pay more money and more time when the ranking is better. That shouldn’t be controversial — you just never hear it next to the flashy Jev demos. The interesting part of Jev isn’t “replace your LLM.” It’s the new loops you can afford when a decision is insanely cheap, and insanely fast.

显示更多