Veeral Patel(@vral):Ashwin benchmarked Jev as a replacement for LLM-based reranking in Ramp's accounting product, and the results are very promising Jev matches current accuracy on GPT-5.6 Luna, but decreases tail latency by 10x to 300ms at 3x lower cost We're excited to get this into production for 70k customers as soon as we stop running into rate limits :)

Veeral Patel

@vral

head of applied ai 💳 investing

Joined October 2010

1.3K Following 4.7K Followers

Veeral Patel@vral

2026.09.24 19:37

Ashwin benchmarked Jev as a replacement for LLM-based reranking in Ramp's accounting product, and the results are very promising Jev matches current accuracy on GPT-5.6 Luna, but decreases tail latency by 10x to 300ms at 3x lower cost We're excited to get this into production for 70k customers as soon as we stop running into rate limits :)