Review tables make up around 20% of our inference costs (largest query last month cost $26k)
we partnered with @appliedcompute to post-train a model specifically for these queries and cut costs by 50%+ while improving answer and citation quality
huge effort by @vtrengarajan@ItsJulioPereyra@nikogrupen@srice120