Review tables make up around 20% of our inference costs (largest query last month cost $26k)
we partnered with
@appliedcompute to post-train a model specifically for these queries and cut costs by 50%+ while improving answer and citation quality
huge effort by
@vtrengarajan @ItsJulioPereyra @nikogrupen @srice120