When should you start post-training your own models?
@FireworksAI_HQ CEO
@lqiao’s answer: after product-market fit. Not because it's hard... but because only after PMF is the data coming off your product surface worth training on.
Lin joined us for our
@sequoia "Own Your Intelligence" event to host a workshop on all things post-training; what works, what breaks, and how not to let the model outsmart you. Must listen!!
00:00 Introduction
00:37 What Fireworks sees across thousands of AI applications
02:47 Off-the-shelf APIs and the problem of keeping your taste
03:58 What "owning your intelligence" actually means
05:43 The progression: prompting → RAG → SFT → preferences → RL
07:20 Why this mirrors how humans learn
09:03 Matching the technique to the problem you actually have
10:46 Where teams get stuck: data quality and vibe evals
12:28 Reward hacking: the model that wrote zero lines of code
13:59 Training-to-serving alignment (and why quality drops)
15:55 Post-training in healthcare and security
17:31 From coding to every co-work domain
19:35 Incumbents, cost burden, and not scaling into bankruptcy
21:26 How much control do you want?
23:24 Q&A: What makes a good reward signal
25:00 Q&A: When to start thinking about post-training