Fireworks
@FireworksAI_HQ
The frontier platform for training and inference on open-weights models at scale.
Joined September 2022
304 Following 32.8K Followers
The hardest bugs were numerical. Long-horizon RL drifts when the engine generating rollouts and the one scoring them stop assigning the same probabilities to the same tokens. Aligning tokenization across both kept the training signal trustworthy.
Show more
