This was fun! We used @FireworksAI_HQ for training two LoRA adapters on top of a small MoE model to catch more secrets and address friction. Weights are available on @huggingface for the community to freely access and continue to build on top of.
Show more
