We plugged Beam into
@opencode, asked it to look at
@UnslothAI, and create a fine-tuning notebook for the latest and smallest Gemma-4 model on a Text2SQL task – an out of distribution domain for Beam.
The model successfully researches the model cards, Unsloth documentation, and available READMEs, and implements the fine-tuning logic and surrounding machinery. As a result, Beam is able to successfully finetune Gemma, increasing Gemma’s accuracy on its heldout test set by 66.5%.