Ostris(@ostrisai):Added initial support to fine tune LLMs in AI Toolkit with a focus on Omni models. First one added is Qwen2.5-Omni-7B and I trained a LoRA for it to better caption and transcribe music files. You can use these LoRAs in the dataset captioner along with default cloud ones.

Ostris

@ostrisai

AI / ML researcher and developer. Creator of AI Toolkit - Support my work -

Joined August 2023

338 Following 15K Followers

Ostris@ostrisai

2026.09.16 16:49

Added initial support to fine tune LLMs in AI Toolkit with a focus on Omni models. First one added is Qwen2.5-Omni-7B and I trained a LoRA for it to better caption and transcribe music files. You can use these LoRAs in the dataset captioner along with default cloud ones.