Rafi Ayub
@theayubinator
Trained AI models, now I write about how they're training us.
Research at @aesona_research, member @spc. Formerly post-training @AnthropicAI, @PyTorch.
138 Following 734 Followers
torchtune v0.3.0 is officially released! We’ve added a lot of improvements in memory and performance and RLHF. The highlights [1/2]:
- Full support for FSDP2 in full and (Q)LoRA finetune, upto +30%-150% speedup
- RLHF with PPO, SimPO, thanks to a community contributor
- DoRA
Show more
