Rafi Ayub
@theayubinator
Trained AI models, now I write about how they're training us.
Research at @aesona_research, member @spc. Formerly post-training @AnthropicAI, @PyTorch.
加入 March 2024
138 正在关注 734 粉丝
torchtune v0.3.0 is officially released! We’ve added a lot of improvements in memory and performance and RLHF. The highlights [1/2]:
- Full support for FSDP2 in full and (Q)LoRA finetune, upto +30%-150% speedup
- RLHF with PPO, SimPO, thanks to a community contributor
- DoRA
显示更多
