注册并分享邀请链接,可获得视频播放与邀请奖励。

Dmytro Dzhulgakov
@dzhulgakov
Co-founder and CTO @FireworksAI_HQ. PyTorch core maintainer. Previously FB Ads. Ex-Pro Competitive Programmer
加入 April 2013
845 正在关注    7.9K 粉丝
pretraining implies unique model arch and/or optimization setup - hard to abstract as API while allowing full flexibility midtraining is different: finetuning on Ts of tokens, same arch you need full param, not only LoRA - check Fireworks Training, we’ve got it covered
显示更多
if tinker launched a pretraining API it would rip so hard. probably mostly by quote/enterprise but theres really no good OSS pretraining stack, unlike RL