Sergio Paniego
@SergioPaniego
Machine Learning Engineer @huggingface 🤗
AI PhD. Technology enables us to be more human. 🏳️🌈
Joined July 2011
1.7K Following 7.9K Followers
TRL now supports MOPD (Multi-Teacher On-Policy Distillation) natively❗️
many frontier open models use it. labs train one RL expert per domain and then distill them all into one model
blog with what it is, who uses it and an experiment you can run on HF Jobs with one command
Show more
