antirez
@antirez
Reproducible bugs are candies.
I like programming too much for not liking automatic programming.
Joined May 2007
797 Following 77.5K Followers
This paper shows that knowledge transfer is hard even under perfect conditions and model access, yet it is randomly used as an argument against what i was saying about distillation. Actually it is a good read to understand why API distillation can't work, and you can just fine tune for specific style/patterns or very narrow domain knowledge *at best*.
Show more
