Samip
@industriaalist
cofounder Q Labs (
solving sample efficiency and generalization
Joined June 2016
116 Following 6.8K Followers
We've figured out how to *pretrain transformers* with zeroth-order optimization and no backprop.
Many of the core assumptions in optimization research are completely wrong.
(paper out soon)
Show more
