Jack Morris
@jxmnop
research @engramlab // language models, information theory, science of AI
Joined October 2016
1.1K Following 53.7K Followers
we didn't ever need to invent Masked Language Modeling, I don't think. it was a bit silly by construction. in most alternate universes we probably skip straight to autoregressive, sorry BERT
