Gergely Orosz
@GergelyOrosz
Writing @Pragmatic_Eng, the #1# software engineering newsletter on Substack. Author of @EngGuidebook. Formerly Uber & Skype.
Joined April 2009
3K Following 348.8K Followers
I’m starting to realize just how important it is to understand context sizes, context rot, context compression & similar behaviors to understand why these models often fall short
Eg why it is that you give it a large block of stuff and the model “forgets” about parts of it etc
Show more
