Michael Pearce
@_MichaelPearce
Interpretability @ Goodfire | Physics | Evolution | Ecology
640 Following 321 Followers
Me: generate a novel 76-residue protein binder
BoltzGen: best I can do is ubiquitin.
I did a quick analysis of memorization in protein generations using @GoodfireAI’s Silico (now publicly available!). Silico makes it easier to investigate and debug model issues like this 🧵
Show more
PCA reveals beautiful geometry inside a protein language model. But does the model actually use it?
I explored how protein folds—like this beta-propeller fold—are represented in ESMC-6B using the interpretability tools built into Silico, @GoodfireAI's research platform 🧵
Show more
