Chris ๐จ๐ฆ
@llm_wizard
Open Source Model Lover @ NVIDIA AI
Views my own.
๊ฐ์
June 2021
673 ํ๋ก์ ์ค 4.6K ํฌ
Guess. That. Model!
computed the similarity (CKA) on the J-lens geometry of every layer inside and across 38 open models. the patterns are weirdly universal: same depth layout, same organization at the same relative depth, even between unrelated families like llama and olmo
๋ ๋ณด๊ธฐ
