Peter J. Liu
@peterjliu
Building @getcompoundai. Was Research Scientist @ Google Brain / DeepMind, language model research. No slop-posting. đēđ¸đ¨đĻ
2.7K Following 9.9K Followers
GPT 5.6 Sol is very under-rated at the moment. Our internal evals show it's a very good model, in a lot of ways better than Opus 5. Plan on posting more details.
Reading Kimi K3 paper, I'm struck by the number of innovations and departures from orthodoxy. These guys are doing real research and not copying. It is no longer the case of being, "mostly the Transformer with a few Noam mods".
I mean they got rid of the position encodings/embeddings! Bold!
More thoughts to come after reading.
Show more
