ρ:ɡeon
@pigeon__s
omnimodality is all you need
Joined October 2020
67 Following 1.7K Followers
DeepSeek is too focused on architectural and memory usage efficiency and not really caring about changing up how their models reason or the reasoning efficiency
their models still burn tokens like no other models on earth I feel like the RL they use is still pretty primitive while the memory improvements like KV cache and stuff for hyperscaling has been the focus
Show more
