Saurabh Shah
@saurabh_shah2
barista @humansand prev @allen_ai @Apple @Penn 🎤dabbler of things🎸 🐈⬛enjoyer of cats 🐈 and mountains🏔️he/him
1.9K Following 3.9K Followers
nvidia acquiring reflection makes sense
Nemo is a 550B
Beam is 501B
550B+ 501B = 1T so they’ll have a K 2.6 level model
If they can get thinky on board that adds another ~1.2T (inkling big and small) so the next nemotron could be as many as 2.2T, in striking range of K3
(ty @srush_nlp for teaching me how to do back of the envelope calcs for transformers)
Show more
