Zain
@zainhas
I build and teach AI • AI/ML @togethercompute • EngSci ℕΨ/PhD @UofT • Previously: vector DBs, data scientist, lecturer & health tech founder • 🇺🇸🇨🇦🇵🇰
加入 August 2012
2.2K 正在關注 8.7K 粉絲
inference engines should be bending over backwards more to get cache hits
really interesting direction:
> An Internet for the KV Cache - sending a KV cache across the Internet can now be faster and cheaper than computing it again.
顯示更多
