Sudo su
@sudoingX
GPU/local LLM. more RAM and OSS... everywhere
加入 August 2022
1.2K 正在关注 40K 粉丝
tell me i'm wrong
every time an ai writes one word it reads the whole model out of memory again, so a 70gb model moves 70gb just to pick the next word, then starts over for the one after
is that really how this works?
显示更多
