Sudo su
@sudoingX
GPU/local LLM. more RAM and OSS... everywhere
参加 August 2022
1.2K フォロー中 40K ファン
tell me i'm wrong
every time an ai writes one word it reads the whole model out of memory again, so a 70gb model moves 70gb just to pick the next word, then starts over for the one after
is that really how this works?
もっと見る
