Sudo su
@sudoingX
GPU/local LLM. more RAM and OSS... everywhere
가입 August 2022
1.2K 팔로잉 중 40K 팬
tell me i'm wrong
every time an ai writes one word it reads the whole model out of memory again, so a 70gb model moves 70gb just to pick the next word, then starts over for the one after
is that really how this works?
더 보기
