Sudo su
@sudoingX
GPU/local LLM. more RAM and OSS... everywhere
Joined August 2022
1.2K Following 40K Followers
tell me i'm wrong
every time an ai writes one word it reads the whole model out of memory again, so a 70gb model moves 70gb just to pick the next word, then starts over for the one after
is that really how this works?
Show more
