A 30M-parameter language model, trained from scratch and running offline on our XIAO ESP32S3 ๐ฑ
Marina squeezed the weights to 4-bit and streams them from microSD to fit the tiny board. Slow, but it works!
Watch the video ๐
๋ ๋ณด๊ธฐ
