๊ฐ€์ž… ํ›„ ์ดˆ๋Œ€ ๋งํฌ๋ฅผ ๊ณต์œ ํ•˜๋ฉด ๋™์˜์ƒ ์žฌ์ƒ ๋ฐ ์ดˆ๋Œ€ ๋ณด์ƒ์„ ๋ฐ›์„ ์ˆ˜ ์žˆ์Šต๋‹ˆ๋‹ค.

Fanfei Li
@fanfei__li
PhD student in ML at @MPI_IS with @wielandbr
๊ฐ€์ž… March 2025
73 ํŒ”๋กœ์ž‰ ์ค‘    467 ํŒฌ
What happens when an LLM never sees material beyond fifth grade? We trained a 5B LittleLearner model from scratch on LittleCurriculum, a corpus restricted to Kโ€“5 material, to make this question testable.๐Ÿงต ๐Ÿ’ฌ Chat with LittleLearner yourself:
๋” ๋ณด๊ธฐ