๊ฐ€์ž… ํ›„ ์ดˆ๋Œ€ ๋งํฌ๋ฅผ ๊ณต์œ ํ•˜๋ฉด ๋™์˜์ƒ ์žฌ์ƒ ๋ฐ ์ดˆ๋Œ€ ๋ณด์ƒ์„ ๋ฐ›์„ ์ˆ˜ ์žˆ์Šต๋‹ˆ๋‹ค.

David Hendrickson
@TeksEdge
CEO & Founder | PhD | Startup Advisor | @Columbia | Author Generative Software Engineering | ๐Ÿ”” Follow for AI & Vibe Coding Tips ๐Ÿ‘‡
๊ฐ€์ž… July 2023
552 ํŒ”๋กœ์ž‰ ์ค‘    12.5K ํŒฌ
A new open LLM can remember an old conversation without putting that conversation back into its context. And at 128K history, its authors claim the persistent memory is ~66ร— smaller than keeping the full KV cache. MemT-1.0 Nano dropped today. Stats ๐Ÿง  36B total / 3B active โš™๏ธ built from Qwen3.6-35B-A3B ๐Ÿ’พ 10M dynamic memory state ๐Ÿง  451M trainable memory parameters ๐Ÿ”“ MIT-licensed weights But it does things a little differently. Normally, a long-running LLM needs old conversation + new message. So as history grows, you keep dragging more context/KV around, or retrieving old text and stuffing it back into the prompt. MemT puts memory inside the model itself. Its memory blocks run alongside the normal LLM attention. As you interact with it, the model learns to: ๐Ÿ“ write information ๐Ÿ—‘๏ธ forget information ๐Ÿ”„ update information ๐Ÿง  read it back later So you can: ๐Ÿ’ฌ have a conversation ๐Ÿ’พ save its latent memory state ๐Ÿ—‘๏ธ discard the plaintext conversation ๐Ÿ”„ start a new session with zero previous messages ๐Ÿง  restore the memory โžก๏ธ and ask about what happened before Their demo does this. At 128K history, the authors report for MemT-Nano ๐Ÿ“ฆ persistent memory โ†’ ~66ร— smaller than full-context KV cache โšก end-to-end inference โ†’ ~1.86ร— faster And the memory state stays a fixed size as history grows. MemT isn't a little memory model sitting next to Qwen. It takes a normal generative LLM and makes persistent memory part of the LLM's computation itself. They also released MemT-Flash: ๐Ÿง  288B total / 17B active ๐Ÿ’พ 336M dynamic memory state ๐Ÿง  3.61B trainable memory parameters ๐ŸŽฏ This could be especially interesting for long-running local agents. โš ๏ธ The 66ร— / 1.86ร— results are author-reported, and strong text-retrieval systems still beat MemT on some tasks where exact historical details matter. I can't find consumer GGUF benchmarks yet. Link in ALT.
๋” ๋ณด๊ธฐ