A new open LLM can remember an old conversation without putting that conversation back into its context.
And at 128K history, its authors claim the persistent memory is ~66ร smaller than keeping the full KV cache.
MemT-1.0 Nano dropped today.
Stats
๐ง 36B total / 3B active
โ๏ธ built from Qwen3.6-35B-A3B
๐พ 10M dynamic memory state
๐ง 451M trainable memory parameters
๐ MIT-licensed weights
But it does things a little differently.
Normally, a long-running LLM needs old conversation + new message.
So as history grows, you keep dragging more context/KV around, or retrieving old text and stuffing it back into the prompt.
MemT puts memory inside the model itself.
Its memory blocks run alongside the normal LLM attention.
As you interact with it, the model learns to:
๐ write information
๐๏ธ forget information
๐ update information
๐ง read it back later
So you can:
๐ฌ have a conversation
๐พ save its latent memory state
๐๏ธ discard the plaintext conversation
๐ start a new session with zero previous messages
๐ง restore the memory
โก๏ธ and ask about what happened before
Their demo does this.
At 128K history, the authors report for MemT-Nano
๐ฆ persistent memory โ ~66ร smaller than full-context KV cache
โก end-to-end inference โ ~1.86ร faster
And the memory state stays a fixed size as history grows.
MemT isn't a little memory model sitting next to Qwen.
It takes a normal generative LLM and makes persistent memory part of the LLM's computation itself.
They also released MemT-Flash:
๐ง 288B total / 17B active
๐พ 336M dynamic memory state
๐ง 3.61B trainable memory parameters
๐ฏ This could be especially interesting for long-running local agents.
โ ๏ธ The 66ร / 1.86ร results are author-reported, and strong text-retrieval systems still beat MemT on some tasks where exact historical details matter.
I can't find consumer GGUF benchmarks yet.
Link in ALT.