Holy ๐ฉ. Tencent released a Local AI model dedicated to deciding what your AI agent should remember.
This might become my favorite memory companion local AI model to pair with Qwen3.8-27B
And community Q4 builds are already around ~17GB. ๐
Hy-Memory-30B-A3B is not meant to be a chatbot but rather a dedicated long-term memory writer.
It
๐ง reads new conversations / agent activity
๐ฏ decides what is actually worth remembering
๐ turns evidence into precise persistent memories
๐ updates memories when facts change
๐๏ธ avoids storing irrelevant information
๐พ maintains the persistent memory bank
Why?
Without persistent memory, your agent either:
๐ง forgets useful information when the session/context ends
๐ keeps stuffing old conversations back into context
A memory system gives your agent a compact long-term store that survives across sessions.
Hy-Memory is the model deciding what deserves to go into that store.
And today memory systems often use a general-purpose LLM for that job.
Tencent instead trained a sparse specialist specifically for it.
And Tencent reports it beats much larger frontier models at that specific task
๐ Hy-Memory-30B-A3B โ 55.49
Claude Opus 5 โ 54.62
DeepSeek V4.1 Flash โ 53.64
Qwen3.6-35B-A3B โ 50.37
EverMemOS ranked #
1# there at 56.89.
Specs
๐ง 30B total
โก ~3B active/token
๐ Apache 2.0
๐ open weights
โ๏ธ vLLM + SGLang
๐ OpenAI-compatible API
And community quants are already arriving:
Q4_K_M โ ~17GB
Q5_K_M โ ~20GB
Q6_K โ ~23GB
EXL3 4.08bpw โ ~15GB
That puts it roughly in the same memory class as a Qwen3.8-27B Q4.
Except Qwen3.8-27B is a dense general-purpose model.
Hy-Memory activates only ~3B parameters/token and was trained specifically for remembering.
๐ Link in ALT