๊ฐ€์ž… ํ›„ ์ดˆ๋Œ€ ๋งํฌ๋ฅผ ๊ณต์œ ํ•˜๋ฉด ๋™์˜์ƒ ์žฌ์ƒ ๋ฐ ์ดˆ๋Œ€ ๋ณด์ƒ์„ ๋ฐ›์„ ์ˆ˜ ์žˆ์Šต๋‹ˆ๋‹ค.

David Hendrickson
@TeksEdge
CEO & Founder | PhD | Startup Advisor | @Columbia | Author Generative Software Engineering | ๐Ÿ”” Follow for AI & Vibe Coding Tips ๐Ÿ‘‡
๊ฐ€์ž… July 2023
552 ํŒ”๋กœ์ž‰ ์ค‘    12.5K ํŒฌ
Tencent has released its own official GGUFs of Hy-Memory-30B-A3B. And they didn't just throw up some quants. They benchmarked them too ๐Ÿ’พ Q4_K_M โ†’ 18.24GB โ†’ 56.49% ๐Ÿ’พ Q6_K โ†’ 24.71GB โ†’ 58.78% ๐Ÿ’พ Q8_0 โ†’ 31.99GB โ†’ 57.63% All tested with llama.cpp on the same LoCoMo memory benchmark setup. ๐Ÿ‘‰ Q6 actually scored highest. And the Q4 means this specialized long-term memory writer is now officially an ~18GB local model. Tencent even documents running it directly with llama.cpp: llama serve -hf tencent/Hy-Memory-30B-A3B-GGUF This is the sort of Local AI architecture I want to experiment with. Link in ALT
๋” ๋ณด๊ธฐ
Holy ๐Ÿ’ฉ. Tencent released a Local AI model dedicated to deciding what your AI agent should remember. This might become my favorite memory companion local AI model to pair with Qwen3.8-27B And community Q4 builds are already around ~17GB. ๐Ÿ‘€ Hy-Memory-30B-A3B is not meant to be a chatbot but rather a dedicated long-term memory writer. It ๐Ÿง  reads new conversations / agent activity ๐ŸŽฏ decides what is actually worth remembering ๐Ÿ“ turns evidence into precise persistent memories ๐Ÿ”„ updates memories when facts change ๐Ÿ—‘๏ธ avoids storing irrelevant information ๐Ÿ’พ maintains the persistent memory bank Why? Without persistent memory, your agent either: ๐Ÿง  forgets useful information when the session/context ends ๐Ÿ“š keeps stuffing old conversations back into context A memory system gives your agent a compact long-term store that survives across sessions. Hy-Memory is the model deciding what deserves to go into that store. And today memory systems often use a general-purpose LLM for that job. Tencent instead trained a sparse specialist specifically for it. And Tencent reports it beats much larger frontier models at that specific task ๐Ÿ† Hy-Memory-30B-A3B โ†’ 55.49 Claude Opus 5 โ†’ 54.62 DeepSeek V4.1 Flash โ†’ 53.64 Qwen3.6-35B-A3B โ†’ 50.37 EverMemOS ranked #1# there at 56.89. Specs ๐Ÿง  30B total โšก ~3B active/token ๐Ÿ”“ Apache 2.0 ๐Ÿ  open weights โš™๏ธ vLLM + SGLang ๐Ÿ”Œ OpenAI-compatible API And community quants are already arriving: Q4_K_M โ†’ ~17GB Q5_K_M โ†’ ~20GB Q6_K โ†’ ~23GB EXL3 4.08bpw โ†’ ~15GB That puts it roughly in the same memory class as a Qwen3.8-27B Q4. Except Qwen3.8-27B is a dense general-purpose model. Hy-Memory activates only ~3B parameters/token and was trained specifically for remembering. ๐Ÿ”— Link in ALT
๋” ๋ณด๊ธฐ