註冊並分享邀請連結,可獲得影片播放與邀請獎勵。

EverMind
@evermind
Long-term agent memory | self-improving | agent harness
加入 November 2025
21 正在關注    4.3K 粉絲
Another paper from us, this time on video token compression. Video VLMs have a token problem. A single video can produce tens of thousands of visual tokens, making prefill expensive and KV caches large. But aggressively pruning them risks deleting the details needed for temporal reasoning. CRAFT takes a different approach. It separates two decisions: Which tokens should merge? Global similarity decides. How should they merge? Position-aware weights and a channel-wise gate learn how to preserve the information. The process is recursive and query-agnostic, so the video can be compressed once and reused across multiple questions. At roughly 8× compression, CRAFT retains 96.8% of the backbone’s average accuracy while substantially reducing prefill and KV-cache costs. The takeaway: don’t just drop redundant tokens. Learn how to fuse them without losing the details.
顯示更多