Triaging security vulnerabilities with Opus 5.5 is a bliss. Thanks, Anthropic, I'm making everyone using Node.js safer.
(Now, if we only had fewer vulnerabilities).
Trial continues for 88-year-old accused of 11 offences relating to alleged raptor persecution in Lincolnshire.
NB: Comments turned off as criminal proceedings are still live ⚖️
"Triadic Linear Attention: Three-Dimensional Recurrent States for Long-Context Sequence Modeling"
Linear attention is fast, but its fixed-size state limits memory.
This paper expands that matrix into a 3D tensor using two keys, giving an 8x larger recurrent state with only ~1.2% more parameters.
At 1.3B scale, it improves long-context recall and reaches 5.1x Transformer speed at 64k context.