Justin Mateen
@justinmateen
Founder of JAM Fund | Co-founder of Tinder | Seed investor in: Curative, Deel, Kalshi, Slash, Speak, Whop… and many others
가입 January 2013
192 팔로잉 중 10.4K 팬
Extraordinary breakthroughs require extraordinary proof.
Appen Research just released a 3rd party evaluation on Subquadratics claims from last week that shocked the world, and so far the receipts are looking good!
더 보기
@AppenResearch independently evaluated @subquadratic's SSA kernel - a learned sparse attention mechanism designed to reduce the quadratic scaling limitations of full attention.
Results at 1M-token context lengths:
- 56.2× wall clock speedup vs. FA2
- 62.8× FLOP reduction (validated via torch.profiler, <4% variance from theoretical)
- 95.6% average score across RULER tasks at 128K
- 86.2% average score on the hardest MRCR 8-needle bucket (512K–1M contexts)
- 81.8% SWE-Bench Verified resolved rate
Full report:
더 보기
