Eric Zhang(@ekzhang1):for the record, I really like DeepSeek’s benchmarking approach, it controls for all the free variables and is probably the most compelling recent roofline curve to me. every engine should be benchmarking this way, and kv caches/pd separately see: https://t.co/ZWuTjNsYj6

Eric Zhang

@ekzhang1

Computer systems person, interaction designer. @thinkymachines prev founding eng @modal → dreams of: a simpler, more honest, more human sort of software

参加 June 2021

672 フォロー中 23.8K ファン

Eric Zhang@ekzhang1

2026.10.21 20:17

for the record, I really like DeepSeek’s benchmarking approach, it controls for all the free variables and is probably the most compelling recent roofline curve to me. every engine should be benchmarking this way, and kv caches/pd separately see: