Juncheng Yang(@1a1a11a):Announcing one year of LLM inference metadata traces, with 6.12 billion requests. We hope this dataset can support research on real-world LLM serving workload understanding, system design and infrastructure optimization. Explore the dataset and learn more: https://t.co/5nFSp2PPaa Driven by our great graduate student William Nixon and in collab with @jon_durbin @airesearch12 @chutes

Juncheng Yang

@1a1a11a

Assistant Professor at Harvard University, Ph.D @ CMU, ex-Snowflake, ex-AWS, ex-Twitter, ex-Cloudflare

加入 September 2014

2.1K 正在關注 2.9K 粉絲

Juncheng Yang@1a1a11a

2026.09.20 00:34

Announcing one year of LLM inference metadata traces, with 6.12 billion requests. We hope this dataset can support research on real-world LLM serving workload understanding, system design and infrastructure optimization. Explore the dataset and learn more: Driven by our great graduate student William Nixon and in collab with @jon_durbin @airesearch12 @chutes_ai

1.2K

140

轉發到社區

熱門用戶