Juncheng Yang
@1a1a11a
Assistant Professor at Harvard University, Ph.D @ CMU, ex-Snowflake, ex-AWS, ex-Twitter, ex-Cloudflare
2.1K Following 2.9K Followers
Announcing one year of LLM inference metadata traces, with 6.12 billion requests.
We hope this dataset can support research on real-world LLM serving workload understanding, system design and infrastructure optimization. Explore the dataset and learn more:
Driven by our great graduate student William Nixon and
in collab with @jon_durbin @airesearch12 @chutes_ai
Show more
Unpopular opinion—we should not publish system design papers any more (given that most papers have "untold story", instead, we should focus on (1) the problem (2) why the solution from AI does not work. How many disagree?
Show more
