KVCache.AI
@KVCache_AI
Hi, this is official account. We build systems for efficient LLM serving, including KTransformers, Mooncake and AgentENV.
加入 August 2018
109 正在关注 1.1K 粉丝
Proud to see Mooncake featured among the supporters of @SemiAnalysis_ InferenceX initiative.
Reliable, transparent benchmarking is critical as inference systems become increasingly disaggregated and complex. We’re excited to contribute to this ecosystem and help push the frontier of efficient, scalable AI inference.
More details:
#InferenceX# #AIInference# #Mooncake#
显示更多
