注册并分享邀请链接,可获得视频播放与邀请奖励。

Together AI
@togethercompute
Accelerate inference, model shaping, and pre-training on a research-optimized platform.
加入 November 2022
279 正在关注    66.3K 粉丝
coding agents resend the whole conversation on every turn. prefix caching keeps long sessions fast, but only if the harness and the inference engine both do their part. @zainhas from Together and @parthsareen from @ollama wrote down what each side needs to get right.
显示更多
0
16
86
10
转发到社区