Teknium 🪽(@Teknium):Just FYI. If you are switching models in a session all the time - you are doing it wrong. Every time you switch, your entire prompt cache is invalidated on the new model you switch to, and you have to repay the full input tokens price for all of it. Stop doing this unless those models are free. This is not a hermes thing - this is a fundamentals of inference thing.

Teknium 🪽

@Teknium

Cofounder and Lead Engineer - Hermes Agent @NousResearch, prev @StabilityAI Github: HuggingFace:

加入 February 2021

6.3K 正在關注 125K 粉絲

Teknium 🪽@Teknium

2026.08.25 06:48

Just FYI. If you are switching models in a session all the time - you are doing it wrong. Every time you switch, your entire prompt cache is invalidated on the new model you switch to, and you have to repay the full input tokens price for all of it. Stop doing this unless those models are free. This is not a hermes thing - this is a fundamentals of inference thing.

330

4.9K

313

轉發到社區

熱門用戶