Teknium 🪽
@Teknium
Cofounder and Lead Engineer - Hermes Agent @NousResearch, prev @StabilityAI
Github:
HuggingFace:
参加 February 2021
6.3K フォロー中 125K ファン
Just FYI. If you are switching models in a session all the time - you are doing it wrong.
Every time you switch, your entire prompt cache is invalidated on the new model you switch to, and you have to repay the full input tokens price for all of it.
Stop doing this unless those models are free.
This is not a hermes thing - this is a fundamentals of inference thing.
もっと見る
