Teknium 🪽
@Teknium
Cofounder and Lead Engineer - Hermes Agent @NousResearch, prev @StabilityAI
Github:
HuggingFace:
Joined February 2021
6.3K Following 125K Followers
Just FYI. If you are switching models in a session all the time - you are doing it wrong.
Every time you switch, your entire prompt cache is invalidated on the new model you switch to, and you have to repay the full input tokens price for all of it.
Stop doing this unless those models are free.
This is not a hermes thing - this is a fundamentals of inference thing.
Show more
