Georgi Gerganov
@ggerganov
24th at the Electrica puzzle challenge | building | engineer @huggingface
加入 May 2015
294 正在關注 71.8K 粉絲
I find the "inception" pattern to be very useful in many agentic use cases. You can force the model to take an action when it thinks for too long by injecting a thought after a specified reasoning budget.
Helps dealing with underspecified tasks which make the model reason for way too long.
顯示更多
to limit the max reasoning length, add:
... \
--reasoning-budget 4096 \
--reasoning-budget-message "... I am thinking for too -- let me gather more info about the task."
adjust to your needs
