Georgi Gerganov
@ggerganov
24th at the Electrica puzzle challenge | building | engineer @huggingface
参加 May 2015
294 フォロー中 71.8K ファン
I find the "inception" pattern to be very useful in many agentic use cases. You can force the model to take an action when it thinks for too long by injecting a thought after a specified reasoning budget.
Helps dealing with underspecified tasks which make the model reason for way too long.
もっと見る
to limit the max reasoning length, add:
... \
--reasoning-budget 4096 \
--reasoning-budget-message "... I am thinking for too -- let me gather more info about the task."
adjust to your needs
