注册并分享邀请链接,可获得视频播放与邀请奖励。

alphaXiv
@askalphaxiv
High fidelity research
加入 November 2023
106 正在关注    61K 粉丝
"HyperThink: Text-to-Parameter Hypernetworks for Efficient Reasoning" Instead of actually generating CoT, this paper uses a lightweight hypernetwork to predict small and question-specific updates to the LLM's bias parameters, approximating the effect of thinking without generating the trace. Trained on the base model's own reasoning outputs, it improves accuracy over non-thinking on several reasoning tasks while keeping latency close to non-thinking. On some QA benchmarks, it matches thinking-mode performance with only 7-9% of the latency.
显示更多