注册并分享邀请链接,可获得视频播放与邀请奖励。

cv usk
@cv_usk
AI / Software Research Notes AI Agent, LLMOps, MLOps, Software Architecture 投稿は個人の意見です。
加入 May 2026
280 正在关注    417 粉丝
🔁 A way to train "think longer, get smarter" models without the gradients exploding. Title: Thinking with Looped Flows URL: Looped models that recurrently update hidden states to "think" have long struggled with unstable BPTT (backprop through time). Looped Flows fixes this by borrowing training principles from diffusion models. Here are 3 highlights. 🧠 Training recurrence without BPTT By training each step with a local loss at gradually decreasing noise levels, the model learns to keep "thinking" stably, without vanishing or exploding gradients. ⏱ More compute at inference, for free Just using a finer time grid at test time boosts accuracy, from 74.5% at 8 steps to 97.9% at 128 steps on Sudoku, with no retraining needed. 🏆 Beats prior looped models on ARC-AGI It reaches 58.8% on ARC-AGI-1 and 12.2% on ARC-AGI-2, outperforming previous looped-model approaches on both. A neat new take on test-time compute scaling: thinking longer at inference genuinely pays off. #LLMInference# #MachineLearning#
显示更多