註冊並分享邀請連結,可獲得影片播放與邀請獎勵。

cv usk
@cv_usk
AI / Software Research Notes AI Agent, LLMOps, MLOps, Software Architecture 投稿は個人の意見です。
加入 May 2026
280 正在關注    416 粉絲
🔁 A way to train "think longer, get smarter" models without the gradients exploding. Title: Thinking with Looped Flows URL: Looped models that recurrently update hidden states to "think" have long struggled with unstable BPTT (backprop through time). Looped Flows fixes this by borrowing training principles from diffusion models. Here are 3 highlights. 🧠 Training recurrence without BPTT By training each step with a local loss at gradually decreasing noise levels, the model learns to keep "thinking" stably, without vanishing or exploding gradients. ⏱ More compute at inference, for free Just using a finer time grid at test time boosts accuracy, from 74.5% at 8 steps to 97.9% at 128 steps on Sudoku, with no retraining needed. 🏆 Beats prior looped models on ARC-AGI It reaches 58.8% on ARC-AGI-1 and 12.2% on ARC-AGI-2, outperforming previous looped-model approaches on both. A neat new take on test-time compute scaling: thinking longer at inference genuinely pays off. #LLMInference# #MachineLearning#
顯示更多