가입 후 초대 링크를 공유하면 동영상 재생 및 초대 보상을 받을 수 있습니다.

alphaXiv
@askalphaxiv
High fidelity research
가입 November 2023
101 팔로잉 중    56.9K 팬
“Discrete Beckmann Transport Models for One-Step Language Modeling and Reasoning” Few-step diffusion and flow LMs usually require distilling a pretrained teacher, which adds training cost and caps the student at teacher quality. So this paper learns a direct path from noise to discrete tokens, generating the whole sequence in one step without a teacher model or tracking diffusion time. Then when you add extra steps, the model doesn’t just take smaller steps toward an answer. It revisits uncertain tokens and fixes them using the tokens it’s already confident about.
더 보기