註冊並分享邀請連結,可獲得影片播放與邀請獎勵。

cv usk
@cv_usk
AI / Software Research Notes AI Agent, LLMOps, MLOps, Software Architecture 投稿は個人の意見です。
加入 May 2026
282 正在關注    431 粉絲
🎨 A new unified visual AI where "seeing" and "creating" get trained to reinforce each other in one shared model. Title: SenseNova-U1.5: Towards Native Unified Visual Intelligence URL: 🧩 Overview OpenSenseNova's 8B Mixture-of-Transformers model drops external vision encoders and VAEs entirely, processing raw pixels directly while handling image understanding, reasoning, generation, and editing in one model. ⚙️ Problem it solves Most unified models route understanding and generation through separate latent spaces, causing consistency loss. This work aims to truly unify them on one shared representation. 🛠 Methodology Visual tokens are projected onto a 2D feature field and reconstructed with a spatial decoder that exchanges info across neighboring 32×32 regions. Four specialized experts (aesthetics, OCR, editing, infographics) are trained separately with RL, then merged into one model via On-Policy Distillation. 📊 Results GenEval overall hits 0.92, ImgEdit reaches 4.59 (up from 3.90 in U1), and BizGenEval jumps from 51.4% to 72.2% — outperforming its predecessor and competitors across understanding, generation, and editing alike. #UnifiedMultimodalAI# #ImageGeneration#
顯示更多