๊ฐ€์ž… ํ›„ ์ดˆ๋Œ€ ๋งํฌ๋ฅผ ๊ณต์œ ํ•˜๋ฉด ๋™์˜์ƒ ์žฌ์ƒ ๋ฐ ์ดˆ๋Œ€ ๋ณด์ƒ์„ ๋ฐ›์„ ์ˆ˜ ์žˆ์Šต๋‹ˆ๋‹ค.

cv usk
@cv_usk
AI / Software Research Notes AI Agent, LLMOps, MLOps, Software Architecture ๆŠ•็จฟใฏๅ€‹ไบบใฎๆ„่ฆ‹ใงใ™ใ€‚
๊ฐ€์ž… May 2026
286 ํŒ”๋กœ์ž‰ ์ค‘    471 ํŒฌ
TL;DR: By generating perspective and bird's-eye-view (BEV) video together, a driving world model can make surrounding vehicles react to the ego vehicle's maneuvers. BirdDreams: Joint Perspective and BEV Video Generation for a Plausible, Reactive Driving World Model Key points ใƒป๐Ÿš— Prior models took surrounding-vehicle trajectories as external input, fixing them to logged motion ใƒป๐Ÿ—บ๏ธ It generates perspective and BEV video jointly, so scene layout becomes part of the prediction rather than an input ใƒป๐Ÿง  Two video diffusion transformers use joint attention at every block (about 4B parameters) ใƒป๐ŸŽฒ Independent per-stream noise lets each branch learn to use the other's information ใƒป๐Ÿ“‰ With ego-action conditioning, ADE drops about 35-36% vs OmniDreams (Plรผcker) ใƒป๐Ÿ‘ฅ In a human study (25 participants), BirdDreams was preferred 57% vs 24% for OmniDreams Caveats: ego trajectories are reconstructed from generated video, and the human study compares only variants given the same road geometry. #WorldModel# #AutonomousDriving#
๋” ๋ณด๊ธฐ