A world model you steer with text and camera controls, with a design that even runs on a single RTX 4090 🎮
Hy-Nomas: Towards Free-form Interactive World Generation
An 8B autoregressive video world model from a Tencent team. One model handles free-form text, continuous camera control, and multi-turn memory.
Three highlights:
🧠 Action-aware causal attention
Each segment's text is split into a description that later segments can see and actions confined to their own time window. The aim is to curb action-order errors and repeated actions across segments.
⚡ 4-step distillation and light inference
Sampling drops from 100 to 4 function evaluations, combined with INT8 and sparse attention. A 100-second video (1280x704, 24 FPS) is generated at a peak of 20.53 GiB on an RTX 4090.
📊 Strong lead on text control
In human evaluation of prompt following, it wins 75.0% and loses 8.3% against LingBot-World v2. Spatial memory, however, still trails Genie 3.
A good read for both the design and evaluation of interactive world generation.
#
WorldModels# #
VideoGeneration#