Here’s a piece by
@goodfellow_ian,
@sunfanyun, and me arguing that use of symbolic representations and game virtual world data offers the best path to building action-conditioned multimodal world models that enable reliable prediction and planning for long-horizon tasks.
The advantages of symbolic language representations in this context was also recently argued for in new work from
@physical_int: .