A lot of the work behind DeliveryGym is systems side: making long-horizon agentic online RL practical in UE5 while balancing photorealistic rendering with rollout throughput.
We use SPEAR for the Python interface to Unreal, alongside our distributed rollout infra: parallel simulator workers, asynchronous coordination across environment execution, inference, and policy training.
Thanks
@mikeroberts3000 and the SPEAR team for building and sharing these tools!