it's more like RL with expert init?
the hard thing is how to restrict the transition inside the constrained set C. this work uses a privileged prompted model to act as the transition.
but this might be over-restrictive and break the on-policy-ness.
顯示更多