Chelsea Finn
@chelseabfinn
Asst Prof of CS & EE @Stanford
Co-founder of Physical Intelligence @physical_int
PhD from @Berkeley_EECS, EECS BS from @MIT
参加 June 2014
397 フォロー中 102.5K ファン
Pretraining a Q-function often doesn’t actually help RL finetuning, compared to initializing Q from scratch.
We find that pretraining Q-functions on data from diverse policies is critical to see improvements from pretraining.
Paper:
もっと見る
Pretraining has worked remarkably well across domains
We show this doesn’t hold for Q-functions in online RL from a pretrained policy — and propose IPE, a more effective way to learn Q-functions for online RL fine-tuning
(1/6)
もっと見る
