Cameron R. Wolfe, Ph.D.
@cwolferesearch
Research @Netflix • Writer @ Deep (Learning) Focus • PhD @optimalab1
加入 August 2021
844 正在关注 42.5K 粉丝
Great visualization and a nicely-executed idea. Many tools are available for model specialization. A lot of work focuses on harnesses or finetuning separately, but why not use them together?
Bullish on efficient recipes for optimizing models in custom / task-specific harnesses!
显示更多
Harness optimization is sample-efficient but plateaus. What should you do if you can afford to update the model too?
Introducing WHALE: a simple recipe for jointly optimizing an LLM's weights and harness.
Blog:
Paper:
显示更多
