๊ฐ€์ž… ํ›„ ์ดˆ๋Œ€ ๋งํฌ๋ฅผ ๊ณต์œ ํ•˜๋ฉด ๋™์˜์ƒ ์žฌ์ƒ ๋ฐ ์ดˆ๋Œ€ ๋ณด์ƒ์„ ๋ฐ›์„ ์ˆ˜ ์žˆ์Šต๋‹ˆ๋‹ค.

Lewis Tunstall
@_lewtun
๐Ÿค  post-training @huggingface
๊ฐ€์ž… August 2018
549 ํŒ”๋กœ์ž‰ ์ค‘    20.4K ํŒฌ
If you're using GRPO in TRL, you should really switch to the new async trainer. In our benchmarks, it's ~2-4x faster ๐Ÿ”ฅ