Sumanth Hegde
@sumanthrh
Post-training @anyscalecompute. Prev - @UCSanDiego, @C3_AI, @iitmadras. Machine Learning and Systems. Intensity is all you need.
加入 February 2016
26 正在關注 1.2K 粉絲
There were two key problems to solve for sharded weight transfer:
1. How do you compute the shard to send to a vLLM worker on the trainer?
2. How do you scale to large models without blowing up memory and keeping transfer times low?
顯示更多
