註冊並分享邀請連結,可獲得影片播放與邀請獎勵。

sarah guo
@saranormous
startup investor/helper, founder @conviction. interested in intelligence, accelerating progress. tech podcast: @nopriorspod
加入 July 2011
3.4K 正在關注    167.2K 粉絲
cracked humans& team continuing to share their cool ideas
Large-scale RL has a problem: weight updates from trainers to samplers are slow and expensive We’re sharing weight teleportation: faster weight updates than existing intra-cluster techniques with internet speeds, enabling samplers anywhere (maybe even space!) Weight teleportation is so efficient (<0.23s sampler pause time, ~3s non-blocking compression + prepare), the bottleneck ends up being the GPU hardware’s decompression ASIC We unlock these gains by using GPUs for massively parallel compression of model weight changes, engineering a heterogeneous decompression and patching pipeline, along with other optimizations and overlaps. These techniques are co-designed with hardware-native features in NVIDIA’s Blackwell generation of chips We’ve open-sourced weight teleportation, so everyone can use it today
顯示更多
0
9
135
7
轉發到社區