Zach Mueller
@TheZachMueller
Head of Dev Rel at neocloud darling @LambdaAPI. Ex-HF. Hardware nerd. Usually yelling at NCCL over things. Posts are my own.
Joined April 2016
957 Following 19.8K Followers
There’s a free 5% boost waiting for you on TP=4 if you tell your LLM to enable CustomAllReduce on SM120 to not be just TP=2
