Horace He
@cHHillee
Joined February 2010
633 Following 55.4K Followers
Feels like it's been some time since I've learned something new about non-determinism on GPUs đ Pretty cool!
1/4
New writeup: you can fingerprint the exact GPU you're running on with a default torch.index_add_ call, even among identical GPUs.
This works because floating-point maths depends on order, and every GPU has its own. This fingerprint survives reboots and can't be faked.
Show more
