kinda funny you can draw a smiley face in your neural net before training and it’ll be there afterwards
you can also use photos. i trained a MNIST classifier initialized to my face and you can still see me at the end
works across inits, weight decay, LR, optimizers, see below