Thinking Machines(@thinkymachines):Efficient training of neural networks is difficult. Our second Connectionism post introduces Modular Manifolds, a theoretical step toward more stable and performant training by co-designing neural net optimizers with manifold constraints on weight matrices. https://t.co/PGG4zy3u23 We explore a fundamental understanding of the geometry of neural network optimization.

Thinking Machines

@thinkymachines

Thinking, beeping, and booping. @tinkerapi

加入 February 2025

1 正在關注 180.9K 粉絲

Thinking Machines@thinkymachines

2025.09.26 17:10

Efficient training of neural networks is difficult. Our second Connectionism post introduces Modular Manifolds, a theoretical step toward more stable and performant training by co-designing neural net optimizers with manifold constraints on weight matrices. We explore a fundamental understanding of the geometry of neural network optimization.