Thinking Machines(@thinkymachines ):Efficient training of neural networks is difficult. Our second Connectionism post introduces Modular Manifolds, a theoretical step toward more stable and performant training by co-designing neural net optimizers with manifold constraints on weight matrices. https://t.co/PGG4zy3u23 We explore a fundamental understanding of the geometry of neural network optimization.

Thinking Machines

@thinkymachines

Thinking, beeping, and booping. @tinkerapi

Joined February 2025

1 Following 149.1K Followers

Thinking Machines@thinkymachines

2025.09.26 17:10

Efficient training of neural networks is difficult. Our second Connectionism post introduces Modular Manifolds, a theoretical step toward more stable and performant training by co-designing neural net optimizers with manifold constraints on weight matrices. We explore a fundamental understanding of the geometry of neural network optimization.