Thanks @srush_nlp ! Really fun to reread the Named Tensor posts in light of TorchLean! A lot of the questions there around tensor semantics, private dimensions, lifting PyTorch modules, and checked pre/postconditions are exactly the kind of things we’d love to push much further.
TorchLean has also grown quite a bit recently; I’ll write up the new features + some of these directions soon!
Show more
Lean Verified Transformers (
In which we prove a bunch of Transformer invariants from scratch in Lean, and speculate about how hard it would be to do that for the rest of the world's code.
Show more
