It truly takes a village to release a model, perhaps especially an open weights model. Actually doing the entire process from scratch, from data to pretraining to posttraining to actual release, gives a lot of appreciation for anyone who does it!
There's so many places to go wrong, and indeed so many things we would (and will!) do differently for a new model. But I'm happy with where we ended up :)
Onto what's next!
Today, we are introducing Inkling.
Inkling reasons efficiently across text, image, and audio modalities. We are making the full weights available.
Available today for fine-tuning on Tinker. Play with it in the Inkling Playground. 🧵