This one was long overdue in the local AI community! A benchmarking platform for on-device intelligence that is 1) independently validated, 2) community driven evaluation components, and 3) taking into account all aspects of local intelligence that do not show up on the cloud!
It was a pleasure working with the amazing @ArtificialAnlys team on this project.
✨ enjoy
Show more
yesterday we made them more compressed! today we make them faster than ever with speculative decoding!
up to 4x decode speed up on device for our 1.2B, 2.6B and 8B moe.
You gotta try these LFMs for function calling applications on device or latency critical load on the cloud! work of art by our very own @tugot17
enjoy 🚢🚀
Show more
