Building a model that fits on a phone or laptop makes pre-training harder. With fewer parameters, quality has to come from better architecture and better data, not just more compute. Our pre-training team, including
@TadimetiAditya and
@Khoi_H_Nguyen, explains how they design LFMs with the target device in mind from day one.