Introducing ERNIE-5.5-Flash-Base, the pre-trained base of ERNIE 5.5 Flash before any mid- or post-training. The post-trained ERNIE 5.5 Flash is coming soon.
• 280B total / 14B activated MoE
• 33.5T pre-training tokens
• 128K training context, 1M for fine-tuning and inference