๊ฐ€์ž… ํ›„ ์ดˆ๋Œ€ ๋งํฌ๋ฅผ ๊ณต์œ ํ•˜๋ฉด ๋™์˜์ƒ ์žฌ์ƒ ๋ฐ ์ดˆ๋Œ€ ๋ณด์ƒ์„ ๋ฐ›์„ ์ˆ˜ ์žˆ์Šต๋‹ˆ๋‹ค.

OpenBMB
@OpenBMB
OpenBMB (Open Lab for Big Model Base) aims to build foundation models and systems towards AGI. Connect with us:
๊ฐ€์ž… February 2022
340 ํŒ”๋กœ์ž‰ ์ค‘    8.5K ํŒฌ
๐Ÿš€ MASSIVE upgrades for UltraData data stack! The tiered data management (L0-L4) framework has now fully battle-tested on MiniCPM5-1B and is ready for your models! No gatekeeping, just pure data power. Whatโ€™s NEW in our latest release:๐Ÿ‘‡ โœ… Ultra-FineWeb-L3 โ€” 600B tokens (200B+ Chinese, 400B+ English) of high-density synthetic pre-training data, which expanded from Ultra-FineWeb via multi-style rewriting & QA generation, and has used in MiniCPM5-1B's decay stage. ๐Ÿค— โœ… UltraData-SFT-2605 โ€” 15M+ post-training samples across math, code, knowledge & instruction following, with deep-thinking and non-thinking training styles, used in MiniCPM5-1B's SFT stage. ๐Ÿค—
๋” ๋ณด๊ธฐ