登録して招待リンクを共有すると、動画再生報酬と紹介報酬を獲得できます。

Alex Dimakis
@AlexGDimakis
Professor, UC berkeley | Founder @bespokelabsai |
参加 April 2009
2.8K フォロー中    25.1K ファン
In medieval times, technical knowledge was kept hidden : guilds guarded recipes, processes, and tools and alchemists often wrote in deliberately obscure language. Knowledge was kept secret because it gives economic, professional, or political advantage. Enlightenment and the scientific revolution changed this: methods and results were published so knowledge could be tested, reproduced, and built upon. Open science is safer, scalable and enables completion and economic growth by reducing monopolies. Marin is doing this for AI with the most open effort going on right now: Open data, open experiments , open discussions - an enormous learning opportunity for the world to go from a dark fragmented art to open science.
もっと見る
🚢 Marin 535B-A23B started training this week! As usual, the whole process is open. Voyage plan: pretraining (80%) + midtraining (20%) on 18.75T tokens on 11 x GB200 NVL72 for ~3 months (2.7e24 FLOPs). Post-training will follow. Before kicking off the run, we trained a 4-rung scaling ladder from 1.6B-A61M (48B tokens) to 27.7B-A1.2B (926B tokens) to debug issues, and to make a forecast of our hero run. This is by far our biggest run, so definitely expecting the unexpected.
もっと見る