登録して招待リンクを共有すると、動画再生報酬と紹介報酬を獲得できます。

Dongxi 东锡 NLP
@dongxi_nlp
Prev. PhD @Stockholm_Uni | Alumni @KTHuniversity @uppsalauni Sharing insights on AI
参加 January 2022
1K フォロー中    42.7K ファン
Nemotron-Labs-TwoTower: Diffusion Language Modeling with Pretrained Autoregressive Context
We took a 30B model and split it in two to write tokens in parallel instead of one at a time. Introducing Nemotron-Labs-TwoTower: a diffusion language model from NVIDIA Research adapted from Nemotron-3-Nano-30B-A3B. Here’s how it works: one half holds the context, the other writes the tokens, with both reusing the pretrained model instead of training a new one from scratch. We found it kept 98.7% of the original model’s quality at 2.42× faster generation.
もっと見る