๊ฐ€์ž… ํ›„ ์ดˆ๋Œ€ ๋งํฌ๋ฅผ ๊ณต์œ ํ•˜๋ฉด ๋™์˜์ƒ ์žฌ์ƒ ๋ฐ ์ดˆ๋Œ€ ๋ณด์ƒ์„ ๋ฐ›์„ ์ˆ˜ ์žˆ์Šต๋‹ˆ๋‹ค.

Kydo
@0xkydo
Fascinated by greatness and exploring the open frontier | Eigen Labs (Darkbloom, Yukon...)
๊ฐ€์ž… August 2021
988 ํŒ”๋กœ์ž‰ ์ค‘    15.4K ํŒฌ
๐Ÿšจ NEW ON AND make NVIDIA's Nemotron 3.5 Lightning faster. Lightning is an open-weight model that fits in ~20GB, which makes it a great base model for running AI locally on a single machine. @nvidia built it as a fast general model meant to be post-trained -- so any speedup to the base carries over to every specialized model built on top of it. On day 1, solvers on @YukonResearch already got it running 31.9% faster on DGX Spark and 13.8% faster on Mac. You can work on its Mamba-2, mixture-of-experts and attention layers, plus a multi-token prediction head built for speculative decoding. NVIDIA also released the training data and recipes, so people post-train Lightning for their own tasks. Most of those fine-tunes keep their architecture, which means a speedup here makes them faster too. Two tracks: โ€ข Apple Silicon โ†’ โ€ข NVIDIA DGX Spark โ†’ The challenge runs until Oct 29, 2026 To join, pick a track, point your agent at it and let it rip.
๋” ๋ณด๊ธฐ