Register and share your invite link to earn from video plays and referrals.

Harrison Kinsley
@Sentdex
gpus and tractors. Neural networks from Scratch book:
396 Following    112.1K Followers
Whoa. Allegedly fixes task execution time. Lets see
🚀 DeepSeek-V4.1-Flash-1017 is here! Stronger benchmark performance, faster task completion, and shorter outputs than the previous version—a Pareto improvement in performance and cost. Now live on our website, app, and API. 🛠️ Optimized for @DeepSeekHarness, Tencent CodeBuddy, WorkBuddy, and more. Upgrade to DeepSeek Harness v0.2.1-rc.1 or later for the best experience with the new model. 1/4
Show more
I wonder if we'll get to a point where being distilled becomes profitable to the labs. If they spend X to create a model. And more than 20 companies pay 1/20th of that to distill it. They're in the money. It's a new form of infra where downstream handles distribution.
Show more
Trying to train a fall recovery policy for the @asimovinc humanoid Getting up is hard!
Nemotron 3.5 Super VL (120B A12B) is now the leading US open source model. Congrats to the NVIDIA AI team! I am still doing testing of this model, but I think the ranking would be even stronger if we were just measuring agentic coding performance. This one may very well be a solid choice for a speedy local coding agent model I'm running many things in parallel, will get proper average and max numbers in time, but just randomly prodding this model for some quick speed checks and over 550 tok/sec. All vanilla settings. Once optimized 600+, maybe even 650+, will be trivial, and so far it does appear to be a token efficient problem solver. Really exciting to see what looks like a solid release so far from nvidia!
Show more
Nemotron 3.5 Super VL is the highest-scoring open weights model from the US, at 26 on the Intelligence Index. It edges out Thinking Machines' Inkling Small (26) and passes NVIDIA's previous flagship, Nemotron 3 Ultra (23), and Meta's Muse Glimmer (17) Despite the advance, the US still trails the United Arab Emirates (K2 Horizon 375B A23B, 31) and China (MiMo-V2.6-Pro, 46) on open weights intelligence.
Show more
The # of times lately I happen to ask someone in private where they work now and it turns out they are working at OpenAI is shocking. It's strangely a company where you hear about the departures but people aren't super open about joining.
Show more
okay seriously, why the hell are so many people leaving openai? now their computing chief is heading out too. i’m actually starting to get concerned about what’s happening at openai.
Show more
The GB300 is what's in the DGX Station, which you can power off a standard US home outlet. It's kinda bananas ngl. GB300 perf in our pockets, when?
We’ve added DeepSeek V4.1 Flash to AA-AgentPerf, with results for NVIDIA and AMD hardware. At 100 tokens/s per user, NVIDIA GB300 is in first place with throughput up to 261M tokens/s per MW. AA-AgentPerf is our agentic inference performance benchmark. It replays real agentic coding sessions, including prompt caching and tool-call delays, to give a realistic measure of inference performance in day-to-day agentic workloads. We measure total system throughput per megawatt of runtime power, and per-agent output speed at varying concurrency levels, to show the trade-off between system utilization and individual user experience. DeepSeek V4.1 Flash joins the leaderboard today. It brings the leaderboard to four featured models, joining DeepSeek V4 Pro 0813, Kimi K3, and GLM-5.2/5.3. We are evolving the featured models as popular new open-weights models release, and will feature day-0 results for major future releases. Background on DeepSeek v4.1 Flash: ➤ It scores 39 on the Artificial Analysis Intelligence Index, ahead of DeepSeek’s earlier V4 Pro 0813 at 36, with about a third of the parameters (552B ‘backbone’ and 16B active, against 1.6T and 49B) ➤ It is built on a new architecture, with a causal encoder-decoder design that activates 8B parameters per input token and 16B per output token. It uses a further 196B parameters of Engram n-gram memory that can sit in host memory rather than on the accelerator, and compressed sparse attention that needs about a quarter of even the earlier V4 Flash model’s KV cache per token ➤ This makes it much more efficient to serve, since the weights fit on fewer GPUs and the smaller KV cache leaves room for more concurrent agents per GPU Initial AA-AgentPerf results for DeepSeek V4.1 Flash: ➤ V4.1 Flash runs on as few as 2 GPUs, so rack-scale systems get less advantage over 8-GPU single nodes like B300, which stays within about 20% of rack-scale GB300 NVL72 across the curve, and leads at both ends ➤ At 100 tok/s per user, GB300 leads with ~261M tokens/s per MW, ahead of B300 (~220M), B200 (~193M), GB200 (~178M) and MI355X (~128M) ➤ Every Blackwell system and MI355X can reach around 600 to 670 tok/s output speed for a single agent (ie. at batch size of one), against 372 to 392 tok/s on H100 and H200 ➤ V4.1 Flash is both more intelligent than V4 Pro 0813 and much cheaper to serve, yielding ~1.3x (GB300) to ~6.2x (B200) the throughput per MW at 100 tok/s per user compared to its larger cousin
Show more
We're open-sourcing Menlo SDK so you can build your own applications for a humanoid robot. The SDK connects your code to Asimov 1, letting you control its movements and read its state. With the full source available, you can build on the existing foundation and adapt it to what your project needs. You can use it to replay a motion, control the robot through a VR headset, or run your trained policy on real hardware. We're also open-sourcing Asimov Edge, the software that runs on the robot, checks incoming commands, and manages control between your application, a gamepad and other controllers. - SDK: - Docs: - Order yours: Keep going.
Show more
reminds me of when i kept my server rack in the kitchen
0
124
3.2K
190
Forward to community
Excited to announce that Moondream is joining Prime Intellect to accelerate inference and continue building the next generation of efficient multimodal models!
0
163
1.3K
57
Forward to community
Every example of local models going truly fast with high quality on rtx pro 6ks, spark/gb10s, or dgx stations either comes directly from this group or it's someone copying from this group. I've learned a lot, and spent way too much money on hardware, because of these people.
Show more
Ready to supercharge your local AI hardware? 👀 Build an optimized docker for your @NVIDIAAI RTX 6000 Pro or DGX Spark at
wait, there's a config for $20K that runs GLM 5.3 at 70 t/s? send details!
Why do people buy $20k local machines just to run GLM 5.3 at 70 TPS? Bro I just used a random provider on openrouter ran it the entire night and paid $10.
have you even said "thank you" once to claude???
Exclusive: Anthropic is updating its usage policy for the first time in over a year. The new rules prohibit sustained "abusive or cruel behavior" towards Claude & add new restrictions about propaganda campaigns, surveillance & weapon development.
Show more
ive never need a fleet of robots as much as I need at least 10 of these omg
France might still be losing to China. But USA is losing to France.
Mistral has released Mistral Large 4, scoring 38 on the Artificial Analysis Intelligence Index; France is back to having the most intelligent model from outside the US and China @MistralAI has released Mistral Large 4 in Research Public Preview, with plans to release the weights of the 1T parameter (49B active) model at the end of October. It achieves 38 on the Artificial Analysis Intelligence Index, comparable to GPT-6 Luna (max, 38) and DeepSeek V4.1 Flash (max, 39). It also achieves 50% on the Artificial Analysis Cyber Index, level with GLM-5.3-Flash and ahead of models such as Kimi K3 and DeepSeek V4.1 Flash (max). Key benchmarking results for Mistral Large 4 Preview: ➤ Most intelligent model from outside the US and China: Mistral Large 4 Preview scores 38 on the Intelligence Index, comparable to DeepSeek V4.1 Flash (max, 39) and GPT-6 Luna (max, 38). This makes it the most intelligent model from outside the US and China, ahead of countries such as South Korea and the United Arab Emirates ➤ Level with GLM-5.3-Flash on cyber defense capability: Mistral Large 4 Preview scores 50 on the Artificial Analysis Cyber Index, level with GLM-5.3-Flash (50) and behind MiMo-V2.6-Pro (56). Once its weights are released, it will rank among the top three open weights models on the Cyber Index. Its strongest result is on CyberGym-E2E-AA, where it scores 82%, ahead of MiMo-V2.6-Pro (79%) and GPT-6 Luna (max, 78%) ➤ Over 4x the Cost per Task of similar-intelligence open weights models: Mistral Large 4 Preview costs $1.13 per Intelligence Index task with standard pricing of $1.36/$4.18 per 1M input/output tokens, with $0.14 per 1M cached input tokens. For the first two weeks, Mistral Large 4 Preview will be served at a 50% launch discount, bringing its Cost per Task down to $0.57. This is still more costly than GLM-5.3-Flash ($0.25) and DeepSeek V4.1 Flash (max, $0.27) ➤ Strong document and image reasoning: Mistral Large 4 Preview scores 19% on GDP.pdf, on par with MiMo-V2.6-Pro (19%) and behind Kimi K3 (22%). This is an 18-point improvement from Mistral Large 3, partly driven by improvements in their API, which now accepts 100 images per request, up from 8 for previous Mistral models Key model details: ➤ Context Window: 512k tokens ➤ Multimodality: Text and image input, with text output ➤ Pricing: $1.36/$4.18 per 1M input/output tokens ($0.14 per 1M cached input tokens), with 50% off for the first two weeks ($0.68/$2.09) ➤ Availability: Research Public Preview on Mistral's API, with open weights planned for the end of October
Show more
That's ~ 63K tok/sec prefill and obviously 450 tok/sec decode is also lovely
So far, easily the coolest thing with the DGX station is adding a single RTX Pro 6K gives you a 60,000 tok/sec prefill with DeepSeek V4.1 Flash. That TTFT speed is intoxicating! Using recipe found here:
Show more
i heard you liked vram so i added more vram to your vram:
I cannot escape the connection of the Reflection 70B fiasco with Reflection the company. Every time I see this name I get irked a little bit. Maybe it's just me but I wonder how many people remember the totally unrelated Reflection 70B model and associate those feelings consciously or subconsciously and it hurts this co's rep. How much of that negativity exists in LLMs too I wonder?
Show more