Register and share your invite link to earn from video plays and referrals.

TheDavidTai
@TheDavidTai
Founder, hacker, stochastic tool. @microsoft escapee. Currently @eigenlabs. Checkout my github actions emulator:
718 Following    1.6K Followers
The tensions between Qwen team and management from last year are resurfacing. I worry about Qwen long term viability if alinaga keeps messing with them
🚨 WHAT THE FUCK IS ALIBABA DOING TO QWEN 🚨 A former Alibaba Cloud employee just revealed what sounds like an absolute shitshow behind the scenes. They have the GPUs, the talent and one of the best open weight model families in the world. And what do the geniuses upstairs do? Keep replacing executives, restructuring entire teams, pushing out random AI apps and worrying about token revenue before the fucking models are even ready. HOW IS THIS REAL 😭 I’ve been hyping Qwen 4 for TWO FUCKING WEEKS. It looks insanely promising, it’s supposed to be dirt cheap AND open weight. Literally everything I want from a model. I genuinely thought Alibaba was about to cook something huge. AND NOW I’M READING THIS SHIT??? These mfs have everything they need to win and somehow the people running the company might be their biggest fucking problem. QWEN 4 ISN’T EVEN OUT YET AND ALIBABA IS ALREADY SPEEDRUNNING THE MANAGEMENT DISASTER 💀 JUST LET THE FUCKING TEAM COOK.
Show more
That’s even worse than picking dumb random numbers. This implies no verification or anything.
eMudhra's incident report is out! A Python script truncated their CA private keys to one byte?!
ERNIE 5.5 Flash Preview just landed! 🔥 Built on a new architecture designed for efficient inference, the latest open-weight foundation model in the ERNIE family delivers stronger performance in coding, 3D modeling, knowledge work and content creation. It keeps decoding fast while posting competitive scores on Terminal-Bench, AutomationBench, and other benchmarks. Here's the rundown: - 280B total parameters, 14B active per token - 1M-token context window - Generation speed above 200 tokens/sec Model weights will be released by November 25.
Show more
0
155
1.5K
160
Forward to community
Poor Tibo lost his one trick and now Ant is rubbing it in.
We've given all Pro, Max, Ultra, and Team users one free full reset, across all models and limits. Use it anytime before December 10 at 2:00PM PT. We recently fixed a few small issues that used more limits than intended, and the Fable resets didn't do much for those of you who'd already hit your weekly limits for all models. While these issues didn't affect everyone, we want to make up for the trouble. You'll find it in Settings > Usage, or at
Show more
Kernel optimizations for me but not for thee.
Anthropic says its Claude Mythos model got Claude processing prompts on AMD's MI355X GPUs in about 3 days, with almost no human help. That job used to take dozens of engineers 6 to 12 months. Claude wrote or adapted almost all the specialized GPU code needed to make it work.
Show more
It feels like we're in next generation hardware and open weight waiting room. Can't wait for DSv5 Flash, GLM 5.5, and Qwen 4!
DeepSeek V4.1 Flash 1017 on one Mac Studio M5 Ultra 512 GB, official lossless weights: 65.7 tok/s output with a 128k-token prompt, mlx-serve 26.11.2 defaults. Median of 5 runs, range 62.2–70.0. Other engines and the method below.
Show more
DeepSeek V4.1 Flash 1017 on one Mac Studio M5 Ultra 512 GB, official lossless weights: 65.7 tok/s output with a 128k-token prompt, mlx-serve 26.11.2 defaults. Median of 5 runs, range 62.2–70.0. Other engines and the method below.
Show more
Sushi 🍣 next version will migrate DeepSeek STQ out of MLX to run with our fully custom core, only for M5+ as a start. This change reduces up to 60% CPU usage and reduce the heat. Laptop throttling is still there but not as aggressive as before.
Show more
130-140tps that I and other contributors were able to achieve with MLX-Server, Tensorfold and the rest of the ecosystem is where the CPU and Memory both start to choke. We've pretty much squeezed all the juice for Qwen Flash Q4 experts quants. Next model please, @Alibaba_Qwen!
Show more
Drafter speedups are not a 256 token demo trick. M5 Max, TensorFold, Qwen3.8 27B: 129 tok/s across 162K tokens of long output, against 24 tok/s with drafting off. 30 runs, 2.7K to 8.2K tokens each, three sampling settings. 5x holds when the answers get long.
Show more
Will Softbank finally not make it this time?
SoftBank defaults on power turbines and electrical equipment for Ohio data center, resulting in $3.7 billion loss on the orders. It’s believed remaining $6.5 billion in order was for $NVDA GPUs that they will attempt to procure to $ORCL on contract. No specific details given. SoftBank promises though it won’t reduce the size of the Ohio data center that never even made it to permit stage before default. OpenAi $CRWV $IREN bankrupt 2027
Show more
Extending acceptance length by 27% is quite the achievement. Congrats to the DSpine team. I wish there was a way to train Spec Decoders for specific use cases in the future.
DSpine: +27.8% acceptance length and +23.3% throughput over DFlash on Qwen3-8B, according to the paper. But the gain is much smaller with the released checkpoint. It was trained on Open-PerfectBlend, and DFlash2 and DSpark retrained on the same data are close behind: about 4% lower at temperature 0 and 5% lower at temperature 1. Still a real gain, for a round that costs about the same as DFlash2's. If you already serve Qwen3-8B or Qwen3.8-27B with SGLang, it's worth an A/B test. I would measure tokens/s on my own prompts rather than trust acceptance length on GSM8K...
Show more
Ginormous model is still too expensive to run
Moonshot's open-weight Kimi K3.1 Pro just pulled off a clean sweep on Artificial Analysis's enterprise capability rankings. Across Finance, Strategy, Legal, Healthcare, Engineering, and Economics, Kimi K3.1 Pro ranked #1# in every single category among open models beating Ling 3.1 Flash, DeepSeek V4.1 Flash 1017, GLM-5.3, and Meta's Muse Spark Open. Plus, SGLang merged PR #49472# today adding "breakable CUDA graphs" specifically for Kimi K3.1's hybrid linear attention, cutting prefill latency in half (-53%).
Show more
A new breakthrough in Local AI I trained a DSpine speculative decoder for GLM-5.3-Flash on 4x DGX Sparks over a mere 8 hours. About a 20% boost so far, I will keep training it and it'll be the best GLM spec decoder out there in a week
Show more
Fitting that we're going to soon have ot use open models to improve open models
Anthropic put GPU kernel optimization in the same Safeguards section as hacking and biology. WTF? It is in their launch post. During training they limited the skills that "could most directly accelerate AI development". "Accelerator kernel optimization." "Improving large language model architectures." There Fable 5.2 stays "at about the level of Opus 5.5". So making a model run faster on a cheap GPU is now a risk to be managed. You cannot see this one. There is no refusal and no warning. It was limited during training, before any user typed a word. Kernel work is how a used 3090 still runs new models. It is how open weights get to people who cannot pay $40 per 1M output tokens. What the hell? I genuinely wanted to say something nice, but now I can't. This completely broke me, I'm disappointed.
Show more
AMD admits GPU driver bug is writing data continuously, wearing out SSDs — Radeon owner claims External Events Utility used up 1% of SSD health every month for over a year, company promises a fix soon
Show more
0
26
642
142
Forward to community