Register and share your invite link to earn from video plays and referrals.

Horace He
@cHHillee
@thinkymachines Formerly @PyTorch "My learning style is Horace twitter threads" - @typedfemale
633 Following    55.4K Followers
Inkling 2 Small pushes the cost-performance pareto frontier for OSS models on DeepFinance bench On long horizon finance workflows, Inkling 2 Small scores higher than GLM 5.3 for 50% of the cost, and nearly the same score as Qwen 3.8 max for 11% of the cost
Show more
Inkling 2 Small can paint 👩‍🎨!! (Video + Audio made in code) Comparison below between GLM 5.3 Flash, DeepSeek V4.1 Flash and Qwen 3.8 Flash on the same prompts. ⬇️
Inkling 2 is a great model especially for multimodal tasks! just tested it on internal benchmarks for image generation & editing judging, and it's better than kimi and muse. looking forward to fine-tuning Inkling on Tinker.
Show more
Our infra has really improved quite a bit since the last time we released a model - this one took just under 3 days to pretrain! Also, it's quite cheap on Tinker (0.30/1.00/1.50 for in/out/train)! Hope you guys find this model great for customization purposes :)
Show more
Introducing Inkling 2 Small. Scoring 31 on the AA Intelligence Index, it's a big jump over its predecessor. Inkling 2 Small is available for fine-tuning and inference on Tinker today, with full weight release planned soon.
Show more
As one of our earliest customers, it's been super exciting to support Trajectory with Tinker. In some sense they've been an ideal Tinker customer - they were influenced by Connectionism's original Lora blogpost, they've tried all sorts of wacky posttraining stuff that have informed our roadmap (as well as ... boring stuff that have informed our roadmap 😅), and they've converted it into real value for their users!
Show more
Imagine if everyone had the tools to shape intelligence itself. That day is today. Today we launch the Trajectory platform - the easiest and most intuitive tool to post-train models of your own. The foundation for continual learning. With just a few agent prompts, you get access to a full creative suite to train, eval, and deploy trillion parameter models. On top of that, we believe in a future where you don’t just shape your model once, it also keeps learning on its own from the world around it. We’re releasing two research previews. 1. Continual grading scales your taste, so your model learns what good looks like from far more than you could ever grade by hand. 2. GS1, a new algorithm that lets models learn directly from what they do in production. We’ve now raised 60M, with a new round led by @Sequoia at a 300M valuation to democratize the most powerful technology of today - training models - so that the lawyers, doctors, and engineers of the world can own their own intelligence. You know what good looks like, now go build it. Own your own value function with Trajectory.
Show more
Feels like it's been some time since I've learned something new about non-determinism on GPUs 😆 Pretty cool!
1/4 New writeup: you can fingerprint the exact GPU you're running on with a default torch.index_add_ call, even among identical GPUs. This works because floating-point maths depends on order, and every GPU has its own. This fingerprint survives reboots and can't be faked.
Show more
Samaya trained Nemotron 3.5 Lightning to beat Fable 5.1 on its finance research benchmark at 9% of the cost. The model was trained on Tinker together with the harness it works in: first by imitating 8 teachers, then RL on its own mistakes.
Show more
One thing I'm kinda curious about is that a lot of inference providers seem to charge on *realized* kv cache hits? Tinker charges off of theoretical kv cache hits (based off of a 1 hour limit), which is more similar to how Anthropic charges based off of explicit TTLs for kv cache retention. Imo I think Tinker/Anthropic's approach makes a lot more sense? Under a "realized" kv cache hit model, inference engines getting more kv cache hits actually reduces their revenue... and I think we've seen some of this gaming on openrouter.
Show more
inference engines should be bending over backwards more to get cache hits really interesting direction: > An Internet for the KV Cache - sending a KV cache across the Internet can now be faster and cheaper than computing it again.
Show more
To encourage independent thinkers, one of these is a psyop :^)
I'm doing DP. I'm doing TP. I'm doing SP. I'm doing PP. I'm doing ZP. I'm doing FSDP. I'm doing 1F1B. I'm doing CP. I'm doing ETP. I'm doing DPA. I'm doing VPP. I'm doing P/D. I'm doing ZBPP. I'm doing DPA. I'm doing HSDP. I'm doing DCP. I'm doing DWDP. I'm doing AFD.
Show more
I'm doing DP. I'm doing TP. I'm doing SP. I'm doing PP. I'm doing ZP. I'm doing FSDP. I'm doing 1F1B. I'm doing CP. I'm doing ETP. I'm doing DPA. I'm doing VPP. I'm doing P/D. I'm doing ZBPP. I'm doing DPA. I'm doing HSDP. I'm doing DCP. I'm doing DWDP. I'm doing AFD.
Show more
If inferenceX didn't deprecate 8k/1k this wouldn't be a problem smh
💭WHY IS DEEPINFER NOT ON INFERENCEX? DeepSeek dropped DeepInfer a few days ago, but the code is missing key components that is crucial for inference serving, and building them adds too much assumptions. (1/5)🧵
Show more
Let us know how the new deepseek v4.1 flash model is compared to the old one!
Your model behaves differently during training and inference? Boy do I have a solution for you :^)
Training the model to detect when it is in training vs. deployment works too! The model can even generalize from vLLM deployment training to SGLang deployment. We do this by recording activations from layer 34 in Hugging Face Trainer's training step and in vLLM's compiled serving. Then, we swap in the attention and residual stream from the Hugging Face copy and SFT the model to predict "Yes," and to predict "No" when we swap in from vLLM instead. The model learns how its training vs. deployment environment affects its first 34 layers.
Show more
As @johnschulman2 has put it, there are many ways we can "spend compute to save our customers compute". Here's one of them - a variant of muon that works far better for lora fine-tuning :)
Dimuon is a new optimizer we built for LoRA fine-tuning. In our SFT tests, it often reaches lower loss in fewer steps than AdamW. We're still experimenting with Dimuon; you can Tinker with it today and share your feedback! See our optimizers guide at
Show more
There's been a lot of efficiency improvements on Tinker, and some of these price cuts are long overdue 😅. Excited to work on lowering costs even more (and many other improvements)! Towards a post-training stack so cheap that nobody does it themselves :^)
Show more
Tinkerers have been busy scaling up long-context RL! We’ve made significant improvements to Tinker’s efficiency to support those, and are passing these on with price cuts up to 70%. GLM-5.3-Flash and DeepSeek-v4.1-Flash are also live for cost-efficient long-context work.
Show more
If you look at the actual share of input/output tokens though, it's ~6:1. Perhaps openrouter is assuming a far lower cache hit ratio than is true in practice. Either way, it's an interesting case of the router dynamics distorting the natural pricing for the inference providers! I apologize to companies currently exploiting this if I'm giving away valuable alpha :^) (5/5)
Show more
Second, I suspect openrouter is just overweighing input prices for routing purposes. Experimenting with GLM 5.3 between inferencenet (0.08$/5$) and Novita (0.42$/1.32$) , it routes to inferencenet 70% of the time, which corresponds to a 95/5 weighting of input/output. (4/5)
Show more
First, openrouter routes by the inverse square of pricing. Thus, if one provider charges $1/M and another provider charges $2/M, then the first provider gets 4x the traffic. So, if your request has lots of input, looks ridiculously cheap! (3/5)
Show more
Also, their cache hits are nearly as expensive as their cache misses! From a GPU efficiency perspective, this makes no sense. Prefill is more efficient than decode, but it's not 60x more efficient! I suspect the reason is due to two subtleties in openrouter routing. (2/5)
Show more
There's an interesting distortion in inference pricing that appears to be driven by openrouter's routing. Namely, ridiculously cheap prefill and very expensive decode. For GLM 5.3, (highest volume provider) charges $0.08/M input but $5.00/M output!(1/5)
Show more
Guys, did you see the inference price war for open weight models in openrouter? It’s bloody war to compete on the lowest price. Reminds me of electricity. I keep hearing inference is huge margin but then it seems it’s a war to zero at openrouter nowadays. I finally understand why openrouter charges 5.5%. I keep hearing stories of data centers in Finland, Philippines and Southeast Asia that are just cheap, cheaper and cheapest? I wonder how US neoclouds cope with this? I mean enterprise is a good market I’m sure.
Show more