Register and share your invite link to earn from video plays and referrals.

covenant
@covenant_ai
One covenant, many orders. @tplr_ai + @basilic_ai + @grail_ai
5 Following    5.1K Followers
The TGIF #29# recap is up. @DistStateAndMe walks through the busiest month in Covenant history with @erfan_mhi and @Hevalon, covering everything from Covenant-72B to Grail's validation by @cursor_ai to what's coming next across the whole ecosystem.
Show more
All Covenant support and discussion now lives in one place. The Covenant Discord. @tplr_ai, @basilic_ai, @grail_ai. The whole team, one server. Come build with us.
The work speaks.
LATEST: 📈 Bittensor's TAO nearly doubled in March after its Subnet 3 trained a competitive LLM that runs across more than 70 distributed nodes.
AI that runs its own experiments, picks what works, and improves itself overnight. No human in the loop. @Hevalon built it on @basilic_ai. 15 autonomous iterations, better model by morning. One command. This is what happens when GPU infrastructure becomes programmable.
Show more
I built autoresearch-rl and pointed it at GRPO fine-tuning on @basilic_ai A100s. One command. 15 iterations. Zero human intervention. 100% infrastructure success rate. GSM8K pass@1: 26% baseline to 36%. The hard part wasn't the search algorithm. It was the infrastructure.
Show more
“Nobody had hope in crypto any more… But we posted about our 72B parameter run and it caught fire.” — Templar creator Sam Dare Hear about how this subnet incentivized miners to train a massive new AI model, what’s holding it back from competing with the likes of GPT-5 and Opus 4.6, and the advantages of decentralizing and democratizing the training process on a brand new TWiST. PLUS Sam’s reaction to hearing his project discussed on the @TheAllIn podcast with special guest Jensen Huang. cc: @Jason, @Lons, @tplr_ai, @DistStateAndMe
Show more
Today on @TWiStartups: @DistStateAndMe on the show with @Jason. Decentralized pre-training, the Covenant ecosystem, and why open intelligence creation matters. Live at 12 PM CT.
NVIDIA's Jensen Huang just called Covenant-72B 'a pretty crazy technical accomplishment' on the All-In Pod. We've got the man who built it: Sam Dare of Subnet 3, Templar (@tplr_ai). Plus a demo of OpenOats -- the open source AI note-taker and assistant -- from @yazins. Track it all on the live docket:
Show more
Today on Novelty Search: the Covenant team. Templar, Grail, Basilica. A big couple of weeks: the viral Covenant-72B announcement, Jack Clark, All-In Podcast, Fireworks citing PULSE for Cursor. We'll walk through all of it. 9PM UTC on Bittensor Discord.
Show more
Congrats to the winners of the SF Bittensor hackathon track. Cryptographic assurance, physical-world coordination, decentralized quant trading. The range of what's being built on Bittensor keeps expanding. @basilic_ai provided compute credits for the prize pool. Good to see the ecosystem supporting new builders!
Show more
Winners from the SF Bittensor hackathon track: 🥇 @provenonce_ai :: Proof of Assurance Cryptographic assurance for AI workflows. 🥈 @PCCProtocol :: Physical Capability Cloud Protocol Verified coordination for physical-world services. 🥉 @tech_insignia :: Insignia Decentralized quant trading with competitive model evaluation. Prize pool + $3500 cash + $3000 in @basilic_ai compute credits + Up to 1000 TAO discretionary investment from @UnsupervisedCap + 50 TAO toward mainnet registration from @CrucibleLabs + Intro call with @bitstarterAI Intelligence at The Frontier partner @FundingCommons Bittensor hackathon track produced by @redwoodnorth_io
Show more
Research from the Covenant ecosystem providing the theoretical foundation for infrastructure behind @cursor_ai, one of the most-used AI coding tools in the world. @grail_ai (SN81) published PULSE in February. @FireworksAI_HQ cited it in their Composer 2 blog this week.
Show more
Pretty wild to see our work on PULSE show up in a real 1T-scale post-training run done by @cursor_ai. Cursor built Composer 2 in collaboration with Fireworks and trained it across multiple datacenters, getting huge savings by syncing only the weights that actually changed between RL checkpoints. Fireworks reports that more than 98% of BF16 weights can stay bit-identical from one checkpoint to the next, and they cited our paper on this, too. That is basically the exact sparsity pattern we showed in our paper, where we introduced PULSE, a lossless method for 100x more efficient weight-sync communication for RL training. Their system is very close to this idea in practice: exploiting the fact that only a tiny fraction of weights actually change between RL steps. The deeper reason for this is not that RL gradients are sparse. They are not. The gradients are still dense. What becomes sparse is the realized weight update. In RL, learning rates are tiny, and with Adam, the update size stays bounded around the learning rate. Then BF16 adds a hard threshold: if the update is too small relative to the weight, it just rounds away, and the stored weight does not change at all. So from one checkpoint to the next, most of the model literally stays identical. That is why this is such a useful systems idea. Lower precision, like using BF16, does not just save compute. It can also save communication, because more tiny updates get absorbed and fewer weights need to be shipped. At that point, compute efficiency and comms efficiency stop being a tradeoff. They start reinforcing each other. If you want the deeper story on why RL updates get this sparse, the theory behind it, and how to push weight-sync bandwidth down by 100x+, take a look at our paper: The Fireworks blog on Composer 2 that cited our work: The animation is taken from Fireworks!
Show more
Open competition producing open optimization research. Crusades miners are publishing their techniques as they discover them. Selective gradient checkpointing, static shape compilation, fused cross-entropy paths. Every submission makes the next one better.
Show more
PULSE made weight sync 100x faster. That turned the trainer itself into the bottleneck. @erfan_mhi just fixed that too. Grail's GRPO trainer is now 1.8x faster on a single B200: 27% to 47% MFU, epoch time nearly halved. Decentralized post-training is converging on centralized speed.
Show more
Seven subnet ideas are heading to testnet, backed by @basilic_ai compute credits. Basilica sponsors the Ideathon because the best way to validate a subnet design is to run it, and compute should not be the bottleneck. Congratulations to all the teams advancing.
Show more
Bittensor Subnet Ideathon — Round I Results 🏆 After reviewing an incredible set of submissions, we’re excited to announce the teams moving forward to Round II (Testnet Phase). Both our Top 7 and Honorable Mention teams will advance to the next round. Top 7 Teams (Ranked Alphabetically): • C-SWON — Aditya Singh • ChronoSeek — Connor Daly • Defektr — Hiw3 • Mentiss_AI — Jeremy Wang • OpenMind — Bello Iteoluwakisi • Proven — Christopher H.G • vividverse — @vividverseai Honorable Mentions: • BitDefense — A.G. • DaVinci — Chris Romano • Keyword Intelligence Subnet (KIS) — Ozan Andaç • Moirai Subnet — @ai_moir • Probity — Dicky Bayu Sadewo • Query Agent — Daniel Derefaka • sotarad-ai — Wade • Talos Protocol — Christopher H.G • TensorClock — Valeriy Lihachev • Titan — JKohav With over 150+ projects, the competition was fierce — and these teams stood out for their strong mechanism design and promising subnet ideas on @opentensor 👏
Show more
TGIF #28# recap now on YouTube. @DistStateAndMe and @const_reborn walk through the full Covenant-72B story and what lies ahead at the frontier of decentralised training.
Covenant72B preview today with @DistStateAndMe walking through the run and what comes next. Full report and model weights on Monday. @const_reborn will be joining us to celebrate this milestone in deAI history!
Show more
This week on TGIF, @DistStateAndMe previews the Covenant72B report ahead of the full release on Monday. He'll walk through what the training run produced, what we learned, and what comes next. Also on the agenda: multi-GPU Crusades went live this week and other updates across the ecosystem.
Show more