가입 후 초대 링크를 공유하면 동영상 재생 및 초대 보상을 받을 수 있습니다.

Gajesh
@gajesh
engineer, chaos agent @eigenlabs, creator @darkbloomai. perpetually curious optimist. entropic. open innovation; formerly: LZ, Telegram
가입 December 2016
2.9K 팔로잉 중    51.2K 팬
Darkbloom: Day 15 We have been locked in for last one week; It has been very exciting and we shipped a lot of improvements to the system. Metrics: - 16.3B tokens served: New ATH & 60% higher than last day. - $420K Network ARR (4x in 2 weeks); - 99.96% uptime (very happy considering we're a distributed network). - ~15-17% utilization at peak; median: 13% utilization. Product: - One big win: we take up 30% of traffic for Gemma 4 26B - We cut latency by ~1.5 second. We plan to ship few more features that would reduce latency by 30-90%. This will include cache-aware routing. - We shipped new routing and system optimizations which were key reason for us to cut down 429s. More such to come. - We will be adding 3-4 more models in the coming week. Excited for @Spangler3000 to be helping us with this! - We conducted MLX(.)Fast which has improved Gemma 4's performance by 2.5x -- the improvements are in process of being imported by @TheDavidTai. - We are exploring payouts solutions such as Stripe Global Payouts to add 67 more countries. - Astra has redesigned our Console UI (this is AGI, ngl). We will also be starting up our efforts for the MacOS app for better user experience. - We have also been looking more deep into Autopilot where we load up models according to the traffic and other factors to maximise the provider earnings. - Our new landing page is almost ready and coming up with one suprise ;) -- huge kudus to @0xkydo and Estella. - Also huge thanks to @iLLRiPHiTTeR for helping us while onboarding new models on OpenRouter. We were able to find out minor issues in our inference engine. - We are also working through engineering practices and cleaning up code. Thank you everyone for being part of this journey and reading along this update. We build these systems to bring people together to contribute to this AI economy. As always, it has been rewarding to keep doing what we do. Until next time.
더 보기