0xSero(@0xSero):20 billion tokens locally. 1.6B tokens a day reached! 50B tokens a month! at the rate i'm going that's 15,000$ in api credits blended of all the models I use at production cache hit rates.. 4x 6000 is a no brainer if you have the budget, it'll recoup it's cost tenfold.

2026.09.23 07:50

20 billion tokens locally. 1.6B tokens a day reached! 50B tokens a month! at the rate i'm going that's 15,000$ in api credits blended of all the models I use at production cache hit rates.. 4x 6000 is a no brainer if you have the budget, it'll recoup it's cost tenfold.