AJ(@ItsmeAjayKV):More proof that we need specialized inference engine. GLM-5.3-Flash is now faster on my 3090 + 64GB RAM After some work on Project Maya (from @PeasantSmith), my own IQ2_XXS quant now runs at - 22 - 24 tok/s gen - 910 t/s prefill at 8k - 1150 t/s prefill at 32k Full system spec: - RTX 3090 - 64GB DDR5 RAM These are number i never thought i'll see in my system. Get my quant here: https://t.co/9LRxs2TtHw Maya:

@ItsmeAjayKV

Bullish on local AI OSS FTW Independent AI R&D. quants, repe, kernel. 1x 3060, 1x 3090: 64GB RAM N4 (日本語勉強中) 🎌

加入 September 2016

862 正在关注 9.1K 粉丝

AJ@ItsmeAjayKV

2026.10.11 19:07

More proof that we need specialized inference engine. GLM-5.3-Flash is now faster on my 3090 + 64GB RAM After some work on Project Maya (from @PeasantSmith), my own IQ2_XXS quant now runs at - 22 - 24 tok/s gen - 910 t/s prefill at 8k - 1150 t/s prefill at 32k Full system spec: - RTX 3090 - 64GB DDR5 RAM These are number i never thought i'll see in my system. Get my quant here: Maya:

显示更多

AJ@ItsmeAjayKV

2026.10.11 11:23

What a time for 3090 ! GLM-5.3-Flash just got way faster on my 3090 + 64GB ram. Project-Maya as inference engine: My PR is in work, but i cannot hold back from teasing.