AJ(@ItsmeAjayKV):GLM-5.3-flash is going to get even faster on 3090 + 64GB RAM. With other pr and mine coming soon, we will be able to run it even faster. Local AI is going through a great time now, especially for small consumer hardware. Special shoutout to @PeasantSmith and @needmorevram.

2026.10.11 00:00

GLM-5.3-flash is going to get even faster on 3090 + 64GB RAM. With other pr and mine coming soon, we will be able to run it even faster. Local AI is going through a great time now, especially for small consumer hardware. Special shoutout to @PeasantSmith and @needmorevram.

AJ@ItsmeAjayKV

2026.10.10 19:12

GLM-5.3-Flash running faster on my 3090 thanks to Project Maya from @PeasantSmith ! After some tweaking (PR coming soon) i'm able to run my Aj-IQ2_XXS mixed quant with Maya. - ~20t/s avg - low 200t/s prefill. Without MTP btw. I'm working on some pr to improve speed, at this rate even GLM-5.3-flash will be usable in my 3090 before end of this month. Checkout Maya: Get my quant:

コミュニティへ転送