AJ(@ItsmeAjayKV):More proof that we need specialized inference engine. GLM-5.3-Flash is now faster on my 3090 + 64GB RAM After some work on Project Maya (from @PeasantSmith), my own IQ2_XXS quant now runs at - 22 - 24 tok/s gen - 910 t/s prefill at 8k - 1150 t/s prefill at 32k Full system spec: - RTX 3090 - 64GB DDR5 RAM These are number i never thought i'll see in my system. Get my quant here: https://t.co/9LRxs2TtHw Maya:

2026.10.11 19:07

More proof that we need specialized inference engine. GLM-5.3-Flash is now faster on my 3090 + 64GB RAM After some work on Project Maya (from @PeasantSmith), my own IQ2_XXS quant now runs at - 22 - 24 tok/s gen - 910 t/s prefill at 8k - 1150 t/s prefill at 32k Full system spec: - RTX 3090 - 64GB DDR5 RAM These are number i never thought i'll see in my system. Get my quant here: Maya:

AJ@ItsmeAjayKV

2026.10.11 11:23

What a time for 3090 ! GLM-5.3-Flash just got way faster on my 3090 + 64GB ram. Project-Maya as inference engine: My PR is in work, but i cannot hold back from teasing.

커뮤니티로 전달