Suso Fontán(@susofontan):Alright, so I just got OrcaSAQ-2-27B (Qwen3.8-27B quantized by orcarouter) up and running on an Nvidia P100. Obviously, performance isn't the greatest, but I honestly didn't expect to run a modern-architecture model using trellis-based quantization on a 2016 GPU with no Tensor Cores that currently goes for around $100–$200 on the used market. Pretty incredible. Status: No MTP, fine-tuning required, PPL matches model documentation. - GPU: Nvidia P100 16GB - Model: OrcaSAQ-2-27B by @OrcaRouter - Engine: footless (In-house development, currently private) Kernels & runtime: Built with assistance from DeepSeek v4.1 Flash by @deepseek

2026.09.26 17:14

Alright, so I just got OrcaSAQ-2-27B (Qwen3.8-27B quantized by orcarouter) up and running on an Nvidia P100. Obviously, performance isn't the greatest, but I honestly didn't expect to run a modern-architecture model using trellis-based quantization on a 2016 GPU with no Tensor Cores that currently goes for around $100–$200 on the used market. Pretty incredible. Status: No MTP, fine-tuning required, PPL matches model documentation. - GPU: Nvidia P100 16GB - Model: OrcaSAQ-2-27B by @OrcaRouter - Engine: footless (In-house development, currently private) Kernels & runtime: Built with assistance from DeepSeek v4.1 Flash by @deepseek_ai .