Mike Key(@1337hero):Managed to bump the generation speed with a minor hit on prefill with finding out some things were wrong with my llama-swap config and my hardware config - editing grub enabled some things that should speed up all my runs on everything. Time to re-bench everything.

Mike Key

@1337hero

Senior Software Engineer going hard on AI. Building local LLMs & AI agents Homelab - 3x AMD R9700 & Strix Halo Shipping code @

加入 March 2023

279 正在關注 2.2K 粉絲

Mike Key@1337hero

2026.08.16 12:29

Managed to bump the generation speed with a minor hit on prefill with finding out some things were wrong with my llama-swap config and my hardware config - editing grub enabled some things that should speed up all my runs on everything. Time to re-bench everything.