Suso Fontán(@susofontan):Good news! OrcaSAQ-2-27B is reaching usable speeds on an Nvidia P100 🤩 • Decode: 24+ tps • Prefill: 200+ tps on long inputs Remember, P100 is a non tensors 2016 GPU 🤯 Wrapping up a few loose ends, organizing the project, and writing documentation now. Opening to the public soon!

Suso Fontán

@susofontan

Software Architect. Side quest: AI research & AI DevOps.

Joined December 2011

134 Following 85 Followers

Suso Fontán@susofontan

2026.10.01 09:04

Good news! OrcaSAQ-2-27B is reaching usable speeds on an Nvidia P100 🤩 • Decode: 24+ tps • Prefill: 200+ tps on long inputs Remember, P100 is a non tensors 2016 GPU 🤯 Wrapping up a few loose ends, organizing the project, and writing documentation now. Opening to the public soon!