Suso Fontán
@susofontan
Software Architect.
Side quest: AI research & AI DevOps.
参加 December 2011
134 フォロー中 85 ファン
Implemented batching support for footless-orcasaq-2-27B-nvidia-p100. Benchmarks show 40 tok/s at concurrency = 4 running OrcaSAQ-2-27B (@OrcaRouter) on a single NVIDIA Tesla P100.
More updates to follow.
• Repo:
• Demo (pure prose):
もっと見る
