Suso Fontán
@susofontan
Software Architect.
Side quest: AI research & AI DevOps.
가입 December 2011
134 팔로잉 중 85 팬
Implemented batching support for footless-orcasaq-2-27B-nvidia-p100. Benchmarks show 40 tok/s at concurrency = 4 running OrcaSAQ-2-27B (@OrcaRouter) on a single NVIDIA Tesla P100.
More updates to follow.
• Repo:
• Demo (pure prose):
더 보기
