注册并分享邀请链接,可获得视频播放与邀请奖励。

Red Hat AI
@RedHat_AI
Accelerating AI innovation with open platforms and community. The future of AI is open.
加入 May 2018
2.1K 正在关注    11.7K 粉丝
Inkling running on a DGX B200 node with vLLM across 8 GPUs. Text, images, and reasoning from a single container. Red Hat AI FP8 checkpoints coming soon. Shoutout to the @vllm_project community for getting this up and running and @_soyr_ for the quick video.
显示更多