註冊並分享邀請連結,可獲得影片播放與邀請獎勵。

Abheer Singh
@abheer
accelerating ai-native startups @nvidia prev gtm @tenstorrent @oracle my opinions are my own
加入 February 2020
491 正在關注    797 粉絲
TensorFold by @ashxhart is one of our newest Inception startups and has been making waves in the local AI community. It's an open-source inference engine for running models on your own hardware. Finally got around to experiencing it for myself. I'm running Qwen3.8 Flash Next in NVFP4 on it across my two DGX Sparks, and built a paper reader to put its concurrency to work. It splits an arXiv paper into its sections and reads them all at once, one request per section, then merges the results into a one-page brief tagged back to each source section. Per-request and combined tok/s update live as it runs.
顯示更多
0
11
38
2
轉發到社區