Abheer Singh(@abheer):TensorFold by @ashxhart is one of our newest Inception startups and has been making waves in the local AI community. It's an open-source inference engine for running models on your own hardware. Finally got around to experiencing it for myself. I'm running Qwen3.8 Flash Next in NVFP4 on it across my two DGX Sparks, and built a paper reader to put its concurrency to work. It splits an arXiv paper into its sections and reads them all at once, one request per section, then merges the results into a one-page brief tagged back to each source section. Per-request and combined tok/s update live as it runs.

Abheer Singh

@abheer

accelerating ai-native startups @nvidia prev gtm @tenstorrent @oracle my opinions are my own

参加 February 2020

491 フォロー中 797 ファン

Abheer Singh@abheer

2026.10.09 08:00

TensorFold by @ashxhart is one of our newest Inception startups and has been making waves in the local AI community. It's an open-source inference engine for running models on your own hardware. Finally got around to experiencing it for myself. I'm running Qwen3.8 Flash Next in NVFP4 on it across my two DGX Sparks, and built a paper reader to put its concurrency to work. It splits an arXiv paper into its sections and reads them all at once, one request per section, then merges the results into a one-page brief tagged back to each source section. Per-request and combined tok/s update live as it runs.