Abheer Singh(@abheer):TensorFold by @ashxhart is one of our newest Inception startups and has been making waves in the local AI community. It's an open-source inference engine for running models on your own hardware. Finally got around to experiencing it for myself. I'm running Qwen3.8 Flash Next in NVFP4 on it across my two DGX Sparks, and built a paper reader to put its concurrency to work. It splits an arXiv paper into its sections and reads them all at once, one request per section, then merges the results into a one-page brief tagged back to each source section. Per-request and combined tok/s update live as it runs.

2026.10.09 08:00

TensorFold by @ashxhart is one of our newest Inception startups and has been making waves in the local AI community. It's an open-source inference engine for running models on your own hardware. Finally got around to experiencing it for myself. I'm running Qwen3.8 Flash Next in NVFP4 on it across my two DGX Sparks, and built a paper reader to put its concurrency to work. It splits an arXiv paper into its sections and reads them all at once, one request per section, then merges the results into a one-page brief tagged back to each source section. Per-request and combined tok/s update live as it runs.

显示更多