가입 후 초대 링크를 공유하면 동영상 재생 및 초대 보상을 받을 수 있습니다.

NO1ennn
@N01ennn
Everything is going as usual
가입 February 2024
631 팔로잉 중    4.8K
he spent $1,999 once. saved $21,000 in a year. NVIDIA DGX Spark on his desk was paying $180/month for cloud GPUs. every experiment had a price tag. every overnight run cost money. then he bought the machine 128GB unified memory. 1 petaflop at FP4. runs Qwen, Llama, Mistral locally. nothing leaves the machine. ever stack: Ollama. PyTorch. HuggingFace. vLLM. all compatible out of the box cloud cost per year: $2,160+. DGX Spark: $1,999 once. electricity after that: basically zero Jensen Huang hand-delivered the first units to Elon Musk at Starbase. fits next to a monitor. no rack. no server room. no cooling setup the math only works once. after that every inference run is free
더 보기