๊ฐ€์ž… ํ›„ ์ดˆ๋Œ€ ๋งํฌ๋ฅผ ๊ณต์œ ํ•˜๋ฉด ๋™์˜์ƒ ์žฌ์ƒ ๋ฐ ์ดˆ๋Œ€ ๋ณด์ƒ์„ ๋ฐ›์„ ์ˆ˜ ์žˆ์Šต๋‹ˆ๋‹ค.

David Hendrickson
@TeksEdge
CEO & Founder | PhD | Startup Advisor | @Columbia | Author Generative Software Engineering | ๐Ÿ”” Follow for AI & Vibe Coding Tips ๐Ÿ‘‡
๊ฐ€์ž… July 2023
551 ํŒ”๋กœ์ž‰ ์ค‘    12.3K ํŒฌ
AMD and Intel agreed on something pretty unusual. A local PyTorch AI app shouldn't have to care whether the CPU underneath it is AMD or Intel. AMD is folding its ZenDNN AI optimizations into oneDNN, the library originally developed by Intel. AMD + Intel have now aligned on oneDNN as the default open-source x86 acceleration path in PyTorch. ZenDNN has been working on refining for ... ๐Ÿง  LLM inference โšก INT4 / INT8 / BF16 / FP16 ๐Ÿงฉ fused MoE operations ๐Ÿš€ vLLM CPU acceleration ๐Ÿ”ง optimized attention/matmul Now that work is being brought into the common oneDNN ecosystem AMD + Intel are also jointly developing ACE, new x86 AI matrix instructions. The plan is for future AMD/Intel AI instructions โ†’ oneDNN โ†’ PyTorch So local PyTorch software gets one x86 target instead of separate vendor paths. โš ๏ธ This does NOT make llama.cpp/GGUF faster, and AMD/Intel haven't published new performance numbers from the merger. ๐ŸŽฏBut for CPU Local AI, the two companies that spent decades fighting over x86 are now cooperating on the AI software layer. Link in ALT
๋” ๋ณด๊ธฐ