CEO & Principal Analyst @creativestrat. Full-stack tech analysis from semis to software. Advisor to industry leaders. Technologist at heart. Keeper of Bees.
Talking with friendlies who run infra about inference compute environments and certainly true we need more GPUs but inline with our estimates we DEF need more CPUs. When you see how much a CPU can bottleneck a GPU during inference it’s eye opening.