With cloud inference, you're sharing a machine with 1,000 other users.
You are a retention/ROI data point on someone's analytics dashboard.
Locally, you own the hardware - it's all yours. You can tune it however you like.
There's no throughput/interactivity tradeoff and no competing incentives.