This article explains the split in AI inference infrastructure between reserved compute platforms and inference APIs. It outlines how each model offers different benefits, with reserved platforms focusing on predictability and control, while inference APIs emphasize cost efficiency and scalability. Understanding these tradeoffs is key as AI inference becomes more prevalent.