Click any tag below to further narrow down your results
Links
AI inference spending will overtake databases as the largest software market by 2027, fundamentally breaking the economics that made traditional SaaS profitable. This shift forces application companies to manage massive infrastructure costs that will compress margins and demand new operational approaches.
- Inference market grows from $25b (2025) to $350b (2027), passing databases at roughly 2x the size, making it the dominant software category.
- Gross margins collapse below SaaS norms (72%) because inference costs become a major COGS line item, forcing vendors to either build proprietary models to reduce token overhead or accept margin compression.
- Customer-owned infrastructure (BYOK) trades top-line revenue for gross margin—vendors get higher percentage margins but on drastically smaller contracts.
- Token price wars won't solve the problem; capability improvements keep resetting frontier model prices upward, so companies must optimize through smaller models, better routing, and efficient harnesses.
Simon Willison argues that pay-by-usage services should enforce hard budget caps by default—stopping service when spending hits a limit rather than just sending warnings—because coding agents make it too easy to accidentally rack up massive bills. AWS and Google Cloud recently launched these features, but they need to become standard across the industry.
- Soft budget caps (warning emails) fail in practice because automated agents and unattended services can incur thousands in charges overnight before anyone notices the alert.
- AWS and Google Cloud both launched hard spending limits recently (September and July 2026), pausing projects when monthly budgets are exceeded, but adoption and availability remain limited.
- The feature should be mandatory by default with an explicit opt-in checkbox to remove caps, shifting the burden of risk from users who fear bankruptcy to those willing to accept it.
- Many developers avoid AWS for personal projects specifically because of runaway cost fears, so hard caps would unlock adoption from risk-averse users.