Blacksmith's serverless CI cloud leverages the chaotic and unpredictable nature of continuous integration workloads to optimize resource utilization and profitability through a multitenant model. By pooling resources, they can efficiently handle spikes in demand from multiple customers, ultimately reducing costs and increasing margins as customer activity blends together. The company highlights the importance of fleet utilization in driving revenue and maintaining sustainable operations.

SWE-Bench Verified was optimized from 240 GiB to just 5 GiB by implementing delta layering, restructuring packfiles, and removing unnecessary build artifacts. These changes drastically reduce setup time for evaluating coding agents, allowing for faster downloads and efficient use of cloud resources. The core optimization technique is applicable to other execution environments as well.