Many leading companies in the AI space have found that rising compute costs, though often cited as a barrier, are no longer the primary constraint to AI adoption. Instead, latency, flexibility, and capacity pose greater challenges. For example, food delivery company Wonder sees AI adding only a few cents per order but faces cloud capacity limits due to rapid growth. Wonder’s CTO, James Chen, explains that while large AI models are currently cost-effective, hyper-customized small models per individual remain too costly. The company encourages experimentation but finds budgeting AI costs unpredictable. Similarly, biotech company Recursion balances on-premises and cloud resources to optimize large-scale AI workloads. Recursion’s CTO, Ben Mabey, advocates for multi-year investments in compute infrastructure to foster innovation, noting on-premises solutions can be significantly more cost-efficient for large tasks. Overall, cost is shifting from an obstacle to managing the pace and scale of AI deployment and infrastructure sustainability.
Back
