Anthropic has identified and resolved three infrastructure bugs that degraded the output quality of its Claude AI models over the summer of 2025. The company is implementing changes to its processes to prevent future issues, while also facing challenges associated with running its service across multiple hardware platforms. Community feedback highlights the complexity of maintaining model performance across these diverse infrastructures.

Harvey's AI infrastructure effectively manages model performance across millions of daily requests by utilizing active load balancing, real-time usage tracking, and a centralized model inference library. Their system prioritizes reliability, seamless onboarding of new models, and maintaining high availability even during traffic spikes. Continuous optimization and innovation are key focuses for enhancing performance and user experience.