Google Kubernetes Engine (GKE) has introduced new generative AI inference capabilities that significantly enhance performance and reduce costs. These features include GKE Inference Quickstart, TPU serving stack, and Inference Gateway, which collectively streamline the deployment of AI models, optimize load balancing, and improve scalability, resulting in lower latency and higher throughput for users.

GKE Data Cache is now generally available, enhancing Google Kubernetes Engine's performance for stateful and stateless applications by utilizing high-speed local SSDs as a caching layer for persistent disks. This solution provides significant improvements in read latency and throughput, making it easier to manage data access while potentially lowering costs. Users can configure caching for their workloads with straightforward setup instructions and options for data consistency.