This article discusses the challenges and solutions for deploying large Mixture-of-Experts models on AWS using Elastic Fabric Adapter technology. It details the development of new inter-node kernels that improve performance and reduce latency for these complex models. The authors explain the technical aspects of their implementation and how it enhances cloud-based model deployment.