This article explains how Meta is using backend aggregation (BAG) to connect thousands of GPUs across multiple data centers for its Prometheus AI cluster. BAG facilitates high-capacity networking, enabling the infrastructure to meet the demands of large-scale AI applications. It details the technical aspects of BAG's design and implementation, emphasizing performance and reliability.