The SGLang RL team developed an end-to-end INT4 Quantization-Aware Training (QAT) pipeline that enhances training efficiency and model stability. By using fake quantization during training and real quantization at inference, they achieved significant performance improvements for large models on a single GPU. The article details the technical steps taken and results of their approach.