FlexOlmo introduces a new paradigm for language model training that enables data owners to collaborate without relinquishing control over their data. This approach allows for asynchronous contributions, maintains data privacy, and provides flexible data use, addressing the challenges of traditional AI development. By leveraging a mixture-of-experts architecture, FlexOlmo enhances model performance while minimizing the risk of data extraction.