RadixArk, the company behind the open-source tool SGLang, has reached a $400 million valuation following a funding round led by Accel. Founded in 2023 by key contributors from the UC Berkeley lab, RadixArk focuses on optimizing AI model inference to reduce costs and improve efficiency. The startup is also developing a new framework for reinforcement learning called Miles.

SGLang has integrated Hugging Face transformers as a backend, enhancing inference performance for models while maintaining the flexibility of the transformers library. This integration allows for high-throughput, low-latency tasks and supports models not natively compatible with SGLang, streamlining deployment and usage. Key features include automatic fallback to transformers and optimized performance through mechanisms like RadixAttention.