LiteLLM is a lightweight proxy server designed to facilitate calls to various LLM APIs using a consistent OpenAI-like format, managing input translation and providing robust features like retry logic, budget management, and logging capabilities. It supports multiple providers, including OpenAI, Azure, and Huggingface, and offers both synchronous and asynchronous interaction models. Users can easily set up and configure the service through Docker and environment variables for secure API key management.
llm ✓
api ✓
proxy ✓
openai ✓
docker ✓