LiteLLM Proxy
MarkdownYour own gateway · OpenAI Chat
Full guide
| Format | Where to set it up |
|---|---|
| OpenAI Chat | config.yaml → model_list → litellm_params (model, api_base, api_key); start with litellm --config config.yaml |
Setup
Copy the configuration and replace sk-... with your key from the Ailoot Dashboard. Prefer storing the key in the environment variable AILOOT_API_KEY, if the application supports it.
Before starting, request GET /v1/models with your Ailoot key. Choose an exact model ID whose methods include POST /v1/chat/completions, then use that ID in the configuration. For agents, also check tool support and the features required by your client version.
model_list:
- model_name: claude-sonnet
litellm_params:
model: openai/claude-sonnet-5-5
api_base: https://api.ailoot.ai/v1
api_key: os.environ/AILOOT_API_KEY
- model_name: gpt-sol
litellm_params:
model: openai/gpt-6.1-sol
api_base: https://api.ailoot.ai/v1
api_key: os.environ/AILOOT_API_KEY
# run: litellm --config config.yamlThis configuration reads the key from the environment variable AILOOT_API_KEY. Set it before starting the application:
export AILOOT_API_KEY="sk-..." # add to ~/.zshrc or ~/.bashrcsetx AILOOT_API_KEY "sk-..." # then restart the terminalExample model: openai/claude-sonnet-5-5, openai/gpt-6.1-sol. Choose any other model from the catalog — check that it supports the format you need.
Good to know
Test
- For the OpenAI format, the URL is
https://api.ailoot.ai/v1(or the full path if the application asks for a full URL). - Ask a short question. If you get an error, check the code and Request ID, then consult Errors and limits.
- 404 immediately after setup almost always means the URL is wrong: an extra or missing
/v1. - 402 — insufficient balance for the reserve. Agents reserve more than chat: why.
Application documentation: https://docs.litellm.ai/docs/providers/openai_compatible