docs
SDKs and frameworks

LiteLLM Proxy

Markdown

Your own gateway · OpenAI Chat

Full guide
FormatWhere to set it up
OpenAI Chatconfig.yaml → model_list → litellm_params (model, api_base, api_key); start with litellm --config config.yaml

Setup

Copy the configuration and replace sk-... with your key from the Ailoot Dashboard. Prefer storing the key in the environment variable AILOOT_API_KEY, if the application supports it.

Before starting, request GET /v1/models with your Ailoot key. Choose an exact model ID whose methods include POST /v1/chat/completions, then use that ID in the configuration. For agents, also check tool support and the features required by your client version.

model_list:
  - model_name: claude-sonnet
    litellm_params:
      model: openai/claude-sonnet-5-5
      api_base: https://api.ailoot.ai/v1
      api_key: os.environ/AILOOT_API_KEY
  - model_name: gpt-sol
    litellm_params:
      model: openai/gpt-6.1-sol
      api_base: https://api.ailoot.ai/v1
      api_key: os.environ/AILOOT_API_KEY

# run: litellm --config config.yaml

This configuration reads the key from the environment variable AILOOT_API_KEY. Set it before starting the application:

export AILOOT_API_KEY="sk-..."   # add to ~/.zshrc or ~/.bashrc

Example model: openai/claude-sonnet-5-5, openai/gpt-6.1-sol. Choose any other model from the catalog — check that it supports the format you need.

Good to know

Test

  • For the OpenAI format, the URL is https://api.ailoot.ai/v1 (or the full path if the application asks for a full URL).
  • Ask a short question. If you get an error, check the code and Request ID, then consult Errors and limits.
  • 404 immediately after setup almost always means the URL is wrong: an extra or missing /v1.
  • 402 — insufficient balance for the reserve. Agents reserve more than chat: why.

Application documentation: https://docs.litellm.ai/docs/providers/openai_compatible

Still have questions? Send your Request ID and a description — we'll help you troubleshoot.Contact support