docs
SDKs and frameworks

LiteLLM

Markdown

SDK · OpenAI Chat

Full guide
FormatWhere to set it up
OpenAI Chatlitellm.completion(model="openai/<id>", api_base=..., api_key=...)

Setup

Copy the configuration and replace sk-... with your key from the Ailoot Dashboard. Prefer storing the key in the environment variable AILOOT_API_KEY, if the application supports it.

Before starting, request GET /v1/models with your Ailoot key. Choose an exact model ID whose methods include POST /v1/chat/completions, then use that ID in the configuration. For agents, also check tool support and the features required by your client version.

import os
import litellm
r = litellm.completion(
    model="openai/claude-sonnet-5-5",
    api_base="https://api.ailoot.ai/v1",
    api_key=os.environ["AILOOT_API_KEY"],
    messages=[{"role": "user", "content": "Hello"}])
print(r.choices[0].message.content)
# embeddings: litellm.embedding(model="openai/nemotron-3-embed", api_base="https://api.ailoot.ai/v1", api_key=os.environ["AILOOT_API_KEY"], input=["text"])

Example model: openai/claude-sonnet-5-5, openai/qwen3.8-max, openai/nemotron-3-embed. Choose any other model from the catalog — check that it supports the format you need.

Good to know

Test

  • For the OpenAI format, the URL is https://api.ailoot.ai/v1 (or the full path if the application asks for a full URL).
  • Ask a short question. If you get an error, check the code and Request ID, then consult Errors and limits.
  • 404 immediately after setup almost always means the URL is wrong: an extra or missing /v1.
  • 402 — insufficient balance for the reserve. Agents reserve more than chat: why.

Application documentation: https://docs.litellm.ai/docs/providers/openai_compatible

Still have questions? Send your Request ID and a description — we'll help you troubleshoot.Contact support