LiteLLM
MarkdownSDK · OpenAI Chat
Full guide
| Format | Where to set it up |
|---|---|
| OpenAI Chat | litellm.completion(model="openai/<id>", api_base=..., api_key=...) |
Setup
Copy the configuration and replace sk-... with your key from the Ailoot Dashboard. Prefer storing the key in the environment variable AILOOT_API_KEY, if the application supports it.
Before starting, request GET /v1/models with your Ailoot key. Choose an exact model ID whose methods include POST /v1/chat/completions, then use that ID in the configuration. For agents, also check tool support and the features required by your client version.
import os
import litellm
r = litellm.completion(
model="openai/claude-sonnet-5-5",
api_base="https://api.ailoot.ai/v1",
api_key=os.environ["AILOOT_API_KEY"],
messages=[{"role": "user", "content": "Hello"}])
print(r.choices[0].message.content)
# embeddings: litellm.embedding(model="openai/nemotron-3-embed", api_base="https://api.ailoot.ai/v1", api_key=os.environ["AILOOT_API_KEY"], input=["text"])Example model: openai/claude-sonnet-5-5, openai/qwen3.8-max, openai/nemotron-3-embed. Choose any other model from the catalog — check that it supports the format you need.
Good to know
Test
- For the OpenAI format, the URL is
https://api.ailoot.ai/v1(or the full path if the application asks for a full URL). - Ask a short question. If you get an error, check the code and Request ID, then consult Errors and limits.
- 404 immediately after setup almost always means the URL is wrong: an extra or missing
/v1. - 402 — insufficient balance for the reserve. Agents reserve more than chat: why.
Application documentation: https://docs.litellm.ai/docs/providers/openai_compatible
Still have questions? Send your Request ID and a description — we'll help you troubleshoot.Contact support