docs
SDKs and frameworks

LlamaIndex

Markdown

Framework · OpenAI Chat

Full guide
FormatWhere to set it up
OpenAI Chatllama-index-llms-openai-like package, OpenAILike(api_base=..., api_key=..., model=..., is_chat_model=True) class

Setup

Copy the configuration and replace sk-... with your key from the Ailoot Dashboard. Prefer storing the key in the environment variable AILOOT_API_KEY, if the application supports it.

Before starting, request GET /v1/models with your Ailoot key. Choose an exact model ID whose methods include POST /v1/chat/completions, then use that ID in the configuration. For agents, also check tool support and the features required by your client version.

pip install llama-index-llms-openai-like
import os
from llama_index.llms.openai_like import OpenAILike
llm = OpenAILike(
    model="deepseek-v4-pro",
    api_base="https://api.ailoot.ai/v1",
    api_key=os.environ["AILOOT_API_KEY"],
    is_chat_model=True,
    is_function_calling_model=True,
    context_window=128000)
print(llm.complete("Hello"))

Example model: deepseek-v4-pro, claude-sonnet-5-5, gpt-6.1-sol. Choose any other model from the catalog — check that it supports the format you need.

Good to know

Test

  • For the OpenAI format, the URL is https://api.ailoot.ai/v1 (or the full path if the application asks for a full URL).
  • Ask a short question. If you get an error, check the code and Request ID, then consult Errors and limits.
  • 404 immediately after setup almost always means the URL is wrong: an extra or missing /v1.
  • 402 — insufficient balance for the reserve. Agents reserve more than chat: why.

Application documentation: https://developers.llamaindex.ai/python/framework-api-reference/llms/openai_like/

Still have questions? Send your Request ID and a description — we'll help you troubleshoot.Contact support