docs
Chat applications

AnythingLLM

Markdown

Chat with documents · OpenAI Chat

Full guide
FormatWhere to set it up
OpenAI ChatSettings > AI Providers > LLM > Generic OpenAI (Docker: env LLM_PROVIDER='generic-openai')

Setup

Copy the configuration and replace sk-... with your key from the Ailoot Dashboard. Prefer storing the key in the environment variable AILOOT_API_KEY, if the application supports it.

Before starting, request GET /v1/models with your Ailoot key. Choose an exact model ID whose methods include POST /v1/chat/completions, then use that ID in the configuration. For agents, also check tool support and the features required by your client version.

UI: Base URL = https://api.ailoot.ai/v1
API Key = sk-...
Chat Model Name = deepseek-v4-pro
Token context window = according to the model

Docker .env:
LLM_PROVIDER='generic-openai'
GENERIC_OPEN_AI_BASE_PATH='https://api.ailoot.ai/v1'
GENERIC_OPEN_AI_MODEL_PREF='deepseek-v4-pro'
GENERIC_OPEN_AI_MODEL_TOKEN_LIMIT=128000
GENERIC_OPEN_AI_API_KEY='sk-...'

Example model: deepseek-v4-pro. Choose any other model from the catalog — check that it supports the format you need.

Good to know

Test

  • For the OpenAI format, the URL is https://api.ailoot.ai/v1 (or the full path if the application asks for a full URL).
  • Ask a short question. If you get an error, check the code and Request ID, then consult Errors and limits.
  • 404 immediately after setup almost always means the URL is wrong: an extra or missing /v1.
  • 402 — insufficient balance for the reserve. Agents reserve more than chat: why.

Application documentation: https://docs.anythingllm.com/setup/llm-configuration/cloud/openai-generic

Still have questions? Send your Request ID and a description — we'll help you troubleshoot.Contact support