LiteLLM
MarkdownSDK · OpenAI Chat
To‘liq qo‘llanma
| Format | Qayerda sozlash kerak |
|---|---|
| OpenAI Chat | litellm.completion(model="openai/<id>", api_base=..., api_key=...) |
Sozlash
Konfiguratsiyani nusxalang va almashtiring: sk-... Ailoot boshqaruv panelidagi o‘z kalitingiz bilan. Kalitni muhit o‘zgaruvchisida saqlagan ma’qul: AILOOT_API_KEY — ilova buni qo‘llab-quvvatlasa.
Ishga tushirishdan oldin Ailoot kalitingiz bilan GET /v1/models so‘rovini yuboring. Usullari POST /v1/chat/completions ni o‘z ichiga olgan aniq model ID sini tanlang va sozlamada ishlating. Agentlar uchun mijoz versiyangizga kerakli vositalar va imkoniyatlar qo‘llab-quvvatlanishini ham tekshiring.
import os
import litellm
r = litellm.completion(
model="openai/claude-sonnet-5-5",
api_base="https://api.ailoot.ai/v1",
api_key=os.environ["AILOOT_API_KEY"],
messages=[{"role": "user", "content": "Salom"}])
print(r.choices[0].message.content)
# embeddinglar: litellm.embedding(model="openai/nemotron-3-embed", api_base="https://api.ailoot.ai/v1", api_key=os.environ["AILOOT_API_KEY"], input=["matn"])Model misoli: openai/claude-sonnet-5-5, openai/qwen3.8-max, openai/nemotron-3-embed. Boshqa istalgan modelni quyidagi joydan oling: katalogdan — kerakli formatni qo‘llab-quvvatlashini tekshiring.
Bilish muhim
Tekshirish
- OpenAI formati uchun manzil —
https://api.ailoot.ai/v1(yoki ilova to‘liq manzilni so‘rasa, to‘liq yo‘l). - Qisqa savol bering. Xato kelsa, kod va Request ID’ni ko‘ring va quyidagi sahifa bilan solishtiring: Xatolar va limitlar.
- Sozlashdan darhol keyingi 404 deyarli har doim noto‘g‘ri manzilni bildiradi: ortiqcha yoki yetishmayotgan
/v1. - 402 — balans zaxiraga yetmaydi. Agentlar chatga qaraganda ko‘proq zaxira oladi: nega.
Ilova hujjatlari: https://docs.litellm.ai/docs/providers/openai_compatible