Source: https://ailoot.ai/models/en/meta-llama-llama-3-1-70b-instruct/
Canonical: https://ailoot.ai/models/en/meta-llama-llama-3-1-70b-instruct/
Language: en

# Meta: Llama 3.1 70B Instruct

[Markdown](https://ailoot.ai/models/en/meta-llama-llama-3-1-70b-instruct/index.md) · [JSON](https://ailoot.ai/models/en/meta-llama-llama-3-1-70b-instruct/facts.json)

## [Meta: Llama 3.1 70B Instruct](https://ailoot.ai/models/en/meta-llama-llama-3-1-70b-instruct/)

Llama 3.1 70B Instruct is Meta's text model for multilingual dialogue, document reasoning and code. Its 70B instruction-tuned release uses grouped-query attention, a 128k maker context and documented tool-call conversation formats, with text and code output.

- [**Ailoot Ultra · OpenAI Chat** `POST /v1/chat/completions` `meta-llama/llama-3.1-70b-instruct`](https://ailoot.ai/models/en/meta-llama-llama-3-1-70b-instruct/#method-0)
- [**Ailoot Ultra · Anthropic Messages** `POST /v1/messages` `meta-llama/llama-3.1-70b-instruct`](https://ailoot.ai/models/en/meta-llama-llama-3-1-70b-instruct/#method-1)

About the model

This description covers the model’s capabilities. Available in Ailoot inputs, outputs and options are listed for the selected method below.

Llama 3.1 70B Instruct is Meta's 70-billion-parameter text model optimized for multilingual dialogue and assistant-like requests. It is an instruction-tuned checkpoint within a family that also includes 8B and 405B sizes and separate pretrained models. It accepts text and returns multilingual text or code; the named 70B edition retains its own size and identity.

Model information and training

The release uses an autoregressive Transformer architecture with grouped-query attention. The tuned models are aligned using supervised fine-tuning and reinforcement learning with human feedback. These are training stages for helpful conversational behavior, not a named runtime switch between separate reasoning and non-reasoning modes.

The maker documents a 128k context for the text models and officially supports English, German, French, Italian, Portuguese, Hindi, Spanish and Thai. Training includes a broader language collection, which does not make every language equally supported. Specify the output language, terminology and reader before asking for a multilingual artifact.

The family pretraining corpus is described as approximately fifteen trillion tokens, with a cutoff of December 2023. Fine-tuning includes instruction datasets and more than twenty-five million synthetic examples. The cutoff is a training-data boundary; a question depending on newer or private information needs that information supplied in the task or returned by a connected source.

Assistant-like chat and source analysis

The Instruct edition is intended to respond to a conversational request, while the pretrained version is a foundation that can be adapted for other generation tasks. For a source-based answer, provide the question and the passages that determine the result. Label the sources and ask for the supporting section or statement beside each finding.

A practical comparison can supply two procedures and request shared conditions, differences and unresolved conflicts. A resulting guide can retain the original sequence and the conditions under which each action applies. A document-editing task can specify the audience, the facts that must survive and whether the final artifact should be a revised passage alone or a passage with an explanation.

For a longer answer, name the required sections and the purpose of each. A large context can retain related material together while the final result remains a concise matrix or explanation. Source identities and a well-defined question matter more than simply including every available document.

Code and generated examples

The documented output includes code. For a proposed implementation, supply the language, input types, expected result and interface that must remain compatible. Include the existing fragment and relevant declarations when the task is a correction. Request the code separately from its assumptions and examples so the next development step can inspect it.

For a code explanation, provide the input to trace and ask how the supplied function reaches the returned value. For a mathematical explanation, define symbols and assumptions and state whether the result should be exact, approximate or a proof. Code generation and written reasoning do not themselves compile a program or execute a calculation.

The maker also identifies synthetic data generation and distillation as family uses. A text task can request varied examples in a specified format, retaining the supplied rules. Whether those examples are suitable for further training is a separate application decision; the text output alone is not an independent verification of their correctness.

Conversation format and tools

The card demonstrates separate system and user messages with the matching chat template. Use the system instruction for role, tone and durable response rules, while the user request contains the actual problem and sources. Preserve relevant earlier messages when asking for a follow-up that builds on a prior answer.

Llama 3.1 supports multiple documented tool-use formats. The application supplies the functions and parameters, the model prepares a proposed call, the application executes it and appends its result to the conversation. A subsequent generation can use that result. The card's brief example explicitly shows adding the assistant's call and then the tool result; selecting a function is distinct from completing its operation.

For a lookup, state what information is required and define the function that returns it. Keep the actual returned value with the originating call before asking for the final explanation. For a calculation, distinguish the model's proposed operation from the result returned by the calculator. Native tool formatting and a wrapper interface's visible representation should retain their own documented conventions.

Edition and practical limits

The read card's 256-token generation setting is a usage example rather than an independently stated maximum output capacity. The 128k context concerns the material and generated conversation within the configured release. Do not substitute the context or visual capabilities of Llama 4 or the size of another Llama 3.1 checkpoint.

This is a text-only Instruct model. An image, recording or video needs its relevant content prepared through another component. External retrieval, program execution and file changes likewise belong to the application connected to the assistant. Preserve the exact 70B Instruct edition and request the source-linked explanation, revised document, code or structured text needed by the task.

Practical task

### Produce a bilingual maintenance notice

Technical example in English

```
Produce a bilingual maintenance notice

Write a maintenance notice in English and Spanish from these facts: warehouse entrance B closes on Tuesday from 08:00 to 11:00; deliveries must use entrance A; pedestrian access is unchanged. Use three short sentences per language and preserve entrance letters and times. Do not add a date, delay estimate or closure of pedestrian access.
```

#### Expected result

```
Two labelled language blocks with equivalent three-sentence notices.
```

#### Check the result

```
Compare both versions for entrance A/B, Tuesday, the time range and unchanged pedestrian access.
```

**Ailoot Ultra · OpenAI Chat** `POST /v1/chat/completions` `meta-llama/llama-3.1-70b-instruct`

[`meta-llama/llama-3.1-70b-instruct`](https://ailoot.ai/models/en/#m=meta-llama%2Fllama-3.1-70b-instruct&route=Ultra&caller=meta-llama%2Fllama-3.1-70b-instruct&fmt=chat)

Meta /`meta-llama/llama-3.1-70b-instruct`

### Overview

Llama 3.1 70B Instruct is Meta's text model for multilingual dialogue, document reasoning and code. Its 70B instruction-tuned release uses grouped-query attention, a 128k maker context and documented tool-call conversation formats, with text and code output.

Accepted inputs

Text

Results

Text

### Available in Ailoot · inputs & methods

**Ailoot Ultra · OpenAI Chat** `POST /v1/chat/completions`

Input types

`text`

Output types

`text`

Output format

json or SSE

| Field | Type | Requirement | Values & limits | Default |
| --- | --- | --- | --- | --- |
| Field`model` | Type`string` | RequirementRequired | Values & limits meta-llama/llama-3.1-70b-instruct | Default— |
| Field`messages` | Type`message[]` | RequirementRequired | Values & limits Minimum items: 1 | Default— |
| Field`messages[].role` | Type`string` | RequirementRequired | Values & limits Examples: system, user, assistant, tool, function Conditions: These roles are explicitly represented by Source compatibility types; the exact model role set remains model-specific. Model-specific | Default— |
| Field`messages[].content` | Type`string\|content_part[]\|null` | RequirementOptional | Values & limits | Default— |
| Field`messages[].tool_calls` | Type`tool_call[]` | RequirementOptional | Values & limits | Default— |
| Field`messages[].tool_call_id` | Type`string` | RequirementOptional | Values & limits Applies when: role=tool; use actual returned ID | Default— |
| Field`messages[].name` | Type`string` | RequirementOptional | Values & limits | Default— |
| Field`messages[].reasoning_content` | Type`string` | RequirementOptional | Values & limits Applies when: Round-trip actual returned reasoning where this model uses it | Default— |
| Field`messages[].reasoning_details` | Type`object\|array` | RequirementOptional | Values & limits Model-specific | Default— |
| Field`max_tokens` | Type`integer` | RequirementOptional | Values & limits Minimum: 1 Model-specific | Default— |
| Field`max_completion_tokens` | Type`integer` | RequirementOptional | Values & limits Minimum: 1 Model-specific | Default— |
| Field`stream` | Type`boolean` | RequirementOptional | Values & limits | Defaultfalse |
| Field`stream_options.include_usage` | Type`boolean` | RequirementOptional | Values & limits Model-specific | Default— |
| Field`temperature` | Type`number` | RequirementOptional | Values & limits Model-specific | Default— |
| Field`top_p` | Type`number` | RequirementOptional | Values & limits Model-specific | Default— |
| Field`stop` | Type`string\|string[]` | RequirementOptional | Values & limits Model-specific | Default— |
| Field`tools` | Type`function_tool[]` | RequirementOptional | Values & limits Model-specific | Default— |
| Field`tools[].type` | Type`string` | RequirementOptional | Values & limits function Model-specific | Default— |
| Field`tools[].function.name` | Type`string` | RequirementRequired | Values & limits Applies when: function tool supplied | Default— |
| Field`tools[].function.description` | Type`string` | RequirementOptional | Values & limits | Default— |
| Field`tools[].function.parameters` | Type`JSON_schema` | RequirementOptional | Values & limits | Default— |
| Field`tool_choice` | Type`string\|object` | RequirementOptional | Values & limits Model-specific | Default— |
| Field`parallel_tool_calls` | Type`boolean` | RequirementOptional | Values & limits Model-specific | Default— |
| Field`response_format` | Type`object` | RequirementOptional | Values & limits Model-specific | Default— |
| Field`reasoning_effort` | Type`string` | RequirementOptional | Values & limits Model-specific | Default— |
| Field`reasoning` | Type`object` | RequirementOptional | Values & limits Model-specific | Default— |
| Field`service_tier` | Type`string` | RequirementOptional | Values & limits Model-specific | Default— |
| Field`instructions` | Type`string` | RequirementOptional | Values & limits Compatibility field | Default— |
| Field`functions` | Type`function[]` | RequirementOptional | Values & limits Model-specific | Default— |
| Field`function_call` | Type`string\|object` | RequirementOptional | Values & limits Model-specific | Default— |
| Field`prompt_cache_options` | Type`object` | RequirementOptional | Values & limits Model-specific | Default— |
| Field`modalities` | Type`string[]` | RequirementOptional | Values & limits text | Default— |
| Field`provider` | Type`object` | RequirementOptional | Values & limits Conditions: provider.options is rejected on this Ultra text route | Default— |
| Field`cache_control.ttl` | Type`string` | RequirementOptional | Values & limits Conditions: 1h is rejected in actual prompt-cache locations | Default— |

Input material combinations

**Text** · UTF8 text

`messages[].content`

Method parameters and lifecycle

| Parameter | Contract |
| --- | --- |
| Parameter`content_type` | Contractapplication/json |
| Parameter`required` | Contractmodel, messages |
| Parameter`material_types` | Contracttext |
| Parameter`messages` | Contractmessage array with role/content shape |
| Parameter`file_material` | Contractactual UTF-8 document inserted as literal text; no file ID inferred |
| Parameter`optional_controls` | Contractstream, temperature, top\_p, stop, max\_tokens, max\_completion\_tokens, reasoning, response\_format, tools, tool\_choice |
| Parameter`control_scope` | Contractmodel-specific; user function tools differ from hosted tools |
| Parameter`output_modalities` | Contracttext |
| Parameter`hosted_operations` | Contractfalse |
| Parameter`multimodal_input_binding` | Contractnull |

Lifecycle: `synchronous_or_streamed`

Send exact model ID with messages.

Context length is not an output cap.

A text file may supply literal text; image/audio/file-object inputs need exact binding.

### Pricing

Tariff references do not add request options. Supported parameters are listed for the selected method.

Fast mode

Standard rate When fast mode is selected

Flex mode

Standard rate When flex mode is selected

Maximum reasoning effort

Standard rate When maximum reasoning effort uses the default adjustment

#### Ailoot rates

#### Prices by configuration

Match each charge to the conditions shown. Use one rate for each set of alternative configurations.

| Configuration | Rate schedule | Context tokens, more than | Context tokens, up to and including | Charge |
| --- | --- | --- | --- | --- |
| ConfigurationBase token rates | Rate scheduleBase rate | Context tokens, more than— | Context tokens, up to and includingNo upper bound | Charge Input · Input tokens **$0.00144** / 1K tokens Output · Output tokens **$0.00144** / 1K tokens Input · Cache read **—** / 1K tokens Input · Cache write **—** / 1K tokens Input · Cache write, 1 hour **—** / 1K tokens |
| ConfigurationRequest-length tier 1 | Rate schedule— | Context tokens, more than0 | Context tokens, up to and includingNo upper bound | Charge Input · Input tokens **$0.00144** / 1K tokens Output · Output tokens **$0.00144** / 1K tokens Input · Cache read **—** / 1K tokens Input · Cache write **—** / 1K tokens Input · Cache write, 1 hour **—** / 1K tokens |

Ailoot reserves an estimated amount before a request. After the result, it settles the final charge from measured usage. Streaming settlement uses the final usage record. [How reservation and settlement work →](https://ailoot.ai/docs/en/billing/reserve/)

### Example requests

#### Ailoot Ultra · OpenAI Chat

curlPython SDKPython stream

```bash
set -eu
: "${AILOOT_API_KEY:?Set your Ailoot API key}"
python3 - <<'PY_REQUEST'
import json,os
from pathlib import Path
p=json.loads('{"model": "meta-llama/llama-3.1-70b-instruct", "messages": [{"role": "user", "content": "Explain the difference between an observation and a hypothesis in three sentences."}]}')

Path("request.json").write_text(json.dumps(p,ensure_ascii=False))
PY_REQUEST
curl --fail-with-body --silent --show-error https://api.ailoot.ai/v1/chat/completions \
  -H "Authorization: Bearer $AILOOT_API_KEY" -H 'Content-Type: application/json' \
  --data-binary @request.json -D response-headers.txt -o result.json
python3 - <<'PY_RESULT'
import json
from pathlib import Path
r=json.loads(Path("result.json").read_text())
for x in r.get("choices",[]):
    if x.get("message",{}).get("content"): print(x["message"]["content"])
PY_RESULT
```

```python
from openai import OpenAI
import os

if not os.environ.get("AILOOT_API_KEY", "").strip(): raise SystemExit("Set AILOOT_API_KEY before making a request")
client=OpenAI(base_url="https://api.ailoot.ai/v1",api_key=os.environ["AILOOT_API_KEY"],max_retries=0)
result=client.chat.completions.create(model='meta-llama/llama-3.1-70b-instruct',messages=[{"role":"user","content":"Explain observations and hypotheses in three sentences."}])
import base64, json
from pathlib import Path

def save_result(data, stem="result"):
    # Keep every field, including usage, IDs, reasoning and tool requests.
    Path(stem + ".json").write_text(json.dumps(data, ensure_ascii=False, indent=2), encoding="utf-8")
    print(json.dumps(data, ensure_ascii=False, indent=2))
    def save_blob(encoded, suffix, label):
        raw = base64.b64decode(encoded, altchars=b"-_", validate=True)
        ext = "png" if raw.startswith(b"\x89PNG\r\n\x1a\n") else "jpg" if raw.startswith(b"\xff\xd8") else "webp" if raw[:4] == b"RIFF" and raw[8:12] == b"WEBP" else suffix
        file = Path(stem + "-" + label + "." + ext)
        file.write_bytes(raw)
        print("Saved", file)
    for index, block in enumerate(data.get("content") or []):
        print("Content", index, json.dumps(block, ensure_ascii=False))
    for choice in data.get("choices") or []:
        print("Choice", choice.get("index"), json.dumps(choice.get("message", choice.get("delta", {})), ensure_ascii=False))
    for index, item in enumerate(data.get("output") or []):
        print("Output", index, json.dumps(item, ensure_ascii=False))
        if item.get("type") == "image_generation_call" and item.get("result"):
            save_blob(item["result"], item.get("output_format") or "bin", "output-" + str(index))
    for ci, candidate in enumerate(data.get("candidates") or []):
        for pi, part in enumerate((candidate.get("content") or {}).get("parts") or []):
            print("Candidate/part", ci, pi, json.dumps(part, ensure_ascii=False))
            blob = part.get("inlineData") or part.get("inline_data")
            if blob and blob.get("data"):
                mime = blob.get("mimeType") or blob.get("mime_type")
                suffix = {"image/png":"png", "image/jpeg":"jpg", "image/webp":"webp", "audio/wav":"wav", "audio/mpeg":"mp3", "video/mp4":"mp4"}.get(mime, "bin")
                save_blob(blob["data"], suffix, "candidate-" + str(ci) + "-part-" + str(pi))

save_result(result.to_dict(mode="json"))
```

```python
from openai import OpenAI
import os
from pathlib import Path

if not os.environ.get("AILOOT_API_KEY", "").strip(): raise SystemExit("Set AILOOT_API_KEY before making a request")
client=OpenAI(base_url="https://api.ailoot.ai/v1",api_key=os.environ["AILOOT_API_KEY"],max_retries=0)
import base64, json
from pathlib import Path

def save_result(data, stem="result"):
    # Keep every field, including usage, IDs, reasoning and tool requests.
    Path(stem + ".json").write_text(json.dumps(data, ensure_ascii=False, indent=2), encoding="utf-8")
    print(json.dumps(data, ensure_ascii=False, indent=2))
    def save_blob(encoded, suffix, label):
        raw = base64.b64decode(encoded, altchars=b"-_", validate=True)
        ext = "png" if raw.startswith(b"\x89PNG\r\n\x1a\n") else "jpg" if raw.startswith(b"\xff\xd8") else "webp" if raw[:4] == b"RIFF" and raw[8:12] == b"WEBP" else suffix
        file = Path(stem + "-" + label + "." + ext)
        file.write_bytes(raw)
        print("Saved", file)
    for index, block in enumerate(data.get("content") or []):
        print("Content", index, json.dumps(block, ensure_ascii=False))
    for choice in data.get("choices") or []:
        print("Choice", choice.get("index"), json.dumps(choice.get("message", choice.get("delta", {})), ensure_ascii=False))
    for index, item in enumerate(data.get("output") or []):
        print("Output", index, json.dumps(item, ensure_ascii=False))
        if item.get("type") == "image_generation_call" and item.get("result"):
            save_blob(item["result"], item.get("output_format") or "bin", "output-" + str(index))
    for ci, candidate in enumerate(data.get("candidates") or []):
        for pi, part in enumerate((candidate.get("content") or {}).get("parts") or []):
            print("Candidate/part", ci, pi, json.dumps(part, ensure_ascii=False))
            blob = part.get("inlineData") or part.get("inline_data")
            if blob and blob.get("data"):
                mime = blob.get("mimeType") or blob.get("mime_type")
                suffix = {"image/png":"png", "image/jpeg":"jpg", "image/webp":"webp", "audio/wav":"wav", "audio/mpeg":"mp3", "video/mp4":"mp4"}.get(mime, "bin")
                save_blob(blob["data"], suffix, "candidate-" + str(ci) + "-part-" + str(pi))

with client.chat.completions.stream(model='meta-llama/llama-3.1-70b-instruct',messages=[{"role":"user","content":"Explain observations and hypotheses in three sentences."}]) as stream:
    with Path("stream-events.jsonl").open("w",encoding="utf-8") as log:
        for event in stream:
            payload=event.to_dict(mode="json")
            log.write(json.dumps(payload,ensure_ascii=False)+"\n"); log.flush()
            print(json.dumps(payload,ensure_ascii=False))
    final=stream.get_final_completion()
    save_result(final.to_dict(mode="json"),"stream-result")
```

### Receive and save results

#### Ailoot Ultra · OpenAI Chat

json or SSE

##### Keep all completed results

Keep every complete returned response, file and content part.

Keep every choice and its content/tool calls/reasoning. In SSE assemble deltas by choice/tool index, retain the final finish reason and usage.

##### If the original response needs checking

Keep request/response IDs and headers. No generic text job retrieval URL is supplied.

Response fields

| Field | Type |
| --- | --- |
| Field`choices[].index` | Typeinteger |
| Field`choices[].message.content` | Typestring\|null |
| Field`choices[].message.tool_calls` | Typetool\_call\[\] |
| Field`choices[].message.reasoning_content` | Typestring |
| Field`choices[].message.reasoning_details` | Typeobject\|array |
| Field`choices[].finish_reason` | Typestring\|null |
| Field`usage` | Typeobject |

Errors and next steps

| Response | Condition | Next step |
| --- | --- | --- |
| Response400 · `invalid_request_error` | ConditionInvalid required fields, material representation or parameter value | Next stepCorrect the indicated fields before a new creation request. |

### Aliases

#### Model aliases

**Ailoot Ultra** [`meta-llama/llama-3.1-70b-instruct`](https://ailoot.ai/models/en/#m=meta-llama%2Fllama-3.1-70b-instruct&route=Ultra&caller=meta-llama%2Fllama-3.1-70b-instruct&fmt=chat)

#### Method path aliases

Use the method paths shown above.

#### Related caller IDs

[`meta-llama/llama-3.1-70b-instruct`](https://ailoot.ai/models/en/#m=meta-llama%2Fllama-3.1-70b-instruct&route=Ultra&caller=meta-llama%2Fllama-3.1-70b-instruct&fmt=chat)

**Ailoot Ultra · Anthropic Messages** `POST /v1/messages` `meta-llama/llama-3.1-70b-instruct`

[`meta-llama/llama-3.1-70b-instruct`](https://ailoot.ai/models/en/#m=meta-llama%2Fllama-3.1-70b-instruct&route=Ultra&caller=meta-llama%2Fllama-3.1-70b-instruct&fmt=messages)

Meta /`meta-llama/llama-3.1-70b-instruct`

### Overview

Llama 3.1 70B Instruct is Meta's text model for multilingual dialogue, document reasoning and code. Its 70B instruction-tuned release uses grouped-query attention, a 128k maker context and documented tool-call conversation formats, with text and code output.

Accepted inputs

Text

Results

json · sse

### Available in Ailoot · inputs & methods

**Ailoot Ultra · Anthropic Messages** `POST /v1/messages`

Input types

`text`

Output types

`json`, `sse`

Output format

JSON or SSE

| Field | Type | Requirement | Values & limits | Default |
| --- | --- | --- | --- | --- |
| Field`model` | Type`string` | RequirementRequired | Values & limits meta-llama/llama-3.1-70b-instruct | Default— |
| Field`messages` | Type`message[]` | RequirementRequired | Values & limits | Default— |
| Field`messages[].role` | Type`string` | RequirementRequired | Values & limits user, assistant | Default— |
| Field`messages[].content` | Type`string` | RequirementRequired | Values & limits | Default— |
| Field`max_tokens` | Type`integer` | RequirementRequired | Values & limits | Default— |
| Field`stream` | Type`boolean` | RequirementOptional | Values & limits | Defaultfalse |

Input material combinations

**Text** · UTF-8 text

`messages[].content string`

Method parameters and lifecycle

| Parameter | Contract |
| --- | --- |
| Parameter`content_type` | Contractapplication/json |
| Parameter`required` | Contractmodel, messages, max\_tokens |
| Parameter`optional_controls` | Contractstream |
| Parameter`material_types` | Contracttext |
| Parameter`text_file_material` | ContractRead the actual UTF-8 document and put its text in the indicated input or message content string. |

Lifecycle: `synchronous_or_streamed`

### Pricing

Tariff references do not add request options. Supported parameters are listed for the selected method.

Fast mode

Standard rate When fast mode is selected

Flex mode

Standard rate When flex mode is selected

Maximum reasoning effort

Standard rate When maximum reasoning effort uses the default adjustment

#### Ailoot rates

#### Prices by configuration

Match each charge to the conditions shown. Use one rate for each set of alternative configurations.

| Configuration | Rate schedule | Context tokens, more than | Context tokens, up to and including | Charge |
| --- | --- | --- | --- | --- |
| ConfigurationBase token rates | Rate scheduleBase rate | Context tokens, more than— | Context tokens, up to and includingNo upper bound | Charge Input · Input tokens **$0.00144** / 1K tokens Output · Output tokens **$0.00144** / 1K tokens Input · Cache read **—** / 1K tokens Input · Cache write **—** / 1K tokens Input · Cache write, 1 hour **—** / 1K tokens |
| ConfigurationRequest-length tier 1 | Rate schedule— | Context tokens, more than0 | Context tokens, up to and includingNo upper bound | Charge Input · Input tokens **$0.00144** / 1K tokens Output · Output tokens **$0.00144** / 1K tokens Input · Cache read **—** / 1K tokens Input · Cache write **—** / 1K tokens Input · Cache write, 1 hour **—** / 1K tokens |

Ailoot reserves an estimated amount before a request. After the result, it settles the final charge from measured usage. Streaming settlement uses the final usage record. [How reservation and settlement work →](https://ailoot.ai/docs/en/billing/reserve/)

### Example requests

#### Ailoot Ultra · Anthropic Messages

Complete minimal JSON bodycurl · use your UTF-8 documentPython · save the complete result

```json
{
  "model": "meta-llama/llama-3.1-70b-instruct",
  "max_tokens": 128,
  "messages": [
    {
      "role": "user",
      "content": "Summarize the incident report."
    }
  ],
  "stream": false
}
```

```bash
set -eu
: "${AILOOT_API_KEY:?Set your Ailoot API key}"
: "${AILOOT_TEXT_FILE:?Set your actual UTF-8 document}"
export AILOOT_TEXT_FILE
python3 - <<'PY_REQUEST'
import json, os
from pathlib import Path

source_file = Path(os.environ['AILOOT_TEXT_FILE'])
if not source_file.is_file():
    raise SystemExit('Set AILOOT_TEXT_FILE to your actual UTF-8 document')
text = source_file.read_text(encoding='utf-8')
if not text.strip():
    raise SystemExit('Choose a document containing text')
payload = {'model': 'meta-llama/llama-3.1-70b-instruct', 'max_tokens': 128, 'messages': [{'role': 'user', 'content': 'Summarize the incident report.'}]}
payload['messages'][0]['content'] = 'Summarize this material and quote supporting source passages.\n\n' + text
Path('request.json').write_text(json.dumps(payload, ensure_ascii=False), encoding='utf-8')
PY_REQUEST
curl --fail-with-body --silent --show-error https://api.ailoot.ai/v1/messages \
  -H "x-api-key: $AILOOT_API_KEY" -H 'anthropic-version: 2023-06-01' -H 'Content-Type: application/json' \
  --data-binary @request.json -D response-headers.txt -o result.json
python3 - <<'PY_RESULT'
import json
from pathlib import Path

result = json.loads(Path('result.json').read_text(encoding='utf-8'))
print(json.dumps(result, ensure_ascii=False, indent=2))
PY_RESULT
```

```python
import json, os
from pathlib import Path

source_file = Path(os.environ['AILOOT_TEXT_FILE'])
if not source_file.is_file():
    raise SystemExit('Set AILOOT_TEXT_FILE to your actual UTF-8 document')
text = source_file.read_text(encoding='utf-8')
if not text.strip():
    raise SystemExit('Choose a document containing text')
payload = {'model': 'meta-llama/llama-3.1-70b-instruct', 'max_tokens': 128, 'messages': [{'role': 'user', 'content': 'Summarize the incident report.'}]}
payload['messages'][0]['content'] = 'Summarize this material and quote supporting source passages.\n\n' + text
from urllib.request import Request, urlopen
from urllib.error import HTTPError

api_key = os.environ['AILOOT_API_KEY']
if not api_key.strip():
    raise SystemExit('Set AILOOT_API_KEY before making a request')
headers = {'x-api-key': 'PLACEHOLDER_KEY', 'anthropic-version': '2023-06-01', 'Content-Type': 'application/json'}
headers['x-api-key'] = api_key
request = Request('https://api.ailoot.ai/v1/messages', data=json.dumps(payload, ensure_ascii=False).encode('utf-8'), headers=headers, method='POST')
try:
    with urlopen(request, timeout=120) as response:
        raw = response.read()
        Path('response-headers.txt').write_text(str(response.headers), encoding='utf-8')
except HTTPError as error:
    Path('result.json').write_bytes(error.read())
    Path('response-headers.txt').write_text(str(error.headers), encoding='utf-8')
    raise
Path('result.json').write_bytes(raw)
import json
from pathlib import Path

result = json.loads(Path('result.json').read_text(encoding='utf-8'))
print(json.dumps(result, ensure_ascii=False, indent=2))
```

### Receive and save results

#### Ailoot Ultra · Anthropic Messages

JSON or SSE

##### Keep all completed results

Keep every complete returned response, file and content part.

Keep all content blocks, thinking signatures and actual tool-use IDs. Assemble all SSE block deltas; a first text block is not the complete output.

##### If the original response needs checking

Keep request/response IDs and headers. No generic text job retrieval URL is supplied.

Response fields

| Field | Type |
| --- | --- |
| Field`id` | Typestring |
| Field`model` | Typestring |
| Field`content[]` | Typetext\|thinking\|tool\_use\|other content block |
| Field`stop_reason` | Typestring\|null |
| Field`usage` | Typeobject |

Errors and next steps

| Response | Condition | Next step |
| --- | --- | --- |
| Response400 · `invalid_request_error` | ConditionInvalid required fields, material representation or parameter value | Next stepCorrect the indicated fields before a new creation request. |

### Aliases

#### Model aliases

**Ailoot Ultra** [`meta-llama/llama-3.1-70b-instruct`](https://ailoot.ai/models/en/#m=meta-llama%2Fllama-3.1-70b-instruct&route=Ultra&caller=meta-llama%2Fllama-3.1-70b-instruct&fmt=messages)

#### Method path aliases

Use the method paths shown above.

#### Related caller IDs

[`meta-llama/llama-3.1-70b-instruct`](https://ailoot.ai/models/en/#m=meta-llama%2Fllama-3.1-70b-instruct&route=Ultra&caller=meta-llama%2Fllama-3.1-70b-instruct&fmt=messages)

FAQ · Meta: Llama 3.1 70B Instruct

What inputs and results are available?

`POST /v1/chat/completions` · `meta-llama/llama-3.1-70b-instruct`: `text` → `text` `POST /v1/messages` · `meta-llama/llama-3.1-70b-instruct`: `text` → `json`, `sse`

Which fields does the request use?

`POST /v1/chat/completions` · `meta-llama/llama-3.1-70b-instruct`: `model`, `messages`, `stream`, `modalities`, `provider` `POST /v1/messages` · `meta-llama/llama-3.1-70b-instruct`: `model`, `messages`, `max_tokens`, `stream`

What limits apply?

`POST /v1/chat/completions` · `meta-llama/llama-3.1-70b-instruct`: `messages.min_items`: `1`

Connect Ailoot to Claude Code, OpenCode, Hermes or your own app.

## The company and its project portfolio

The company and its project portfolio: millions of customers; monthly sales in the billions.

## Buy tokens at a discount.

Subscription discounts for regular use. Promo codes offer up to 50% off token purchases.

Subscription

Choose a discounted plan for your regular requests.

Promo code: up to 50% off

Enter your code at checkout. The price updates to reflect the current promotion.

Spending in your history

The model, tokens and amount are recorded for each request.

[Choose a subscription](https://ailoot.ai/docs/en/billing/subscriptions/) · [View model prices](https://ailoot.ai/models/en/)

## Connect the API to a product you sell.

Use Ailoot in SaaS, apps and bots under its official service offer and licence agreement. Request a reseller licence for resale.

Commercial application

Add text, image, video and audio generation to paid features in your service.

Reseller licence

Send a description of your project and how you provide access. Request written terms for use and resale.

Documents on the website

The service offer, licence agreement and data processing policy are available before you connect.

[Request a reseller licence](mailto:support@ailoot.ai) · [Service offer and licence agreement](https://ailoot.ai/legal/offer?lang=en)

## Ailoot · The company and its project portfolio





Ailoot combines established operating experience, a large client base, stable service and ongoing KPI control.





The company and its project portfolio: millions of customers; monthly sales in the billions.





Ailoot brings that operating experience to API access for AI features in customer products, agents, applications and automations.