Large Language Models

Model capabilities

Large Language Models (LLMs) on Bitdeer AI are accessed through the Chat Completions HTTP API (POST /v1/chat/completions). They support:

• Text Generation — Generate coherent, contextual text for any task
• Code Generation — Write, explain, and debug code in Python, JavaScript, and 30+ languages
• Summarization & Translation — Condense documents or translate between languages
• Multi-turn Conversation — Maintain context across multiple user/assistant exchanges
• Tool Use — Call external functions and APIs via Function Calling

Available models

See the full list in the Model Catalog.

API integration

Use the API Reference for request and response fields. In short:

1. Base URL: https://api-inference.bitdeer.ai/v1
2. Send Authorization: Bearer <your Bitdeer key>

The snippet below uses the Python helper from SDKs; the same call is a JSON POST over HTTPS.

from openai import OpenAI

client = OpenAI(
    base_url="https://api-inference.bitdeer.ai/v1",
    api_key="YOUR_BITDEER_API_KEY",
)

response = client.chat.completions.create(
    model="deepseek-ai/DeepSeek-V4-Pro",
    messages=[
        {"role": "system", "content": "You are a helpful assistant."},
        {"role": "user", "content": "What is serverless inference?"},
    ],
    stream=True,
    max_tokens=512,
)

for chunk in response:
    print(chunk.choices[0].delta.content or "", end="")

Feature guides

Key parameters