Chat Completions

The Chat Completions API is the primary way to interact with language models through Routeway. Send a list of messages and receive a model-generated response. The endpoint is fully compatible with OpenAI’s /v1/chat/completions format, so any existing client or SDK works without changes.

Routeway supports the same request and response schema as the OpenAI Chat Completions API. Point your base URL to https://api.routeway.ai/v1 and you’re set.

New: Append @flux-2-turbo or @online to any model ID to generate images or search the web directly in chat — no client-side tool setup required. See Server Tools.

Quick Example

Python
Node.js
cURL

import os
from openai import OpenAI

client = OpenAI(
    base_url="https://api.routeway.ai/v1",
    api_key=os.getenv("ROUTEWAY_API_KEY")
)

response = client.chat.completions.create(
    model="gpt-4o-mini",
    messages=[
        {"role": "system", "content": "You are a helpful assistant."},
        {"role": "user", "content": "What is the capital of France?"}
    ]
)

print(response.choices[0].message.content)

import OpenAI from "openai";

const client = new OpenAI({
  baseURL: "https://api.routeway.ai/v1",
  apiKey: process.env.ROUTEWAY_API_KEY,
});

async function main() {
  const response = await client.chat.completions.create({
    model: "gpt-4o-mini",
    messages: [
      { role: "system", content: "You are a helpful assistant." },
      { role: "user", content: "What is the capital of France?" },
    ],
  });

  console.log(response.choices[0].message.content);
}

main().catch(console.error);

curl https://api.routeway.ai/v1/chat/completions \
  -H "Authorization: Bearer $ROUTEWAY_API_KEY" \
  -H "Content-Type: application/json" \
  -d '{
    "model": "gpt-4o-mini",
    "messages": [
      {"role": "system", "content": "You are a helpful assistant."},
      {"role": "user", "content": "What is the capital of France?"}
    ]
  }'

Response Shape

A successful response looks like this:

{
  "id": "chatcmpl-abc123",
  "object": "chat.completion",
  "created": 1718500000,
  "model": "gpt-4o-mini",
  "choices": [
    {
      "index": 0,
      "message": {
        "role": "assistant",
        "content": "The capital of France is Paris."
      },
      "finish_reason": "stop"
    }
  ],
  "usage": {
    "prompt_tokens": 24,
    "completion_tokens": 8,
    "total_tokens": 32
  }
}

Field	Description
`choices[0].message.content`	The model’s text response.
`choices[0].finish_reason`	Why the model stopped: `stop`, `length`, or `tool_calls`.
`usage`	Token counts for billing and monitoring.

Request Model

These are the most common fields you can include in a Chat Completions request:

Field	Type	Description
`model`	`string`	The model to use (e.g. `gpt-4o-mini`, `claude-sonnet-4-20250514`).
`messages`	`array`	The conversation history. Each message has a `role` and `content`.
`tools`	`array`	Function definitions the model can call. See Tool Calling.
`response_format`	`object`	Constrain output to JSON or a JSON Schema. See Structured Outputs.
`stream`	`boolean`	Return tokens incrementally via SSE. See Streaming.
`stream_options`	`object`	Options for streaming (e.g. `include_usage`).
`reasoning_effort`	`string`	Control thinking depth for reasoning models. See Reasoning.
`service_tier`	`string`	Choose processing tier (`default`, `flex`, or `priority`) on supported OpenAI and Gemini models. See Service Tiers.

Learn More

Streaming

Receive tokens as they are generated for real-time output.

Tool Calling

Let the model invoke functions and external tools.

Server Tools

Use image generation and online search via model tag syntax.

Structured Outputs

Constrain responses to JSON or a specific schema.

Reasoning

Use extended thinking for complex multi-step problems.

Multimodal Inputs

Send images and other media alongside text messages.

Caching

Reduce costs and latency with prompt caching.

Service Tiers

Trade cost for speed with flex and priority processing.

Presets

Apply reusable configurations to your requests.

Get Started

Platform Details

Help & Resources

Core Concepts

Account Management

Guides

Quick Example

Response Shape

Request Model

Learn More

Streaming

Tool Calling

Server Tools

Structured Outputs

Reasoning

Multimodal Inputs

Caching

Service Tiers

Presets

​Quick Example

​Response Shape

​Request Model

​Learn More

Streaming

Tool Calling

Server Tools

Structured Outputs

Reasoning

Multimodal Inputs

Caching

Service Tiers

Presets

Quick Example

Response Shape

Request Model

Learn More