Providers Overview

​

Configuring providers without env vars

​

Supported providers

​

Provider notes

• Z.ai GLM Coding Plan — set ZAI_BASE_URL=https://api.z.ai/api/coding/paas/v4.
• MiniMax regions and current text models — the default global endpoint is https://api.minimax.io/v1; accounts on the China platform should set MINIMAX_BASE_URL=https://api.minimaxi.com/v1. The current text model IDs are MiniMax-M3 (1,000,000-token context; text, image, and video input) and MiniMax-M2.7 (204,800-token context; text input). Per-million-token USD pricing is $0.60 input,$2.40 output, and $0.12 cached input for M3, and$0.30 input, $1.20 output,$0.06 cached input, and $0.375 cache writes for M2.7. M3 supports adaptive or disabled thinking; M2.7 always thinks.
• Amazon Bedrock Mantle — GPT-5.6 Sol, Terra, and Luna accept only the Responses API on Mantle. GoModel sends /v1/responses requests directly to AWS and selects the required /openai/v1/responses upstream path.
• Fireworks AI — model IDs are account-scoped paths such as accounts/fireworks/models/gpt-oss-120b; use them verbatim in requests and in FIREWORKS_MODELS.
• Meta (Muse Spark) — the Meta Model API is OpenAI-compatible; set META_API_KEY and route to muse-spark-1.1. Muse Spark models are not in the upstream model catalog yet, so declare context_window and pricing under providers.meta.models metadata in config.yaml if you want cost tracking and context-window reporting.
• Kilo AI — model IDs use provider/model (for example, anthropic/claude-sonnet-4.5) and are forwarded unchanged. GoModel serves /v1/responses by translating it to Kilo’s chat-completions endpoint. If another configured provider exposes the same raw model ID, select Kilo explicitly with kilo/anthropic/claude-sonnet-4.5; GoModel removes only the outer kilo/ routing qualifier before forwarding.
• Xiaomi MiMo — TTS (mimo-v2.5-tts*) and ASR (mimo-v2.5-asr) are served through /v1/audio/speech and /v1/audio/transcriptions (translated to MiMo’s chat-completions audio dialect) as well as directly via chat completions; for 1M context append [1m] to the model ID and list it in XIAOMI_MODELS.
• OpenCode Go (OpenCode Zen) — routes per model: most models use OpenAI-style /chat/completions, while /messages-only models (default qwen3.7-max, override with OPENCODE_GO_MESSAGES_MODELS) are sent to the Anthropic-native endpoint. Set OPENCODE_GO_API_KEY; the base URL defaults to https://opencode.ai/zen/go/v1.
• Kimi Code — no per-token pricing; quota refreshes weekly and is also constrained by a rolling 5-hour window. Usage-cost tracking reports zero for Kimi Code, so cost load-balancing cannot price it; prefer conservative retry strategies.
• Configured model lists — available for every provider with <PROVIDER>_MODELS, for example OPENROUTER_MODELS=openai/gpt-oss-120b,anthropic/claude-sonnet-4 or ORACLE_MODELS=openai.gpt-oss-120b,xai.grok-3. DeepSeek defaults to https://api.deepseek.com; set DEEPSEEK_BASE_URL only when using a compatible proxy or alternate DeepSeek endpoint. By default, CONFIGURED_PROVIDER_MODELS_MODE=fallback uses those lists only when upstream /models is unavailable or empty. Set CONFIGURED_PROVIDER_MODELS_MODE=allowlist to expose only configured models for providers that define a list, skipping their upstream /models calls.
• vLLM — set VLLM_API_KEY only if the upstream server was started with --api-key.
• Multiple API keys for one provider — set OPENAI_API_KEY_2, OPENAI_API_KEY_3, and so on to spread sessions across keys while keeping each conversation on one key for prompt-cache affinity. See API key rotation.
• Multiple instances of one provider type — without config.yaml, use suffixed env vars such as OPENAI_EAST_API_KEY and OPENAI_EAST_BASE_URL; add OPENAI_EAST_MODELS to configure that instance’s model list. This registers provider openai-east with type openai. Vertex AI follows the same suffix pattern — VERTEX_US_PROJECT registers provider vertex-us. Vertex project and location env vars must match the instance prefix: for a suffixed instance such as VERTEX_US_PROJECT, also set VERTEX_US_LOCATION and any other suffixed settings for that instance, rather than the generic VERTEX_PROJECT / VERTEX_LOCATION. VERTEX_AUTH_TYPE defaults to Application Default Credentials (gcp_adc).

​

Why some providers have dedicated pages

• Google Vertex AI — needs a GCP project, region, and either Application Default Credentials or a service-account JSON key.
• Amazon Bedrock — no API key of its own; uses the AWS credential chain and requires explicit model access in the Bedrock console.
• Azure OpenAI — deployment-scoped base URLs, the api-version query parameter, and the api-key header instead of Authorization: Bearer.
• Oracle GenAI — requires an OCI IAM policy for generativeaiapikey and a region-specific OpenAI-compatible endpoint URL.
• Google Gemini (AI Studio) — two routing modes (native generateContent vs OpenAI-compatible) with different image-input behavior.
• Anthropic — reasoning effort maps to Claude’s adaptive thinking and effort control, which differ across model generations.
• DeepSeek — reasoning effort mapping quirks for DeepSeek V4.
• Ollama / vLLM — local-model hosting with optional multi-instance setup through suffixed env vars and provider-qualified model IDs.
• Xiaomi MiMo — thinking mode on by default, a [1m] context suffix, and TTS/ASR that run through chat completions rather than native audio endpoints.
• OpenCode Go — OpenCode Zen splits models across OpenAI-style /chat/completions and Anthropic-native /messages; GoModel routes per model (the /messages-only set is maintained manually, default qwen3.7-max).

​

Provider status

• Recent Requests — requests and errors through the gateway in the last 10 minutes.
• Breaker State — the provider’s live circuit-breaker state (see Resilience).
• Models (Recent Traffic) — per-model request/error counts. A model with at least 3 errors making up half or more of its windowed requests is flagged in red — this catches a single broken model on an otherwise healthy provider, which model discovery alone cannot see. Hover a row for the model’s latest error message.