Skip to content

CHAT COMPLETIONS API

One API, every chat model.

Switch chat models by changing one parameter. DeepSeek, Llama, Qwen, Gemma and Mistral behind one OpenAI-compatible endpoint, with streaming, function calling and JSON mode.

Hand this to your agent

Add a Runcrate model to this project: run curl -fsSL"https://runcrate.ai/agents.md?intent=build"and follow it.

Your agent asks for an API key. Create a key

Works inClaude CodeCodexOpenCodeClineRoo CodeKilo CodeCursor
ModelsOpen-weight
StreamingServer-sent events
Endpoint/v1/chat/completions

Quick start

Hand it to your agent. Or read the request it sends.

Your agent writes and runs it. The same key works for every model and every GPU.

Docs
Run prompts.jsonl through DeepSeek V3 and Llama 4 Scout on Runcrate and save both answers side by side. Runs curl https://api.runcrate.ai/v1/chat/completions \ -H "Authorization: Bearer rc_live_YOUR_API_KEY" \ -H "Content-Type: application/json" \ -d '{ "model": "deepseek-ai/DeepSeek-V3", "messages": [ {"role": "system", "content": "You are a helpful assistant."}, {"role": "user", "content": "How should I design an API?"} ] }'.

Available models

Models you can call today. Billed prices, as charged.

ModelMakerPriceDetail
meta-llama/Llama-4-Scout-17B-16E-InstructMeta$0.105 in, $0.315 out per 1M tokens17B MoE, 128K context
google/gemma-3-27b-itGoogle$0.084 in, $0.168 out per 1M tokens27B, instruction-tuned
See every model price

Why Runcrate

Built for production. One key, one balance.

  • Streaming support

    Server-sent events for real-time token streaming. Build chat interfaces that render tokens as they arrive.

  • Function calling

    Standard OpenAI tools format for structured function calls. Build AI agents that interact with your APIs and databases.

  • JSON mode

    Force structured JSON output from any model. Reliable for data extraction, form filling, and API integrations.

  • Multi-provider

    One API key and one balance across many model makers. Compare models side by side and switch without re-integrating.

FAQ

Common questions.