Skip to content

SERVERLESS INFERENCE

GPU inference, zero infrastructure.

Send requests to models that are already serving: no GPU instances, CUDA versions or autoscaling to manage. Billed per token, image or second of output.

Hand this to your agent

Add a Runcrate model to this project: run curl -fsSL"https://runcrate.ai/agents.md?intent=build"and follow it.

Your agent asks for an API key. Create a key

Works inClaude CodeCodexOpenCodeClineRoo CodeKilo CodeCursor
ModelsOpen models, one API
BillingPer token, image, second
ModalitiesChat, image, video, audio

Available GPUs

GPUs you can launch today. Billed prices, as charged.

NameMakerPriceDetail
meta-llama/Llama-4-Scout-17B-16E-InstructMeta$0.105 in, $0.315 out per 1M tokens17B MoE, 128K context
black-forest-labs/FLUX.1-devBlack Forest Labs$0.0313 per image12B, photorealistic images
openai/whisper-large-v3OpenAI$0.000473 per minuteSpeech-to-text, 100+ languages
See every GPU price

Why Runcrate

Built for production. One key, one balance.

  • Zero infrastructure

    No GPU provisioning, no Docker containers, no autoscaling policies, no CUDA debugging. Send a request, get a result. Runcrate handles everything else.

  • Nothing to load

    The models are already serving. No container spin-up or weight downloads on your side: send the request and read the result.

  • Per-usage billing

    Pay per token, per image, per second of audio, or per second of video. No idle GPU costs, no monthly minimums, no seat licenses.

  • Multi-Modal

    Chat, image generation, video generation, speech-to-text, text-to-speech, embeddings, and vision, all through one API and one billing account.

Comparison

Runcrate and Self-Hosted GPU, side by side.

FeatureRuncrateSelf-Hosted GPU
Setup timeMinutes: get an API keyHours to days
ScalingHandled for youManual autoscaling
Idle costNoneFull GPU cost 24/7
MaintenanceNone on your sideCUDA, drivers, monitoring

Get started

Try it in one request.

Your agent writes and runs it. The same key works for every model and every GPU.

Docs
Caption every image in ./photos with Qwen3 VL on Runcrate and save the captions to captions.json. Runs # Chat completion curl https://api.runcrate.ai/v1/chat/completions \ -H "Authorization: Bearer rc_live_YOUR_API_KEY" \ -H "Content-Type: application/json" \ -d '{ "model": "deepseek-ai/DeepSeek-V3", "messages": [{"role": "user", "content": "Hello, world!"}] }' # Image generation curl https://api.runcrate.ai/v1/images/generations \ -H "Authorization: Bearer rc_live_YOUR_API_KEY" \ -H "Content-Type: application/json" \ -d '{ "model": "black-forest-labs/FLUX.1-dev", "prompt": "A futuristic cityscape" }'.

FAQ

Common questions.