Blog
Inference. Models over an API.
Calling open models, and seeing how long each call took, what it cost and why it stopped.
Latest
See every model call your agents make
Every call to the inference API is now kept for 30 days. Name the end user, group an agent's calls into a session, and get told when they fail.
The Runcrate team
Read the post