# fastrun

> Fast inference for open models through an OpenAI-compatible API.

- [Introduction](https://docs.fastrun.si/index.md): Fast inference for open models through an OpenAI-compatible API.
- [Quickstart](https://docs.fastrun.si/quickstart.md): Create an API key and make your first request.
- [Authentication](https://docs.fastrun.si/authentication.md): Send your API key as a bearer token.
- [Models](https://docs.fastrun.si/models.md): The models fastrun serves, with their limits and features.
- [Pricing and usage](https://docs.fastrun.si/pricing.md): What a request costs and where to see your usage.
- [Streaming](https://docs.fastrun.si/guides/streaming.md): Receive tokens as they are generated.
- [Tool calling](https://docs.fastrun.si/guides/tool-calling.md): Let the model call functions in your code.
- [Structured outputs](https://docs.fastrun.si/guides/structured-outputs.md): Get JSON that matches your schema.
- [Reasoning](https://docs.fastrun.si/guides/reasoning.md): Let the model think before it answers.
- [Prompt caching](https://docs.fastrun.si/guides/prompt-caching.md): Pay less and wait less when requests share a beginning.
- [Errors and retries](https://docs.fastrun.si/guides/errors.md): What each error means and which ones to retry.
- [API reference](https://docs.fastrun.si/api-reference/introduction.md): Base URL, authentication and the endpoints of the fastrun API.
- [Create a chat completion](https://docs.fastrun.si/api-reference/chat/create-a-chat-completion.md): Generates the next assistant message for a conversation. Compatible with OpenAI's Chat Completions API. Set `stream: true` to receive the answer as server-sent events.
- [Create a completion](https://docs.fastrun.si/api-reference/completions/create-a-completion.md): Continues a raw text prompt with no chat template applied. Compatible with OpenAI's legacy Completions API. Use chat completions unless you build the prompt format yourself.
- [List models](https://docs.fastrun.si/api-reference/models/list-models.md): The models that can serve requests right now.

## OpenAPI Specs

- [openapi](/openapi.yaml)


This documentation is built and hosted on [Mintlify](https://mintlify.com), a developer documentation platform.