DeepInfra

Configure DeepInfra with Continue to access low-cost inference for open-source models like Mixtral-8x7B-Instruct, including API setup instructions

Discover Deep Infra models here

Get an API key from the Deep Infra

Configuration

YAML

config.yaml

name: My Config
version: 0.0.1
schema: v1

models:
  - name: <MODEL_NAME>
    provider: deepinfra
    model: <MODEL_ID>
    apiKey: <YOUR_DEEPINFRA_API_KEY>

JSON (Deprecated)

config.json

{
  "models": [
    {
      "title": "<MODEL_NAME>",
      "provider": "deepinfra",
      "model": "<MODEL_ID>",
      "apiKey": "<YOUR_DEEPINFRA_API_KEY>"
    }
  ]
}

Check out a more advanced configuration here