Providers Configuration

Detailed guide for configuring LLM providers.

Supported Providers

DeepSeek

{
  "NAME": "deepseek",
  "HOST": "https://api.deepseek.com",
  "APIKEY": "your-api-key",
  "MODELS": ["deepseek-chat", "deepseek-coder"],
  "transformers": ["anthropic"]
}

Groq

{
  "NAME": "groq",
  "HOST": "https://api.groq.com/openai/v1",
  "APIKEY": "your-api-key",
  "MODELS": ["llama-3.3-70b-versatile"],
  "transformers": ["anthropic"]
}

Gemini

{
  "NAME": "gemini",
  "HOST": "https://generativelanguage.googleapis.com/v1beta",
  "APIKEY": "your-api-key",
  "MODELS": ["gemini-1.5-pro"],
  "transformers": ["anthropic"]
}

OpenRouter

{
  "NAME": "openrouter",
  "HOST": "https://openrouter.ai/api/v1",
  "APIKEY": "your-api-key",
  "MODELS": ["anthropic/claude-3.5-sonnet"],
  "transformers": ["anthropic"]
}

Provider Configuration Options

Field	Type	Required	Description
NAME	string	Yes	Unique provider identifier
HOST	string	Yes	API base URL
APIKEY	string	Yes	API authentication key
MODELS	string[]	No	List of available models
transformers	string[]	No	List of transformers to apply

Model Selection

When selecting a model in routing, use the format:

{provider-name},{model-name}

For example:

deepseek,deepseek-chat

Next Steps

• Routing Configuration - Configure how requests are routed
• Transformers - Apply transformations to requests