Concepts
LLM Providers
20+ supported LLM providers
LLM Providers
Overseer supports 20+ LLM providers out of the box. Switch between providers and models on the fly via the web dashboard or environment variables.
Supported Providers
| Provider | Models | Configuration |
|---|---|---|
| OpenAI | GPT-4o, GPT-4, O1, O3-mini | OPENAI_API_KEY |
| Anthropic | Claude 3.5 Sonnet, Opus, Haiku | ANTHROPIC_API_KEY |
| Gemini 2.0 Flash, 1.5 Pro | GOOGLE_GENERATIVE_AI_API_KEY | |
| Groq | Llama 3.3, Mixtral, Gemma | GROQ_API_KEY |
| Ollama | Any local model | OLLAMA_BASE_URL |
| Azure OpenAI | GPT-4, GPT-3.5 | AZURE_OPENAI_* |
| AWS Bedrock | Claude, Llama | AWS_* |
| Mistral | Mistral Large, Medium, Small | MISTRAL_API_KEY |
| Cohere | Command R+, Command | COHERE_API_KEY |
| Together AI | Llama, Mixtral | TOGETHER_AI_API_KEY |
| DeepSeek | DeepSeek Chat | DEEPSEEK_API_KEY |
| Perplexity | Sonar models | PERPLEXITY_API_KEY |
| Fireworks | Llama, Mixtral | FIREWORKS_API_KEY |
| xAI | Grok | XAI_API_KEY |
| DeepInfra | Various | DEEPINFRA_API_KEY |
Configuration
Via Web Dashboard
- Go to Settings → Providers
- Click Add Provider
- Select provider and enter API key
- Set as default or configure per-conversation
Via Environment Variables
DEFAULT_PROVIDER=openai
DEFAULT_MODEL=gpt-4o
OPENAI_API_KEY=sk-...OpenAI-Compatible Providers
Any provider with an OpenAI-compatible API can be used:
CUSTOM_PROVIDER_BASE_URL=https://your-provider.com/v1
CUSTOM_PROVIDER_API_KEY=your-key