Supported Language Models

• GPT-4
  • Model Name: gpt-4-1106-preview
• GPT-3.5 Turbo
  • Model Name: gpt-3.5-turbo-1106
• Gemini Pro
  • Model Name: gemini-pro
• Gemini Ultra
  • Model Name: gemini-ultra
• Claude 2.1
  • Model Name: claude-2.1
• Mistral
  • Model Names:
    • mistral/mistral-small
    • mistral/mistral-medium
• Azure OpenAI Models endpoints

Privately hosted open-source modes (Enterprise plan only)

Private models are models that are hosted on your own infrastructure. This is useful for companies that have their own data that can be trained on their data.

Coming soon:

• AWS - Sagemaker
• AWS - Bedrock
• Cloudflare AI Workers
• Cohere
• Anthropic
• Huggingface
• Replicate
• Together_ai
• Openrouter
• Ollama
• Deepinfra
• Perplexity-ai
• Anyscale