Providers

The Provider module is a multi-model gateway configuration page that supports the platform to connect to multiple LLM providers. The provider list displays the icon, name, and switch status of added providers in an intuitive card format.

Feature Highlights

• Permission Control: Administrators can easily enable or disable providers by setting toggle buttons to achieve instant control.
• Detailed Configuration: When a specific provider is selected, parameters such as API Key and API Host address can be configured, and model configuration can be performed for different functions.
• Flexible Management: Supports adding new providers, checking connection status, and deleting models that are no longer applicable.

This module supports OpenAI compatible mode (URL/compatible-mode/v1/), and can simultaneously access domestic inference platforms such as Qwen SiliconFlow, DeepSeek, PPIO, etc., to achieve automatic load balancing and failover.