Custom Endpoint
When to Use
Section titled “When to Use”Use this if you run:
- Self-hosted models (vLLM, LiteLLM, etc.)
- Enterprise proxy/gateway endpoints
- Any OpenAI-compatible API server
Configure in AnySoul
Section titled “Configure in AnySoul”- Provider: Custom Endpoint
- Enter endpoint URL (example:
https://your-endpoint/v1) - Enter model ID exactly as your endpoint expects
- If required, paste API key and save
- Endpoint must be OpenAI-compatible
- If your endpoint needs extra headers, place them at your gateway/proxy layer