You can circumvent the need for Highlight’s proxy service by utilizing your own Custom Provider. Highlight currently only supports providers that are compatible with OpenAI SDK.

To activate this, navigate to the Settings page of the Highlight App, turn on Developer Mode, enter the Base URL of your provider, make sure to correctly write your model name and API key.

You can debug your custom provider by right clicking on Highlight icon on sidebar and click on ‘Toggle Overlay Dev Tools’ to see the request and response from your provider.

Highlight is not liable for any complications that may occur due to the use of your API key, including but not limited to costs or rate limits.

OpenAIGrokCloud