Skip to content

LibreChat

LibreChat supports custom OpenAI-compatible endpoints. Add Inferray in librechat.yaml:

endpoints:
  custom:
    - name: "Inferray"
      apiKey: "${INFERRAY_API_KEY}"
      baseURL: "https://api.inferray.com/v1"
      models:
        default: ["gpt-5.5", "claude-sonnet-4-6", "gemini-3.6-flash"]
        fetch: true
      titleConvo: true
      titleModel: "gemini-3.6-flash"
      modelDisplayLabel: "Inferray"

Put the key in LibreChat's .env:

INFERRAY_API_KEY=inferray_...

With fetch: true, LibreChat loads the full model list from GET /v1/models; default is what it shows if that fails. A small, fast model makes a good titleModel, since it runs on every new conversation.

Restart LibreChat after editing the file, then pick Inferray in the endpoint menu.