TextGenWebUI

TextGenWebUI is a comprehensive, open-source language model UI and local server. You can set it up with an OpenAI-compatible server plugin, and then configure it like this:

YAML

config.yaml

models:
  - name: Text Generation WebUI
    provider: text-gen-webui
    apiBase: http://localhost:5000/v1
    model: MODEL_NAME

JSON

config.json

{
  "models": [
    {
      "title": "Text Generation WebUI",
      "provider": "text-gen-webui",
      "apiBase": "http://localhost:5000/v1",
      "model": "MODEL_NAME"
    }
  ]
}