How to Configure the Gateway
routers
- defines Glide’s routers per model modality (e.g. routers.language
, routers.speech
, etc). For more information on router types see the router page.api
- defines Glide’s server configuration for specific protocol. Read more about this belowtelemetry
- defines configuration for Glide’s observability. Read more about this below.language
- This is the language API endpoint which support a /chat
endpoints from model providersid
- A unique id for your routerstrategy
- The type of router can be round-robin, weighted-round-robin, least-latency, prioritymodels/id
- A unique ID for the model configuration.env
files located in the directory where it was called.
You can use a separate --env
flag to provide a specific path:
api.http.host
(default: localhost) - defines address to which Glide binds its server. Usually, it’s localhost
or 0.0.0.0
api.http.read_timeout
(default: 3m) - the timeout of data reading from clientsapi.http.write_timeout
(default: 3m) - the timeout of data writing to clientsapi.http.idle_timeout
(default: 1m) - the free timeout of the request link for persistent keep-alive connectionsapi.http.max_request_body_size
(default: 4Mb) - max body size of a requesttelemetry.logging.level
(default: info) - minimal log level to output. Possible values: debug
, info
, warning
, error
telemetry.logging.encoding
(default: json) - logging encoding. The json
outputs structured logs useful for production setup while console
is much more readable, so it fits development setups.telemetry.logging.disable_caller
- controls adding information about place in Glide’s codebase where the log was generatedtelemetry.logging.disable_stacktrace
- controls adding information about full stacktrace to the code that generated logstelemetry.logging.output_paths
(default: [] (an empty array)) - allows to save logging streams to the specified filestelemetry.logging.output_paths
(default: (an empty map)) - key-value pairs to label each Glide’s log record.