Glide is currently under development and the docs are updated frequently.
π¦ What is Glide?
Glide is a cloud-native LLM gateway, delivering high-performance LLMOps in a lightweight package. Glide provides a simplified way to build application resilience, reduce latency, and manage API keys among many other features.Install and Deploy π
Setup Config File
A single model setup is not recommended for production deployments.
Deployment
Currently the only supported deployment is via container.Docker
- Install Git: Ensure that Git is installed on your machine. You can download it from Gitβs official website.
-
Clone the Repository:
Open a terminal or command prompt and paste the code below:
- Build Docker Image:
- Deploy: Deploy the image to your prefered image hosting platform.