1+ ---
2+ title : " Deploy on Google Kubernetes Engine"
3+ ---
4+
15Learn how to deploy LLMstudio as a containerized application on Google Kubernetes Engine and make calls from a local repository.
26
37
@@ -18,20 +22,20 @@ This example demonstrates a public deployment. For a private service accessible
1822 <Step title = " Select Deploy" >
1923 Go to ** Workloads** and ** Create a new Deployment** .
2024 <Frame >
21- <img src = " how-to/deploy-on-gke/ images/step-2.png" />
25+ <img src = " images/step-2.png" />
2226 </Frame >
2327 </Step >
2428 <Step title = " Name Your Deployment" >
2529 Rename your project. We will call the one in this guide ** llmstudio-on-gcp** .
2630 <Frame >
27- <img src = " how-to/deploy-on-gke/ images/step-3.png" />
31+ <img src = " images/step-3.png" />
2832 </Frame >
2933 </Step >
3034 <Step title = " Select Your Cluster" >
3135 Choose between ** creating a new cluster** or ** using an existing cluster** .
3236 For this guide, we will create a new cluster and use the default region.
3337 <Frame >
34- <img src = " how-to/deploy-on-gke/ images/step-4.png" />
38+ <img src = " images/step-4.png" />
3539 </Frame >
3640 </Step >
3741 <Step title = " Proceed to Container Details" >
@@ -47,7 +51,7 @@ This example demonstrates a public deployment. For a private service accessible
4751 ```
4852 Set it as the ** Image path** to your container.
4953 <Frame >
50- <img src = " how-to/deploy-on-gke/ images/step-6.png" />
54+ <img src = " images/step-6.png" />
5155 </Frame >
5256 </Step >
5357 <Step title = " Set Environment Variables" >
@@ -63,7 +67,7 @@ Additionally, set the `GOOGLE_API_KEY` environment variable to enable calls to G
6367<Tip >Refer to ** SDK/LLM/Providers** for instructions on setting up other providers.</Tip >
6468
6569<Frame >
66- <img src = " how-to/deploy-on-gke/ images/step-7.png" />
70+ <img src = " images/step-7.png" />
6771</Frame >
6872
6973 </Step >
@@ -74,13 +78,13 @@ Additionally, set the `GOOGLE_API_KEY` environment variable to enable calls to G
7478 Select ** Expose deployment as a new service** and leave the first item as is.
7579
7680 <Frame >
77- <img src = " how-to/deploy-on-gke/ images/step-9-1.png" />
81+ <img src = " images/step-9-1.png" />
7882 </Frame >
7983
8084 Add two other items, and expose the ports defined in the ** Set Environment Variables** step.
8185
8286 <Frame >
83- <img src = " how-to/deploy-on-gke/ images/step-9-2.png" />
87+ <img src = " images/step-9-2.png" />
8488 </Frame >
8589 </Step >
8690 <Step title = " Deploy" >
@@ -108,7 +112,7 @@ Now let's make a call to our LLMstudio instance on GCP!
108112
109113 Go to your newly deployed ** Workload** , scroll to the ** Exposing services** section, and take note of the Host of your endpoint.
110114 <Frame >
111- <img src = " how-to/deploy-on-gke/ images/step-env.png" />
115+ <img src = " images/step-env.png" />
112116 </Frame >
113117
114118 Create your ` .env ` file with the following:
@@ -141,7 +145,7 @@ Now let's make a call to our LLMstudio instance on GCP!
141145 ```
142146
143147 <Frame >
144- <img src = " how-to/deploy-on-gke/ images/step-llmstudio-call.png" />
148+ <img src = " images/step-llmstudio-call.png" />
145149 </Frame >
146150
147151
0 commit comments