Custom large language models (LLMs) can be fine-tuned and deployed using Google Kubernetes Engine (GKE) and Cloud Run. Watch along as Ali Zaidi, Solutions Architect Google Cloud, demonstrates the architecture of a custom LLM on Google Cloud as well as how to get started today. Check out the GitHub code repository below to get started.
Chapters:
0:00 – Meet Ali
0:31 – Demo architecture
1:29 – How to fine-tune LLMs
2:07 – How to deploy LLMs on GKE & Cloud Run
2:51 – Chatting with the LLMs
4:14 – Wrap up
Resources:
GitHub → https://goo.gle/4btqsKt
Watch more Cloud Next 2024 → https://goo.gle/Next-24
Subscribe to Google Cloud Tech → https://goo.gle/GoogleCloudTech
#GoogleCloudNext #GoogleGemini
Event: Google Cloud Next 2024
Speaker: Ali Zaidi
Products Mentioned: Google Kubernetes Engine, Cloud Run, Gemma
