1-Day Instructor-Led Training
Hands-On Labs
After-Course Instructor-Coaching
#1485
Generative AI in Production
Course 1485
- Duration: 1 day
- Language: English
- Level: Intermediate
In this course, you learn about the different challenges that arise when productionizing generative AI-powered applications versus traditional ML. You will learn how to manage experimentation and tuning of your LLMs, then you will discuss how to deploy, test, and maintain your LLM-powered applications. Finally, you will discuss best practices for logging and monitoring your LLM-powered applications in production.
Generative AI in Production Course Delivery Methods
In-Person
Online
Upskill your whole team by bringing Private Team Training to your facility.
Generative AI in Production Course Information
This course will empower you to:
- Describe the challenges in productionizing applications using generative AI.
- Manage experimentation and evaluation for LLM-powered applications.
- Productionize LLM-powered applications.
- Implement logging and monitoring for LLM-powered applications.
Prerequisites
Completion of "Introduction to Developer Efficiency on Google Cloud" or equivalent knowledge.
Generative AI in Production Course Outline
Module 1: Introduction to Generative AI in Production
- Understand generative AI operations
- Compare traditional MLOps and GenAIOps
- Analyze the components of an LLM system
Module 2: Managing Experimentation
- Experiment with datasets and prompt engineering.
- Utilize RAG and ReACT architecture.
- Evaluate LLM models. • Track experiments.
Module 3: Productionizing Generative AI
- Deploy, package, and version models
- Test LLM systems
- Maintain and update LLM models
- Manage prompt security and migration
Module 4: Logging and Monitoring for Production LLM Systems
- Utilize Cloud Logging
- Version, evaluate, and generalize prompts
- Monitor for evaluation-serving skew
- Utilize continuous validation.
Questions about this course?
Customize Your Team Training Experience
Fill out the form below or call 888-843-8733
Need Help Finding The Right Training Solution?
Our training advisors are here for you.
Generative AI in Production Course FAQs
Yes, a foundational understanding of machine learning and AI concepts is recommended. Familiarity with Python and cloud-based AI tools is also beneficial.
While this course provides valuable practical knowledge, it does not directly lead to a Google certification. However, the insights and skills gained can serve as a strong foundation for those interested in pursuing certifications related to generative AI, such as those offered by Google Cloud.
- Vertex AI
- Vertex AI Pipelines
- Vertex AI Evaluation
- Vertex AI Studio
- Vertex AI Gemini API
- Gemini