Thank you for sending your enquiry! One of our team members will contact you shortly.
Thank you for sending your booking! One of our team members will contact you shortly.
Duration 21 hours
Course Outline
Introduction to Production Deployment
- Primary obstacles in deploying fine-tuned models
- Distinctions between development and production ecosystems
- Instruments and platforms for model release
Model Preparation for Deployment
- Exporting models using standard formats (ONNX, TensorFlow SavedModel, etc.)
- Enhancing models for faster response times and higher throughput
- Validating models against edge cases and actual data
Containerization for Model Release
- Overview of Docker
- Generating Docker images for ML models
- Best practices for container safety and efficiency
Expanding Deployments via Kubernetes
- Introduction to Kubernetes for AI workloads
- Configuring Kubernetes clusters for model hosting
- Load balancing and horizontal scaling techniques
Oversight and Maintenance of Models
- Implementing monitoring with Prometheus and Grafana
- Automated logging for error tracking and performance analysis
- Re-training pipelines for model drift and updates
Guaranteeing Security in Production
- Protecting APIs for model inference
- Authentication and authorization protocols
- Mitigating data privacy issues
Case Studies and Practical Labs
- Releasing a sentiment analysis model
- Scaling a machine translation service
- Setting up monitoring for image classification models
Conclusion and Future Steps
Requirements
- Solid grasp of machine learning workflows
- Practical experience with fine-tuning ML models
- Knowledge of DevOps or MLOps frameworks
Intended Participants
- DevOps engineers
- MLOps specialists
- AI implementation experts
Testimonials (3)
Craig was extremely involved in the training, always making sure we are paying attention, adapted the examples to our day-to-day activities and always provided an answer when asked, even if the information was not added in the presentation.
Ecaterina Ioana Nicoale - BOOKING HOLDINGS ROMANIA SRL
Course - DevOps Foundation®
High level of commitment and knowledge of the trainer
Jacek - Softsystem
Course - DevOps Engineering Foundation (DOEF)®
real life examples