Secure & Portable AI Inference with Docker: From Local to Cloud Training Course
Docker serves as a containerization platform designed to create portable, isolated, and secure deployment environments for AI inference services.
This instructor-led live training (available online or onsite) is designed for technical professionals at beginner to intermediate levels who aim to develop secure, portable AI inference microservices capable of consistent deployment across local machines, servers, or cloud VMs.
Upon completing this workshop, participants will be able to:
- Create lightweight inference containers for both local and cloud deployment.
- Secure containerized AI services by applying industry best practices.
- Implement portable microservice workflows to ensure consistent environments.
- Deploy AI inference endpoints across various infrastructures.
Format of the Course
- Guided lectures combined with practical demonstrations.
- Hands-on exercises to reinforce deployment and security techniques.
- Live-lab practice for building and running portable inference services.
Course Customization Options
- To tailor this training to your specific infrastructure or AI tooling stack, please contact us to arrange a session.
Course Outline
Introduction to AI Inference with Docker
- Understanding AI inference workloads
- Benefits of containerized inference
- Deployment scenarios and constraints
Building AI Inference Containers
- Selecting base images and frameworks
- Packaging pretrained models
- Structuring inference code for container execution
Securing Containerized AI Services
- Minimizing container attack surface
- Managing secrets and sensitive files
- Safe networking and API exposure strategies
Portable Deployment Techniques
- Optimizing images for portability
- Ensuring predictable runtime environments
- Managing dependencies across platforms
Local Deployment and Testing
- Running services locally with Docker
- Debugging inference containers
- Testing performance and reliability
Deploying on Servers and Cloud VMs
- Adapting containers for remote environments
- Configuring secure server access
- Deploying inference APIs on cloud VMs
Using Docker Compose for Multi-Service AI Systems
- Orchestrating inference with supporting components
- Managing environment variables and configs
- Scaling microservices with Compose
Monitoring and Maintenance of AI Inference Services
- Logging and observability approaches
- Detecting failures in inference pipelines
- Updating and versioning models in production
Summary and Next Steps
Requirements
- An understanding of basic machine learning concepts
- Experience with Python or backend development
- Familiarity with foundational container concepts
Audience
- Developers
- Backend engineers
- Teams deploying AI services
Need help picking the right course?
southafrica@nobleprog.co.za or +27 (0)10 005 5793
Secure & Portable AI Inference with Docker: From Local to Cloud Training Course - Enquiry
Testimonials (1)
The training met expectations with its clear explanations, real-world examples, and hands-on labs that made complex topics easy to understand. It provided valuable insights into container orchestration, security, scaling and many other advanced topics.
Anna Wyszomirska-Szmyd - Akamai
Course - Docker and Kubernetes advanced
Related Courses
Advanced Docker
14 HoursThis instructor-led, live training in Nigeria (online or onsite) is aimed at engineers who wish to advance their knowledge of Docker so as to deploy applications at a larger scale while maintaining control.
By the end of this training, participants will be able to:
- Build their own Docker images.
- Deploy and manage large number of Docker applications.
- Evaluate different container orchestration solutions and choose the most suitable one.
- Set up a continuous integration process for Docker applications.
- Integrate Docker applications with existing continuous tools integration processes.
- Secure their Docker applications.
Containerized AI & ML Deployment with Docker
14 HoursDocker serves as a robust containerization platform, facilitating consistent, portable, and reproducible environments for AI and machine learning workloads.
This instructor-led live training (available online or onsite) targets intermediate-level professionals seeking to package ML codebases, dependencies, and models using Docker to establish reliable development-to-production workflows.
Upon completing this course, participants will be equipped to:
- Create and manage Docker images specifically tailored for AI and ML applications.
- Containerize machine learning pipelines, tools, and their associated dependencies.
- Optimize Docker environments for enhanced performance and portability.
- Deploy containerized ML services across diverse runtime environments.
Format of the Course
- Concept demonstrations supported by guided discussion.
- Hands-on exercises focused on real-world containerization tasks.
- Practical implementation using live-lab Docker environments.
Course Customization Options
- To customize this training for your organizational environment, please contact us to arrange.
CI/CD for AI: Automating Docker-Based Model Builds and Deployments
21 HoursCI/CD for AI represents a structured methodology for automating the packaging, testing, containerization, and deployment of models through continuous integration and continuous delivery pipelines.
This instructor-led live training, available online or onsite, is designed for intermediate-level professionals seeking to automate end-to-end AI model delivery workflows using Docker and CI/CD platforms.
By the conclusion of the training, participants will be able to:
- Create automated pipelines for building and testing AI model containers.
- Implement version control and reproducibility for model lifecycles.
- Integrate automated deployment strategies for AI services.
- Apply CI/CD best practices tailored to machine learning operations.
Format of the Course
- Instructor-guided presentations and technical discussions.
- Practical labs and hands-on implementation exercises.
- Realistic CI/CD workflow simulations in a controlled environment.
Course Customization Options
- If your organization requires customized pipeline workflows or platform integrations, please contact us to tailor this course.
Certified Kubernetes Administrator (CKA) - exam preparation
21 HoursThe Certified Kubernetes Administrator (CKA) programme was established by The Linux Foundation and the Cloud Native Computing Foundation (CNCF).
Kubernetes has emerged as a leading platform for container orchestration.
NobleProg has been delivering Docker and Kubernetes training since 2015. With over 360 successfully completed training projects, we have become one of the most recognized training providers globally in the field of containerization.
Since 2019, we have also been assisting our customers in validating their expertise in Kubernetes environments by preparing them to pass the CKA and CKAD exams.
This instructor-led, live training (available online or onsite) is designed for System Administrators and Kubernetes users who wish to validate their knowledge by passing the CKA exam.
Furthermore, the training focuses on gaining practical experience in Kubernetes Administration; therefore, we recommend participating even if you do not intend to sit for the CKA exam.
Course Format
- Interactive lectures and discussions.
- Extensive exercises and practice sessions.
- Hands-on implementation in a live-lab environment.
Course Customization Options
- To request a customized training for this course, please contact us to make arrangements.
- To learn more about CKA certification, please visit: https://training.linuxfoundation.org/certification/certified-kubernetes-administrator-cka
Certified Kubernetes Application Developer (CKAD) - exam preparation
21 HoursThe Certified Kubernetes Application Developer (CKAD) program was developed by The Linux Foundation and the Cloud Native Computing Foundation (CNCF), the host of Kubernetes.
This instructor-led, live training (online or onsite) is aimed at Developers who wish to confirm their skills in design, build, configure, and expose cloud native applications for Kubernetes.
On the other hand, training is also focused on gaining practical experience in Kubernetes application development, so we recommend taking part in it, even if you don't intend to take CKAD exam.
NobleProg have been delivering Docker & Kubernetes training from 2015. With more than 360 successfully completed training projects, we became one of the best known training company worldwide in field of containerization. Since 2019 we are also helping our customers to confirm their performance in k8s environment by preparing them and encouraging to pass CKA and CKAD exams.
Format of the Course
- Interactive lecture and discussion.
- Lots of exercises and practice.
- Hands-on implementation in a live-lab environment.
Course Customization Options
- To request a customized training for this course, please contact us to arrange.
- To learn more about CKAD, please visit: https://training.linuxfoundation.org/certification/certified-kubernetes-application-developer-ckad/
Introduction to Docker
14 HoursThis instructor-led, live training in Nigeria (online or on-site) is aimed at engineers who wish to use Docker to deploy and manage software as containers instead of as traditional stand-alone software.
By the end of this training, participants will be able to:
- Install and configure Docker.
- Understand and implement software containerization.
- Manage Docker based applications.
- Network different Docker applications and systems.
- Understand and edit Docker registries.
Container Platforms Administration with Docker, Kubernetes and OpenShift
35 HoursDiscover how to build, deploy, and administer containerized environments using Docker, Kubernetes, and OpenShift. This five-day, hands-on training covers container images, Kubernetes workloads, cluster networking, storage, security, monitoring, and practical OpenShift administration. Participants will acquire the necessary skills to operate modern container platforms and troubleshoot applications across both development and production settings.
Docker and Kubernetes: Building and Scaling a Containerized Application
21 HoursIn this instructor-led, live training in Nigeria (onsite or remote), participants will learn how to create and manage Docker containers, then deploy a sample application inside a container. Participants will also learn how to automate, scale, and manage their containerized applications within a Kubernetes cluster. Finally, the training goes on to more advanced topics, walking participants through the process of securing, scaling and monitoring a Kubernetes cluster.
By the end of this training, participants will be able to:
- Set up and run a Docker container.
- Deploy a containerized server and web application.
- Build and manage Docker images.
- Set up a Docker and Kubernetes cluster.
- Use Kubernetes to deploy and manage a clustered web application.
- Secure, scale and monitor a Kubernetes cluster.
Docker for MLOps: End-to-End Pipeline Containerization
21 HoursDocker is a containerization platform used to build reproducible, portable, and scalable environments for ML systems.
This instructor-led, live training (online or onsite) is aimed at intermediate-level to advanced-level technical professionals who wish to containerize and operationalize complete ML pipelines using Docker.
Upon completion of this training, participants will be able to:
- Containerize ML training, validation, and inference workloads.
- Design and orchestrate end-to-end ML pipelines using Docker and supporting tools.
- Implement versioning, reproducibility, and CI/CD for ML components.
- Deploy, monitor, and scale ML services in containerized environments.
Format of the Course
- Interactive lectures supported by practical demonstrations.
- Hands-on exercises focused on building real ML pipeline components.
- Live-lab implementation for end-to-end containerized workflows.
Course Customization Options
- For customized training aligned with specific ML infrastructure needs, please contact us to discuss options.
Docker and Kubernetes
21 HoursTraining Objectives: Acquire theoretical and practical skills in Docker and Kubernetes.
Docker and Kubernetes advanced
35 HoursThe "Advanced Docker and Kubernetes" course is a comprehensive training covering the Kubernetes platform and its ecosystem. It caters to participants with diverse experience levels, ensuring a full range of both basic and advanced Kubernetes functionalities. Key concepts covered include Containers, Labels, Controllers, Services, Secrets, Persistent Volumes, Namespaces, Quotas, Container Networking Model, Service Discovery, Scaling, Load Balancing, Cluster Management, Kubernetes Installation, Cluster Security, Access Control, Controller High Availability, Monitoring and Logging, Application Auto-composition, Advanced Scheduling, Microservices-based Applications, Application Design Patterns, and Deploying Applications on a Kubernetes Cluster.
GPU-Accelerated AI & Deep Learning with Docker Containers
21 HoursHarnessing GPU acceleration is critical for executing high-performance deep learning tasks in a scalable and efficient way.
This live training, delivered by an expert instructor (available online or at your location), targets intermediate-level technical professionals who want to configure, optimize, and run AI workloads enabled by GPUs within Docker containers.
Upon completing this course, participants will be able to:
- Create and execute GPU-enabled containers for both training and inference tasks.
- Set up CUDA, drivers, and runtime libraries for AI workflows within containers.
- Optimize resource allocation and isolation for applications that are intensive with GPU usage.
- Deploy scalable, containerized deep learning services in production settings.
Course Format
- Interactive teaching complemented by real-world demonstrations.
- Practice-based exercises focused on development with GPU capabilities.
- Practical implementation in a live-lab environment.
Course Customization Options
- For training tailored to your specific infrastructure or GPU stack, please reach out to us to arrange it.
Hybrid AI Deployment: Docker, Cloud, and Edge Integration
21 HoursHybrid AI deployment involves executing AI inference across cloud, on-premise, and edge environments through unified container-based workflows.
This instructor-led live training, available online or onsite, is designed for advanced professionals aiming to architect and deploy distributed AI inference systems within heterogeneous environments.
Upon completing this training, participants will be equipped to:
- Construct secure and scalable containerized AI services for multi-site environments.
- Deploy AI inference workloads to cloud platforms, local servers, and edge devices using Docker.
- Integrate orchestration tools to automate distributed AI operations.
- Enhance inference latency, reliability, and resilience across diverse infrastructure.
Course Format
- Guided presentations and expert-led discussions.
- Extensive hands-on practice and applied exercises.
- Real-world experimentation within a controlled live-lab setup.
Course Customization Options
- For tailored adjustments to align this course with your organization’s infrastructure or specific use cases, please contact us to customize the training.
Kubernetes from Basic to Advanced
14 HoursIn this instructor-led, live training session in Nigeria (onsite or remote), participants will learn how to deploy a collection of sample servers inside containers, then automate, scale, and manage their containerised servers within a Kubernetes cluster. The training progresses to more advanced topics, walking participants through the process of securing, networking and monitoring a Kubernetes cluster.
By the end of this training, participants will be able to:
- Set up and run a Docker container.
- Deploy containerised databases and servers.
- Set up a Docker and Kubernetes cluster.
- Use Kubernetes to deploy and manage different environments under the same cluster.
- Secure, scale and monitor a Kubernetes cluster.
Building Microservices with Spring Cloud and Docker
21 HoursDuring this instructor-led live training in Nigeria, participants will acquire the foundational skills needed to build microservices using Spring Cloud and Docker. Knowledge will be assessed through exercises and the step-by-step development of sample microservices.
By the end of this training, participants will be able to:
- Understand the fundamentals of microservices.
- Use Docker to build containers for microservice applications.
- Build and deploy containerized microservices using Spring Cloud and Docker.
- Integrate microservices with discovery services and the Spring Cloud API Gateway.
- Use Docker Compose for end-to-end integration testing.