Thank you for sending your enquiry! One of our team members will contact you shortly.
Thank you for sending your booking! One of our team members will contact you shortly.
Duration 16 hours
Course Outline
Module 1: Overview of Confluent Apache Kafka Architecture and Cluster Configuration
- An introduction to Apache Kafka and the Confluent Platform
- Core concepts of Kafka brokers, producers, consumers, and topics
- The critical role of Kafka in data streaming and messaging pipelines
- Key Confluent extensions: REST Proxy, Schema Registry, and Control Center
- Kafka cluster architecture: examining brokers, partitions, and replication
Module 2: Configuring Zookeeper Quorum
- Understanding the Zookeeper ecosystem
- The function of Zookeeper within a Kafka cluster
- Determining optimal Zookeeper quorum size
- Zookeeper configuration best practices
- Implementing SSH on server infrastructure
- Hands-on: Configuring Zookeeper (both as a team and as a service)
- Utilizing the Zookeeper Command Line Interface (CLI)
- Hands-on: Establishing a Zookeeper quorum
- Exploring Zookeeper’s internal file system
- Performance variables that impact Zookeeper
- Demo: Managing tools and utilizing Zoonavigator for Zookeeper
Module 3: Setting Up Kafka Clusters
- Foundational Kafka principles
- Configuring Kafka core parameters
- Hands-on: Configuring Kafka on a single broker
- Hands-on: Running Kafka commands
- Hands-on: Establishing a Kafka multi-broker (cluster) environment
- Hands-on: Testing the Kafka cluster setup
- Verifying connectivity to the Kafka cluster
- Configuring Advertised.listeners: a critical setting
- Topic configuration strategies
- Setting up message ingestion and delivery within topics
- Hands-on: Demonstrating Kafka resilience
- Kafka performance: focusing on I/O, network, RAM, CPU, and OS
- Kafka performance: additional influencing factors
- Hands-on: Modifying broker configurations
Module 4: Advanced Kafka Configuration
- Configuring Landoop Kafka Topics UI, Confluent REST Proxy, and Confluent Schema Registry
- Sending and receiving messages via CLI, Java, and the Spring Framework
- Leveraging metrics and monitoring tools (including Confluent Control Center and Elasticsearch)
- Managing log files and offsets
- Ensuring high availability and disaster recovery
- Achieving high availability through replication
- Performance tuning for producers and consumers
- Formulating disaster recovery strategies
- Controlling failover and data recovery processes
- Setting up connectors
- Implementing Kafka Connect
- Enhancing Kafka security features
Summary and Recommended Next Steps
Requirements
- Proficiency with Linux-based systems and command-line utilities
- Working knowledge of distributed systems concepts
- Foundational understanding of networking and system configuration
Target Audience
- DevOps and SRE teams responsible for managing Kafka deployments
- System administrators working with Confluent and Zookeeper
- Kafka developers and architects focused on building scalable systems
Testimonials (2)
Possibility to perform independent exercises in the training environment.
Tomasz - PKO Zycie Towarzystwo Ubezpieczen S.A.
Course - Kafka for Administrators
Very practical examples. The trainer has tried to keep a pace where everybody is able to go with even though the group was quite inhomogeneous regarding the knowhow. He has provided a lot of support to basically everybody who asked for it :)