Get in Touch
 Duration 16 hours

Course Outline

Module 1: Overview of Confluent Apache Kafka Architecture and Cluster Configuration

  • An introduction to Apache Kafka and the Confluent Platform
  • Core concepts of Kafka brokers, producers, consumers, and topics
  • The critical role of Kafka in data streaming and messaging pipelines
  • Key Confluent extensions: REST Proxy, Schema Registry, and Control Center
  • Kafka cluster architecture: examining brokers, partitions, and replication

Module 2: Configuring Zookeeper Quorum

  • Understanding the Zookeeper ecosystem
  • The function of Zookeeper within a Kafka cluster
  • Determining optimal Zookeeper quorum size
  • Zookeeper configuration best practices
  • Implementing SSH on server infrastructure
  • Hands-on: Configuring Zookeeper (both as a team and as a service)
  • Utilizing the Zookeeper Command Line Interface (CLI)
  • Hands-on: Establishing a Zookeeper quorum
  • Exploring Zookeeper’s internal file system
  • Performance variables that impact Zookeeper
  • Demo: Managing tools and utilizing Zoonavigator for Zookeeper

Module 3: Setting Up Kafka Clusters

  • Foundational Kafka principles
  • Configuring Kafka core parameters
  • Hands-on: Configuring Kafka on a single broker
  • Hands-on: Running Kafka commands
  • Hands-on: Establishing a Kafka multi-broker (cluster) environment
  • Hands-on: Testing the Kafka cluster setup
  • Verifying connectivity to the Kafka cluster
  • Configuring Advertised.listeners: a critical setting
  • Topic configuration strategies
  • Setting up message ingestion and delivery within topics
  • Hands-on: Demonstrating Kafka resilience
  • Kafka performance: focusing on I/O, network, RAM, CPU, and OS
  • Kafka performance: additional influencing factors
  • Hands-on: Modifying broker configurations

Module 4: Advanced Kafka Configuration

  • Configuring Landoop Kafka Topics UI, Confluent REST Proxy, and Confluent Schema Registry
  • Sending and receiving messages via CLI, Java, and the Spring Framework
  • Leveraging metrics and monitoring tools (including Confluent Control Center and Elasticsearch)
  • Managing log files and offsets
  • Ensuring high availability and disaster recovery
  • Achieving high availability through replication
  • Performance tuning for producers and consumers
  • Formulating disaster recovery strategies
  • Controlling failover and data recovery processes
  • Setting up connectors
  • Implementing Kafka Connect
  • Enhancing Kafka security features

Summary and Recommended Next Steps

Requirements

  • Proficiency with Linux-based systems and command-line utilities
  • Working knowledge of distributed systems concepts
  • Foundational understanding of networking and system configuration

Target Audience

  • DevOps and SRE teams responsible for managing Kafka deployments
  • System administrators working with Confluent and Zookeeper
  • Kafka developers and architects focused on building scalable systems

Testimonials (2)

Related Categories