Apache Kafka E-Learning Training

Bestel deze unieke E-Learning cursus Apache Kafka online, 1 jaar 24/ 7 toegang tot rijke interactieve video’s, spraak, voortgangsbewaking door rapportages.

Apache Kafka is een krachtig, gedistribueerd, gepartitioneerd, gerepliceerd berichten- en commit-logsysteem. Het is geschreven in Scala om te draaien op de Oracle Java virtual machine (JVM). Kafka is oorspronkelijk ontwikkeld door LinkedIn om hun zeer hoge en specifieke prestatiedoelen te bereiken, en is sindsdien open source. Dit cursuspad biedt een overzicht van Apache Kafka, de architectuur en hoe ermee om te gaan vanuit een Ops-perspectief en als ontwikkelaar.

Cursusinhoud

Kafka Concepts

Course: 28 Minutes

• Course Introduction
• What is Kafka?
• Kafka Architecture
• Partitions
• Topics
• Replicas

Kafka Components

Course: 12 Minutes

• Producers
• Consumers
• Brokers

Deployment

Course: 21 Minutes

• Hardware Specifications
• Deployment Overview
• Red Hat and CentOS deployment
• Puppet Deployment

Operating Tasks

Course: 36 Minutes

• Adding and Removing a Broker
• Balancing Data and Partitions for Performance
• Add New Topics
• Scaling Producers
• Scaling Consumers

Monitoring

Course: 25 Minutes

• Kafka Web Console
• Kafka Offset Monitor
• Monitoring with Graphite
• Monitoring with JMX
• Using Kafka Log Files

Tuning

Course: 9 Minutes

• Kernel Tuning
• Disk Throughput Tuning
• JVM Tuning

Practice: Operate Apache Kafka

Course: 7 Minutes

• Exercise: Operating Apache Kafka

Reading from Kafka

13 Minutes

• Course Introduction
• High-Level Consumer API
• Simple Consumer API
• Hadoop Consumer API

Configuration Settings

Course: 19 Minutes

• Broker Configuration Settings
• Consumer Configuration Settings
• Producer Configuration Settings
• Configuring Compression

Writing to Kafka

Course: 34 Minutes

• Producer API
• Sync Producers
• Async Producers
• Message Acknowledgement
• Batching Messages
• Keyed and Non-Keyed Messages
• Broker Discovery

Testing and Serialization

Course: 14 Minutes

• Kafka Test Suites
• Serialization
• Building a Custom Serializer

Practice: Using Kafka

Course: 5 Minutes

• Exercise: Creating a Producer and Consumer

Kafka Integration with Spark

Course: 1 Hour, 7 Minutes

• Course Introduction
• Configuring Spark and Kafka
• Reading Data from Kafka
• Reading Data from Kafka in Parallel
• Writing Data to Kafka
• Writing Data to Kafka in Parallel
• Creating a Direct Stream
• Planning for Location and Consumer Strategies
• Using an RDD
• Managing Offsets
• Creating a Kafka-Spark Word-splitting Application

Storm Integration

Course: 46 Minutes

• Course Introduction
• Configuring Storm and Kafka
• Describing the Storm-Kafka Pipeline
• Configuring and Using the KafkaSpout API
• Reading from Kafka Using the Storm Connector
• Writing to Kafka
• Creating a Kafka-Storm Word Counting Application
• Managing Offsets in Storm

Practice: Spark and Storm with Kafka

Course: 4 Minutes

• Exercise: Using Storm with Kafka

Clusters

Course: 30 Minutes

• Course Introduction
• Identifying the Benefits of Kafka Clustering
• Working with a Multi-broker Cluster
• Configuring Replication
• Working with Log Compaction
• Configuring the Log Cleaner

Advanced Clusters

Course: 30 Minutes

• Increasing the Replication Factor
• Expanding a Cluster
• Mirroring between Clusters
• Working with Rack Awareness for Replication
• Balancing Leadership and Unclean Leader Election

Real-time Kafka Applications

Course: 57 Minutes

• Course Introduction
• The Real-time Capabilities of Kafka
• Installing the Twitter Streaming API
• Creating a Producer Using the Twitter API
• Creating a Consumer to Transfer to Spark
• Using Spark to Process Tweets
• Creating a Consumer to Transfer to Storm
• Using Storm to Process Tweets
• Using Kafka, Spark, and Storm Together

Practice: Real-time Apps for Kafka

Course: 6 Minutes

• Exercise: Create Real-time Kafka Applications