Hadoop Operations E-Learning Training

Bestel deze unieke E-Learning cursus Hadoop Operations online, 1 jaar 24/ 7 toegang tot rijke interactieve video’s, spraak, voortgangsbewaking door rapportages en testen per hoofdstuk om de kennis direct te toetsen.

Apache Hadoop is een open source softwareproject dat gedistribueerde verwerking van grote datasets over clusters van commodity-servers mogelijk maakt. Het is ontworpen om op te schalen van een enkele server naar duizenden machines, met een zeer hoge mate van fouttolerantie. In dit leertraject leer je over clusterplanning, installatie en beheer, resourcebeheer en monitoring en logging.

Cursusinhoud

Big Data Engineering

Course: 22 Minutes

• Course Introduction
• Defining Supercomputing
• Examining Engineering Teams
• Exploring Big Data Solutions

Principles of Hadoop Clusters

Course: 16 Minutes

• Examining Axioms of Supercomputing
• Exploring Design Principles for Hadoop
• Examining Additional Design Principles

Architecture a Hadoop Cluster

Course: 12 Minutes

• Examining Hadoop Cluster Architecture
• Scaling Hadoop Architectures

Network for the Hadoop Cluster

Course: 8 Minutes

• Examining Network Clusters

Hardware for the Hadoop Cluster

Course: 12 Minutes

• Examining Hardware Responsibilities
• Exploring Master Server Best Practices
• Examining Data Server Recommendations

Operating Systems for the Hadoop Cluster

Course: 9 Minutes

• Exploring Operating Systems Best Practices
• Examining Hostnames and DNS Recommendations

Storage for the Hadoop Cluster

Course: 16 Minutes

• Examining Storage Options
• Calculating Storage Amounts
• Evaluating Storage Options

Deployment of an Admin Server

Course: 36 Minutes

• Planning a Deployment
• Setting Up Flash Drives
• Setting Up Kickstart Files
• Setting Up Network Installer

Practice: Design a Hadoop Cluster

Course: 4 Minutes

• Exercise: Design Considerations for Hadoop Clusters

Amazon Web Services

Course: 23 Minutes

• Course Introduction1
• Examining Cloud Computing
• Examining Amazon Web Services
• Examining AWS EC

Setup of AWS

Course: 18 Minutes

• Examining AWS Credentials
• Creating an AWS Account
• Examining AWS Access Keys
• Examining Identification and Access Management
• Setting Up Identification and Access Management

AWS System Security

Course: 8 Minutes

• Exploring SSH Keys

AWS S3 and E

Course: 12 Minutes

• Setting Up S
• Provisioning a Micro EC

Setup of AWS Cluster

Course: 38 Minutes

• Configuring Hadoop for AWS
• Creating an EC2 Baseline Server
• Creating an Amazon Machine Image
• Creating an Amazon Cluster
• Exploring the AWS Command Line Interface

Moving Data

Course: 10 Minutes

• Using the AWS Command Line Interface
• Moving Data Into AWS

Elastic MapReduce

Course: 1 Hour

• Examining Hadoop Cloud Implementations
• Examining AWS Elastic MapReduce
• Examining EMR and End-users
• Setting Up EMR Clusters
• Running EMR Jobs
• Running EMR Jobs with Hue
• Running EMR Jobs with the Command Line Interface

Practice: Cloud Computing

Course: 6 Minutes

• Exercise: Using a Hadoop Cluster on AWS

Configuration Management Tools

Course: 15 Minutes

• Course Introduction
• Examining Configuration Management Tools
• Simulating Configuration Management Tools

Create Configuration Items

Course: 27 Minutes

• Building Images for Baseline Servers
• Building Images for DataServers
• Building Images for Master Servers

Setup a CM Environment

Course: 10 Minutes

• Provisioning Admin Servers

Deploy a Hadoop Cluster

Course: 2 Hours, 6 Minutes

• Exploring Cluster Architecture
• Provisioning Hadoop Clusters
• Deploying Support Tools
• Starting and Stopping Hadoop Clusters
• Configuring Hadoop Clusters
• Configuring Logging
• Building Client Servers
• Configuring MySQL Databases
• Building Hadoop Clients
• Configuring Hive Daemons
• Validating Flume, Sqoop, HDFS, and MapReduce
• Validating Hive and Pig
• Configuring HCatalog Daemons
• Configuring Oozie
• Configuring Hue

Practice: Configure the Admin Server

Course: 4 Minutes

• Exercise: Format HDFS and Run a Hadoop Program

Availability of Hadoop

Course: 1 Hour, 11 Minutes

• Course Introduction
• Defining Hadoop Fault Tolerance
• Examining NameNode Reliability
• Exploring Checkpoint Node
• Testing NameNode Failure
• Examining NameNode Recovery
• Swapping NameNodes
• Examining DataNode Reliability
• Testing DataNode Reliability
• Examining DataNode Recovery
• Exploring DataNode Replications

High Availability for HDFS

Course: 54 Minutes

• Recovering Missing Data Blocks
• Defining HDFS High Availability
• Configuring for High Availability
• Setting up NameNode High Availability
• Examining High Availability Auto Failovers
• Creating High Availability Auto Failovers

YARN Containers

Course: 14 Minutes

• Examining YARN Task Reliability
• Examining YARN Containers
• Testing YARN Container Reliability

YARN Jobs

Course: 6 Minutes

• Examining YARN Job Reliability
• Testing Application Reliability

High Availability for YARN

Course: 14 Minutes

• Examining YARN High Availability
• Setting Up High Availability for ResourceManagers

Practice: Managing Availability

Course: 9 Minutes

• Exercise: Recover from a NameNode Failure

Hadoop Security

Course: 9 Minutes

• Course Introduction
• Examining Security Risks

Network Security

Course: 18 Minutes

• Locking Down Networks
• Implementing Security Groups

Kerberos

Course: 41 Minutes

• Examining Kerberos
• Creating Kerberos Diagrams
• Preparing for Kerberos Installation
• Installing Kerberos
• Configuring Kerberos

Services Security

Course: 1 Hour, 15 Minutes

• Examining Hadoop and Kerberos
• Configuring HDFS for Kerberos
• Configuring YARN for Kerberos
• Examining Hive with Kerberos
• Configuring Hive for Kerberos
• Examining Pig, Sqoop, Oozie with Kerberos
• Configuring Pig and HTTPFS for Kerberos
• Configuring Oozie for Kerberos
• Configuring Hue for Kerberos
• Examining Flume and Kerberos

User Security

Course: 19 Minutes

• Managing User Security
• Managing User Access
• Creating Access Control Lists

Data Security

Course: 35 Minutes

• Examining Data in Motion
• Encrypting Data in Motion
• Encrypting Data at Rest
• Examining Hadoop Security
• Monitoring Hadoop Security

Practice: Securing Services

Course: 11 Minutes

• Exercise: Perform Security Level task for Hadoop

Hadoop Operations

Course: 27 Minutes

• Course Introduction
• Managing Hadoop Service Levels
• Deploying Hadoop Releases
• Examining Hadoop Change Management

Racks Awareness for Hadoop

Course: 12 Minutes

• Examining Rack Awareness
• Installing Rack Awareness

File System Management for HDFS

Course: 48 Minutes

• Starting and Stopping a Hadoop Cluster
• Writing Init Scripts
• Administering HDFS
• Managing HDFS
• Setting Quotas
• Installing Trash

DataNode Management for HDFS

Course: 24 Minutes

• Managing HDFS DataNodes
• Replacing a DataNode
• Managing HDFS Scaling
• Adding DataNodes

Balancing a Hadoop Cluster

Course: 12 Minutes

• Managing Hadoop Balancing
• Balancing Hadoop Clusters

Backup and Recovery for HDFS

Course: 17 Minutes

• Managing HDFS Backup and Recovery
• Copying Data

Managing Jobs

Course: 13 Minutes

• Examining MapReduce Job Management
• Performing MapReduce Job Management

Upgrades for a Hadoop Cluster

Course: 12 Minutes

• Managing Hadoop Upgrades

Practice: High Availability

Course: 11 Minutes

• Exercise: Installing Hbase with High Availability

Hadoop Stability

Course: 3 Hours, 36 Minutes

• Course Introduction
• Exploring Event Management
• Exploring Incident Management
• Exploring Problem Management
• Examining Ganglia
• Examining Ganglia Functionality
• Installing Ganglia
• Examining Hadoop Metrics
• Install Hadoop Metrics2 for Ganglia
• Exploring Ganglia
• Using Ganglia
• Examining Nagios
• Using Nagios Commands
• Using Nagios
• Using Hadoop Metrics2 for Nagios
• Examining Hadoop Logs
• Configure Logging for Jobs
• Configuring log4j for Hadoop
• Configuring JobHistoryServer logs
• Configuring Hadoop Logs
• Exploring Problem Management Lifecycle
• Examining Problem Management Best Practices
• Examining Common Problems
• Performing Root Cause Analysis

Practice: Problem Management

Course: 3 Hours, 36 Minutes

• Exercise: Use Monitoring Tools
• Installing Nagios
• Nagios Contact Records
• Nagios Push

Capacity Management

Course: 15 Minutes

• Course Introduction
• Examining Capacity Management
• Examining Capacity Strategies

HDFS Capacity

Course: 14 Minutes

• Examining Schedulers
• Setting HDFS Quotas

YARN Capacity

Course: 1 Hour, 30 Minutes

• Examining MRv
• Exploring Fair Schedulers
• Examining Fair Scheduler Algorithms
• Examining Scheduler Behaviors
• Monitoring Fair Share
• Examining Single Resource Fairness
• Balancing Resources
• Examining Single Resource Fairness Configurations
• Configuring Single Resource Fairness
• Examining Minimum Resources
• Configuring Minimum Resources
• Examining Preemption
• Configuring Preemption

Service Performance

Course: 9 Minutes

• Examining Dominant Resource Fairness
• Writing Service Levels

Practice: Fair Scheduler

Course: 5 Minutes

• Exercise: Using the Fair Scheduler

Performance Tuning Hadoop Clusters

Course: 18 Minutes

• Course Introduction
• Managing Performance Tuning
• Examining Best Practices for Performance Tuning

Performance Tuning Networks

Course: 15 Minutes

• Examining Best Practices for Network Tuning
• Installing Compression

Performance Tuning Servers

Course: 18 Minutes

• Examining Operating System Tune Up Options
• Examining Java Tune Up Options
• Examining Input and Output Tune Up Options

Performance Tuning Memory

Course: 30 Minutes

• Optimizing Memory for Daemons
• Optimizing Memory for YARN
• Optimizing Memory for Containers
• Tuning Memory for Hadoop Clusters

Performance Tuning HDFS

Course: 22 Minutes

• Examining Tune Up Options for HDFS
• Examining HDFS Data Blocks
• Testing Data Blocks
• Performance Tuning HDFS

Performance Tuning YARN

Course: 46 Minutes

• Examining Tune UP Options for YARN
• Configure Speculative Execution
• Examining MapReduce Tune Up Options
• Performance Tuning MapReduce
• Examining Benchmarking
• Examining Best Practices for Benchmarking
• Stress Testing and Benchmarking Hadoop Clusters

Modeling Applications

Course: 9 Minutes

• Examining Applications Modeling

Practice: Performance Tuning

Course: 5 Minutes

• Exercise: Tuning a Hadoop Cluster

Cluster Management Tools

Course: 18 Minutes

• Course Introduction
• Defining Cluster Management
• Examining Cluster Management Tools

Cloudera Manager Introduction

Course: 39 Minutes

• Examining Cloudera Manager
• Installing Cloudera Manager
• Deploying Clusters
• Installing Hadoop with Cloudera Manager

Cloudera Manager Administration

Course: 2 Hours, 11 Minutes

• Exploring Cloudera Manager Admin Console
• Exploring Cloudera Manager Architecture
• Performing Cluster Management
• Managing Services
• Managing Hosts with Cloudera Manager
• Setting Cloudera Manager for High Availability
• Managing Resources
• Monitoring with Cloudera Manager
• Diagnosing with Cloudera Manager
• Improving Performance
• Installing and Configuring Impala
• Installing and Configuring Sentry
• Using Hive for Sentry Administration
• Using Cloudera Manager for Administration

Manage Data with Hue

Course: 44 Minutes

• Configuring Hue with MySQL
• Importing Data with Hue
• Running Hive Jobs with Hue
• Editing Oozie Workflows with Hue

Practice: Hadoop Programs

Course: 6 Minutes

• Exercise: Run a Hadoop Program