Big Data Hadoop Architects manage large scale development and deployment of Hadoop applications. With Big Data knowledge and power, companies that know how to harness it, Big Data Hadoop Architects have become the critical link between business and technology. Big Data Hadoop architects are in great demand, and are among the highest paid professionals in the IT industry.
Preview
After completion of Hadoop architecture training, you will be able to:
1.Gain in-depth understanding of Big Data and Hadoop concepts
2.Excel in the concepts of Hadoop big data architecture and Hadoop Distributed File System (HDFS)
3.Implement HBase and MapReduce Integration
4.Understand Apache Hadoop Framework and Architecture
5.Learn to write complex Hadoop MapReduce programs
6.Design and develop applications of big data using Hadoop Ecosystem
7.Monitor a Hadoop cluster and execute routine administration procedures
Course Contents
Day 1
Introduction to HADOOP
What is Hadoop?
Need for Hadoop
What is Big Data?
Problem with existing traditional system
Requirements for new approach
Comparing SQL databases and Hadoop
HDFS ( Hadoop – Distributed File System)
Hadoop Distributed file system , Background, GFS
Data Replication
Data Storage
Data Retrieval
Additional HDFS commands
Day 2
MapReduce Programming
MapReduce, Background
Writing MapReduce Programs
Writable and WritableComparable
Input Format, Output Format
Input Split and Block size
Combiner
Partitioner
Number of Mappers and Reducers
Counters
Map Reduce Algorithms and Exercises
Line Count and Word Count
Distributed Search
Sorting Data – Key Value Data Type
Mathematical Transformation example
Working with Counters exercise
Distributed Cache exercise
Zero Reducer based exercises
Day 3
Apache Pig
Installation
Execution Types
Grunt Shell
Pig Latin
Data Processing
Loading and Storing
Data Filtering
Grouping & Joining Operations
Apache Hive Installation and Details
Hive Installation on Single cluster Hadoop Node.
Hive Services
Hive Shell Description
Hive Server·
Meta store Details
Hive QL Basics
Working with Tables, Databases etc.
Hive JDBC programming
Day 4
Sqoop
Sqoop Overview
Installation
Data Processing through Sqoop
Understand Sqoop connectivity model with RDBMS
Using Sqoop example with real time data
Imports and Exports
Zoo Keeper
Zoo Keeper Overview
Installation
Server Mantainace
Apache HBase Installation and Details
HBase and NOSQL Introduction
HBase Installation and Configuration.
HBase and Java Based integration
HBase Hadoop Integration Details.
HBase basic exercises
Training Hours
Time: 12:00 NOON GMT | 07:00AM EST | 4:00AM PST | 6:00AM CST | 5:00AM MST | 5:30PM IST | 01:00PM GMT+1
Audience
Big Data Hadoop Architect is a highly desirable career goal for those seeking to fast-track their career in this industry.
1.Software Developers, Testers
2.Software Architects
3.Analytics Professionals
4.Data Management Professionals
5.Project Managers
6.Mainframe Professionals
7.Graduates looking to build a career in Big Data Hadoop