Big Data Hadoop Development / Testing Certification Training

✔ What is Big Data?
✔ Examples of Big Data
✔ Reasons for Big Data Generation
✔ Why Big Data deserves your attention
✔ Use cases of Big Data
✔ Different options of analyzing Big Data
✔ Interview Questions and Tips.
✔ HADOOP SOFTWARE INSTALLATION & SETUP
✔ Cloudera 5.12.0 Hadoop latest software

✔ What is Big data Hadoop
✔ History of Hadoop
✔ How Hadoop’s name was given
✔ Advantages and drawbacks of Hadoop
✔ Problems with Traditional Large-Scale Systems and the Need for Hadoop
✔ Setting up single node Hadoop cluster(Pseudo mode)
✔ Understanding Hadoop configuration files
✔ Hadoop Components- HDFS, Map Reduce
✔ Overview Of Hadoop Processes
✔ Overview Of Hadoop Distributed File System
✔ Understanding Hadoop Architecture 1X
✔ Understanding Hadoop Architecture 2X
✔ Fundamental of HDFS (Blocks, Name Node, Data Node, Secondary Name Node)
✔ Rack Awareness
✔ Read/Write from HDFS
✔ HDFS Federation and High Availability
✔ The building blocks of Hadoop
✔ Types of scaling
✔ Hands-On Exercise using Linux commands
✔ Hands-On Exercise using HDFS commands
✔ HDFS Module Interview Questions and Answers

✔ Introduction to Apache Hive
✔ Architecture of Hive
✔ Installing Hive
✔ Hive data types
✔ Exploring hive meta store tables
✔ Types of Tables in Hive(Internal Table and External Table)
✔ Comparison between internal table and external table
✔ Loading data into hive tables
✔ Writing output into local or hdfs file system
✔ How to use hive commands in Linux prompt
✔ How to use Hadoop commands in hive prompt
✔ Partitions(Static & Dynamic)
✔ Bucketing
✔ Table Sampling
✔ Hive functions(Numeric Functions, Aggregate Functions, Date Functions, and String Functions)
✔ Indexes
✔ Views
✔ Sub Quires
✔ Joins (Left Outer, Right Outer, Full Outer, inner join, and Cross Join)
✔ Developing hive scripts
✔ Parameter Substitution
✔ Difference between order by & sort by
✔ Difference between Cluster by & distributed by
✔ Difference between view and table
✔ Purpose of UNION ALL
✔ DML Commands
✔ Complex Data Types(Array, Map and Struct)
✔ File Input formats
✔ Text File
✔ RC
✔ ORC
✔ Sequence
✔ Avro
✔ Parquet
✔ Creating Hive UDFs
✔ Hands-On Exercise
✔ Hive module interview questions and answers

✔ Introduction to Apache Pig
✔ Building Blocks ( Bag, Tuple & Field)
✔ Installing Pig
✔ PIG Architecture
✔ Big Data types and complex data types
✔ Pig components
✔ Different modes of execution of PIG
✔ Types of different bags creation
✔ Working with various PIG Commands covering all the functions in PIG
✔ Aggregate and String functions.
✔ Developing PIG scripts
✔ Parameter Substitution
✔ Command line arguments
✔ Passing parameters through a param file
✔ Joins (Left Outer, Right Outer, Full Outer, inner join, replicated and skewed join)
✔ Advanced Joins (replicated join and skewed join)
✔ Purpose of count and count_star
✔ Group and cogroup
✔ Nested queries
✔ Word Count program using pig queries
✔ Working with Semi-structured data like XML and JSON
✔ Complex data types using pig
✔ Creating PIG UDFs
✔ Hands-On Exercise
✔ PIG Module Interview Questions and Answers

✔ Introduction to SQOOP
✔ SQOOP Architecture
✔ Import data from RDBMS to HDFS
✔ Importing Data from RDBMS to HIVE
✔ Importing data from RDBMS to HBASE
✔ Exporting data from HDFS to RDBMS
✔ Exporting data from HIVE to RDBMS
✔ Handling incremental loads using sqoop to HDFS.
✔ Handling incremental loads using sqoop to HIVE.
✔ Handling incremental loads using sqoop to Hbase.
✔ Creation of Sqoop jobs, Execution, and deletion.
✔ Hands-on exercise
✔ SQOOP Module Interview Questions and answers

✔ Introduction to HBase
✔ HBase Architecture
✔ Installation of HBase
✔ Exploring HBASE Master & Region server
✔ Exploring Zookeeper
✔ CRUD Operation of Hbase with Examples
✔ HIVE integration with HBASE(HBASE-Managed hive tables)
✔ Hands-on exercise on HBASE
✔ Hbase Interview Questions and Answers

✔ Understanding Map Reduce
✔ Job Tracker and Task Tracker
✔ Architecture of Map Reduce
✔ Map Function
✔ Reduce Function
✔ Data Flow of Map Reduce
✔ Hadoop Writable, Comparable & comparison with Java data types
✔ Map Function & Reduce Function
✔ How Map Reduce Works
✔ Submission & Initialization of Map Reduce Job
✔ Monitoring & Progress of Map Reduce Job
✔ Understand Difference Between Block and Input Split
✔ Role of Record Reader, Shuffler, and Sorter
✔ File Input Formats(TextInputFormat, KeyValueInputFormat)
✔ File output
✔ Formats(TextInputFormat,KeyValueInputFormat,SequenceOutputFormat)
✔ Getting Started With Eclipse IDE
✔ Setting up Eclipse Development Environment
✔ Creating Map Reduce Projects
✔ Configuring Hadoop API on Eclipse IDE
✔ Map Reduce program flow with word count
✔ Combiner & Partitioner, Custom Partitioner
✔ Joining Multiple datasets in Map Reduce
✔ Map Reduce programs explanation

✔ Oozie Introduction
✔ Oozie Architecture
✔ Oozie Map Reduce Jobs Execution
✔ How to use the OOZIE Web-Console
✔ How to use oozie through Hue

✔ Use of Hue
✔ How to use HDFS module through hue
✔ How to use Hive module through hue
✔ How to use OOZIE module through hue
✔ How to use Hbase module through hue

✔ Purpose of Cloudera manager
✔ How to use Cloudera manager
✔ How to start cluster and stop cluster
✔ How to restart and stop only specific modules
✔ How to check existing cluster nodes
✔ How to remove node from the cluster
✔ How to monitor health issues of the cluster

✔ All the modules-related materials soft copies will provide
✔ Each module-related complete reference book will provide
✔ Big Data Hadoop Certification Papers will provide