Post 10 | HDPCD | Load Pig Relation WITHOUT schema

  Hello everyone, hope you are finding the tutorials useful. In the previous tutorial, we started off with Data Transformation category of the HDPCD certification. This tutorial, being the second objective in this category, focuses on creating a sample pig relation without the schema. Before, starting with the actual process, let us define what isContinue reading “Post 10 | HDPCD | Load Pig Relation WITHOUT schema”

Post 9 | HDPCD | Pig Script Execution

This is the first post in Data Transformation category which is essential to clear the HDPCD certification, given by Hortonworks Inc. In the last eight tutorials, we focused on Data Ingestion tasks. The next twenty-one, yeah, that’s right, I said next twenty-one tutorial, including this one, will focus on the Data Transformation category of theContinue reading “Post 9 | HDPCD | Pig Script Execution”

Post 8 | HDPCD | Configure Flume Memory Channel

In the last tutorial, we saw the process to start the flume agent. This tutorial is an extension to the previous tutorial, so please refer to it before getting started with this tutorial. The last tutorial enabled us to start the flume agent, after which we can send the messages that we want over flumeContinue reading “Post 8 | HDPCD | Configure Flume Memory Channel”

Post 7 | HDPCD | Starting Flume Agent

Hello everyone, hope you are finding the tutorials quite useful. In the previous post, we performed the Sqoop Export operation. In this tutorial, we are going to start the flume agent. Flume is one of the projects of Apache Ecosystem. Apache Flume is a reliable and distributed service for moving a large amount of logContinue reading “Post 7 | HDPCD | Starting Flume Agent”

Post 6 | HDPCD | Sqoop Export

Hi everyone, hope you are finding these tutorials quite helpful. Today, we are going to target the 4th objective in data ingestion category of the HDPCD certification. We are going to perform the Sqoop Export operation. In this tutorial, we saw the sqoop import operation, which is the reverse of the sqoop export operation. So, letContinue reading “Post 6 | HDPCD | Sqoop Export”

Post 5 | HDPCD | RDBMS to Hive Import

Hello everyone, in this tutorial, we are going to see the 3rd objective in data ingestion category. The objective is listed on Hortonworks website under data ingestion and looks like this. In the previous post, we imported data into HDFS, here, we are going to import the data directly into Hive table. So, let us begin.Continue reading “Post 5 | HDPCD | RDBMS to Hive Import”

Post 4 | HDPCD | Free-form Query Import

Hello everyone, in this tutorial, we are going to see the 2nd objective in data ingestion category. The objective is listed on Hortonworks website under data ingestion and looks like this. In the previous objective, we imported entire records from a MySQL table, whereas in this post, we are going to import data based onContinue reading “Post 4 | HDPCD | Free-form Query Import”

Post 3 | HDPCD | Sqoop Import

Hi everyone, hope you are finding the tutorials useful. From this tutorial onwards, we are going to perform objectives for HDPCD certification. In this tutorial, we are going to see the first objective in Data Ingestion category. If you go to Hortonworks’ objective page here, you will find it to be worded as “Import data fromContinue reading “Post 3 | HDPCD | Sqoop Import”

Post 2 | HDPCD | Sandbox Installation

This is the second post in this series. In this post, we are going to install Hortonworks Sandbox, which is the platform where we will practice our exam objectives. We are going to follow below step-by-step process to install Hortonworks Sandbox. As you can see from above picture, below are the steps to install andContinue reading “Post 2 | HDPCD | Sandbox Installation”

HDPCD Certification – Post 1

In this post series, I am going to talk about the Hortonworks Data Platform Certified Developer Certification, also known as HDPCD. We’ll kick-off the proceedings with the introduction to this certification exam and the things need to be covered in order to earn a verified digital badge, proving your certification. Therefore, few facts about thisContinue reading “HDPCD Certification – Post 1”