Data Factory with Pig

Overview/Description
Hadoop is an open source software for affordable supercomputing. It provides the distributed file system and the parallel processing required to run a massive computing cluster. This course explains Pig as a data flow scripting tool for interfacing with Hadoop. You'll learn about the installation and configuration of Pig and explore a demonstration of Pig in action.

Target Audience
Technical personnel with a background in Linux, SQL, and programming who intend to join a Hadoop Engineering team in roles such as Hadoop developer, data architect, or data engineer or roles related to technical project management, cluster operations, or data analysis

Prerequisites
None

Expected Duration (hours)
1.5

Lesson Objectives

Data Factory with Pig

• start the course
• describe Pig and its strengths
• recall the minimal edits needed to be made to the configuration file
• install and configure Pig
• recall the complex data types used by Pig
• recall some of the relational operators used by Pig
• use the Grunt shell with Pig Latin
• set parameters from both a text file and with the command line
• write a Pig script
• use a Pig script to filter data
• use the FOREACH operator with a Pig script
• set parameters and arguments in a Pig script
• write a Pig script to count data
• perform data joins using a Pig script
• group data using a Pig script
• cogroup data with a Pig script
• flatten data using a pig script
• recall the languages that can be used to write user defined functions
• create a user defined function for Pig
• recall the different types of error categories
• use explain in a Pig script
• install Pig, use Pig operators and Pig Latin, and retrieve and group records