Hadoop Development Onboarding (Linux, Single Cluster)

The following instructions outline how to set up your Hadoop development environment. The instructions are aimed to be agnostic of the platform the stack is installed on, so a working knowledge of the specifics of your GNU/Linux distribution or other such Unix based operating system is assumed.

Prerequisites

Before beginning, please ensure that you have the following tools installed, using your favorite package manager to install them where applicable.

Hardware

• At least 4 GB of RAM
• At least 20 GB of free storage space
• A CPU with 64-bit architecture

Tools and dependency managers

• java (JDK >= 8)
• hadoop (Hadoop version >= 2.7.1)

Setup