Geoprocessing Tools

Geoprocessing Tools

The geoprocessing tools listed below are provided to simplify interaction between ArcGIS and Hadoop components. They are written in python and you can find them at the root level of this repository.

• HadoopTools.pyt - Toolbox definition for ArcGIS along with Copy To HDFS and Copy From HDFS
• JSONUtil.py - Conversion from features to JSON and back
• OozieUtil.py - Interaction with Oozie workflow scheduler

---

Copy From HDFS

Copy From HDFS copies a file or directory from a remote HDFS to a local file system.

Usage Notes

• If the remote path is a directory and the local path is a directory, each file from the remote directory will be copied to the local directory.
• If the remote path is a directory and the local path is a file, each file from the remote directory will be appended to the local file with a new line to separate each file.
• If the remote path is a file and the local path is a file, the remote file will be copied to the local file path.

Copy To HDFS

Copy To HDFS copies a local file to a remote file with the option to either append or overwrite an existing file in the remote HDFS.

Execute Workflow

Execute Workflow executes an Oozie workflow application on a Hadoop system with the Oozie component installed.

Usage Notes

• This geoprocessing tool expects that the workflow XML has already been copied to HDFS and that the job properties file supplied to the tool points to that workflow.

Features To JSON

Features to JSON converts a feature class to a JSON file format. The JSON file format can be either Enclosed JSON or Unenclosed JSON. See JSON Formats.

JSON To Features

JSON to Features converts a JSON file to a feature layer