Creating an Hadoop Cluster on Docker

Hi at all,
sometimes, for testing purpose, having a mini cluster can be useful. Unfortunately, it may be expensive.

This script creates a cluster on Docker-based on Cloudera CDH 5.9. It is based on Loicmathieu’s work, more information are available at https://github.com/loicmathieu/docker-cdh/tree/master/cloudera-cdh-edgenode.
You can use this script in this way:

sh createCluster.sh NetworkName NumberOfDatanodes

At the end, you will have a Cluster on Docker composed by:

  • 1 Yarnnode
  • 1 Namenode
  • N DataNodes
  • 1 EdgeNode

Sharing is caring!

Leave a Reply