sahara-image-elements/elements/hadoop
Pino Toscano bc4811d7a4 hadoop: move scripts from post-install.d to install.d
As also the previous comment on the top of 40-setup-hadoop said, this
was done because the Hadoop v1 RPM was buggy, so it needed to be
installed after the rest of the system is set up.

Since the support for Hadoop v1 has been dropped, the installation of
Hadoop can be done in install.d.

Change-Id: If3b0f8f595d6bf36017e63d331b5c1f7faa532e2
2015-09-18 16:15:56 +02:00
..
install.d hadoop: move scripts from post-install.d to install.d 2015-09-18 16:15:56 +02:00
root.d Drop hadoop/vanilla v1 images 2015-09-14 17:54:20 +02:00
README.rst Improvements to README.rst of elements 2015-04-29 18:41:30 +02:00
element-deps Start switching to declarative package-installs 2015-04-15 00:44:54 +08:00
package-installs.yaml hadoop: move scripts from post-install.d to install.d 2015-09-18 16:15:56 +02:00

README.rst

hadoop

Installs Java and Hadoop, configures SSH.

HOWTO build Hadoop Native Libs

  • Install: jdk >= 6, maven, cmake and protobuf >= 2.5.0

  • Get Hadoop source code:

    wget http://archive.apache.org/dist/hadoop/core/hadoop-2.6.0/hadoop-2.6.0-src.tar.gz
  • Unpack source:

    tar xvf hadoop-2.6.0-src.tar.gz
  • Build Hadoop:

    cd hadoop-2.6.0-src
    mvn package -Pdist,native -DskipTests
  • Create tarball with Hadoop Native Libs:

    cd hadoop-dist/target/hadoop-2.6.0/lib
    tar -czvf hadoop-native-libs-2.6.0.tar.gz native