openstack/sahara-image-elements
Code Issues Proposed changes
8cdff5d71f
sahara-image-elements/elements/hadoop
History
Jeremy Freudberg 3ee20cbc09 Revise s3_hadoop 
* Handle Hadoop classpath better
* Include proper support for Spark classpath
* Formally limit element's use to Vanilla and Spark

Change-Id: I65abd7e375dba11599a4ab943d24f878235cd71d
Closes-Bug: #1727757
Closes-Bug: #1728061
2018-02-07 05:58:44 +00:00
..
install.d Revise s3_hadoop 2018-02-07 05:58:44 +00:00
root.d Adding rhel7 to elements checks 2016-09-20 17:28:02 -03:00
element-deps Start switching to declarative package-installs 2015-04-15 00:44:54 +08:00
package-installs.yaml fix firstboot script 2016-12-22 08:58:20 +00:00
pkg-map fix firstboot script 2016-12-22 08:58:20 +00:00
README.rst drop vanilla 2.6.0 support from elements 2016-08-22 17:41:05 +03:00

README.rst

hadoop

Installs Java and Hadoop, configures SSH.

HOWTO build Hadoop Native Libs

  • Install: jdk >= 6, maven, cmake and protobuf >= 2.5.0

  • Get Hadoop source code:

    wget http://archive.apache.org/dist/hadoop/core/hadoop-2.7.1/hadoop-2.7.1-src.tar.gz

  • Unpack source:

    tar xvf hadoop-2.7.1-src.tar.gz

  • Build Hadoop:

    cd hadoop-2.7.1-src
mvn package -Pdist,native -DskipTests

  • Create tarball with Hadoop Native Libs:

    cd hadoop-dist/target/hadoop-2.7.1/lib
tar -czvf hadoop-native-libs-2.7.1.tar.gz native