sahara-image-elements/elements/hadoop
Shu Yingya 12efcf84e2 Add support to build 2.8.2 image
Also tweak Hive a bit and refer to artifacts in a new (but not totally
ideal) location.

Co-Authored-By: Jeremy Freudberg <jeremyfreudberg@gmail.com>
Change-Id: I3a25ee8c282849911089adf6c3593b1bb50fd067
2018-03-01 09:51:01 +08:00
..
install.d Add support to build 2.8.2 image 2018-03-01 09:51:01 +08:00
root.d Adding rhel7 to elements checks 2016-09-20 17:28:02 -03:00
element-deps Start switching to declarative package-installs 2015-04-15 00:44:54 +08:00
package-installs.yaml fix firstboot script 2016-12-22 08:58:20 +00:00
pkg-map fix firstboot script 2016-12-22 08:58:20 +00:00
README.rst drop vanilla 2.6.0 support from elements 2016-08-22 17:41:05 +03:00

hadoop

Installs Java and Hadoop, configures SSH.

HOWTO build Hadoop Native Libs

  • Install: jdk >= 6, maven, cmake and protobuf >= 2.5.0

  • Get Hadoop source code:

    wget http://archive.apache.org/dist/hadoop/core/hadoop-2.7.1/hadoop-2.7.1-src.tar.gz
  • Unpack source:

    tar xvf hadoop-2.7.1-src.tar.gz
  • Build Hadoop:

    cd hadoop-2.7.1-src
    mvn package -Pdist,native -DskipTests
  • Create tarball with Hadoop Native Libs:

    cd hadoop-dist/target/hadoop-2.7.1/lib
    tar -czvf hadoop-native-libs-2.7.1.tar.gz native