openstack/sahara-image-elements

History

Jeremy Freudberg a77a9a978a Add S3 jar to Hadoop classpath As prereq of support for S3 datasource, the hadoop-aws jar needs to be in the Hadoop classpath. The jar is copied into the proper folder when possible on the appropriate plugins, and otherwise can be provided from a download URL by the user. Additionally, set the correct value of DIB_HDFS_LIB_DIR on the Vanilla plugin to avoid any unnecessary simlinking. Partially-Implements: bp sahara-support-s3 Change-Id: I94c5b0055b87f6a4e1382118d0718e588fccfe87		2017-07-28 14:01:01 +00:00
..
post-install.d	Add support to create CDH 5.11 images	2017-07-25 17:26:40 +00:00
element-deps	Start switching to declarative package-installs	2015-04-15 00:44:54 +08:00
package-installs.yaml	Start switching to declarative package-installs	2015-04-15 00:44:54 +08:00
README.rst	Add S3 jar to Hadoop classpath	2017-07-28 14:01:01 +00:00

README.rst

swift_hadoop

Install the Hadoop swift connector jar file into the image. By default, this jar file is generated from the sources available in the sahara-extras repository.

Environment Variables

swift_url

Required: No
Default: http://sahara-files.mirantis.com/hadoop-swift/hadoop-swift-latest.jar
Description: Location of the swift jar file.

DIB_HDFS_LIB_DIR

Required: No
Default: /usr/share/hadoop/lib
Description: Directory in the guest where to save the swift jar. Shared with s3_hadoop.

DIB_HADOOP_SWIFT_JAR_NAME

Required: No
Default: hadoop-openstack.jar
Description: Filename of the deployed swift jar.