sahara-image-elements

Files

iberezovskiy d18337c542 Use stable apache urls in spark elements

Backport from master branch (https://review.openstack.org/#/c/96506/)

Change-Id: I7a24244d98207856609b5f5ad62c4196f15d1399

2014-06-23 11:39:38 +04:00

install.d

Use stable apache urls in spark elements

2014-06-23 11:39:38 +04:00

root.d

Add a Spark element

2014-02-06 11:48:54 +01:00

element-deps

Add a Spark element

2014-02-06 11:48:54 +01:00

README.md

Add a Spark element

2014-02-06 11:48:54 +01:00

README.md

Installs Spark on Ubuntu. Requires Hadoop CDH 4 (hadoop-cdh element).

It tries to choose the right version of the Spark binaries to install based on the Hadoop version defined in 'DIB_HADOOP_VERSION'. This behaviour can be controlled also by using 'DIB_SPARK_VERSION' or directly with 'SPARK_DOWNLOAD_URL'

If you set 'SPARK_CUSTOM_DISTRO' to 1, you can point the 'SPARK_DOWNLOAD_URL' variable to a custom Spark distribution created with the make-distribution.sh script included in Spark.