openstack/sahara-image-elements
Code Issues Proposed changes
sahara-image-elements/elements/spark/README.md
Daniele Venzano c9117f821f Update Spark element 
Fix Spark element to work with the updated hadoop-cdh element.
Install Spark version 0.9.1 in /opt so that the default user can connect
and immediately start working.
Setup a short firstboot script to take care of file permissions for the
ubuntu user.

Change-Id: I2ab1f810e340b75cf368dd1647816e1d725dd916
2014-05-05 08:52:36 +02:00

428 B
Raw Blame History

Installs Spark on Ubuntu. Requires Hadoop CDH 4 (hadoop-cdh element).

It will install a version of Spark known to be compatible with CDH 4 This behaviour can be controlled also by using 'DIB_SPARK_VERSION' or directly with 'SPARK_DOWNLOAD_URL'

If you set 'SPARK_CUSTOM_DISTRO' to 1, you can point the 'SPARK_DOWNLOAD_URL' variable to a custom Spark distribution created with the make-distribution.sh script included in Spark.