40b3594bda
Add a Spark element that installs Spark in the image. By default the script tries to find a suitable Spark version based on the Hadoop version string. For now only the Hadoop CDH installed by the hadoop-cdh element is supported. Environment variables can be used to select a different Spark version or use a custom Spark distribution, generated by hand. This element is going to be used to build images that will be configured and run by the Savanna Spark plugin. Change-Id: Icd4dfef792a7c112bdcccc8951f7e86892abbe86
Installs Spark on Ubuntu. Requires Hadoop CDH 4 (hadoop-cdh element).
It tries to choose the right version of the Spark binaries to install based on the Hadoop version defined in 'DIB_HADOOP_VERSION'. This behaviour can be controlled also by using 'DIB_SPARK_VERSION' or directly with 'SPARK_DOWNLOAD_URL'
If you set 'SPARK_CUSTOM_DISTRO' to 1, you can point the 'SPARK_DOWNLOAD_URL' variable to a custom Spark distribution created with the make-distribution.sh script included in Spark.