Improve the formatting of README.rst of elements: - proper syntax for bash snippets - improve list formatting - use list definitions for environment variariables - remove the explicit bash usage from diskimage-create.sh invocations - wrap lines at 80 characters - various small text formattings Change-Id: I93b4c35b31dac66af22663b2cec426a08fa73bd8
spark
Installs Spark on Ubuntu. Requires Hadoop CDH 4
(hadoop-cdh element).
It will install a version of Spark known to be compatible with CDH 4;
this behaviour can be controlled also by using
DIB_SPARK_VERSION or directly with
SPARK_DOWNLOAD_URL.
Environment Variables
- DIB_HADOOP_VERSION
-
- Required
-
Yes, if
SPARK_DOWNLOAD_URLis not set. - Description
-
Version of the Hadoop platform. See also http://spark.apache.org/docs/latest/hadoop-third-party-distributions.html.
- Example
-
DIB_HADOOP_VERSION=CDH4
- DIB_SPARK_VERSION
-
- Required
-
No
- Default
-
Depends on
DIB_HADOOP_VERSION. - Description
-
Version of Spark to download from apache.org.
- SPARK_DOWNLOAD_URL
-
- Required
-
Yes, if
DIB_HADOOP_VERSIONis not set. - Default
-
http://archive.apache.org/dist/spark/spark-$DIB_SPARK_VERSION/spark-$DIB_SPARK_VERSION-bin-$SPARK_HADOOP_DL.tgz - Description
-
Download URL of the Spark package.