0300afc2c1
Change-Id: Id3294bf5180b7336193c3127a26f069703ec4705 Story: 2007996 Task: 40636 |
||
---|---|---|
.. | ||
images | ||
core-default.xml | ||
hdfs-default.xml | ||
README.rst | ||
spark-cleanup.cron | ||
spark-env.sh.template | ||
tmp-cleanup.sh.template | ||
topology.sh |
Apache Spark and HDFS Configurations for Sahara
This directory contains default XML configuration files and Spark scripts:
- core-default.xml,
- hdfs-default.xml,
- spark-env.sh.template,
- topology.sh
These files are used by Sahara's plugin for Apache Spark and Cloudera HDFS. XML config files were taken from here: * https://github.com/apache/hadoop-common/blob/release-1.2.1/src/core/core-default.xml * https://github.com/apache/hadoop-common/blob/release-1.2.1/src/hdfs/hdfs-default.xml
Cloudera packages use the same configuration files as standard Apache Hadoop.
XML configs are used to expose default Hadoop configurations to the users through Sahara's REST API. It allows users to override some config values which will be pushed to the provisioned VMs running Hadoop services as part of appropriate xml config.