openstack/sahara-image-elements
Code Issues Proposed changes
787d4e807a
sahara-image-elements/elements
History
Matthew Farrellee f812f4168c Use archive.apache.org instead of www.apache.org 
The Apache Hive project has taken hive 0.11.0 down from
www.apache.org. However, it and newer versions are available from
archive.apache.org. This change uses archive over www.

Change-Id: I777c13b70bbc142e31d17fd6c8653aa1960ba532
2014-04-22 09:11:17 -04:00
..
apt-mirror Add diskimage-creating script, elements for mirrors 2013-09-05 19:50:43 +04:00
disable-firewall Remove all iptables rules that are set in base image 2014-03-14 18:13:03 +04:00
hadoop Add inject hadoop native libs to vanilla hadoop 2 2014-04-10 17:40:49 +04:00
hadoop-cdh Update hadoop-cdh element 2014-04-15 14:12:33 +02:00
hadoop-hdp Updates hadoop-hdp to use new project name in URL 2014-04-08 11:38:36 -04:00
hive Use archive.apache.org instead of www.apache.org 2014-04-22 09:11:17 -04:00
java Fix cookie for java download 2014-03-17 13:04:47 +04:00
mysql Add CentOS support 2013-12-06 16:04:25 +04:00
oozie Fix install Oozie for vanilla 2 plugin 2014-04-09 23:14:28 +04:00
redhat-lsb/pre-install.d Add CentOS support 2013-12-06 16:04:25 +04:00
root-passwd Setup password for root using variable 'DIB_PASSWORD' 2013-09-02 12:59:03 +04:00
sahara-version/install.d Renaming all Savanna references to Sahara 2014-03-13 15:26:47 +04:00
spark Add a Spark element 2014-02-06 11:48:54 +01:00
ssh Renaming all Savanna references to Sahara 2014-03-13 15:26:47 +04:00
swift_hadoop Disable hadoop swift element for vanilla 2 plugin 2014-03-21 12:13:47 +04:00
yum-mirror Add diskimage-creating script, elements for mirrors 2013-09-05 19:50:43 +04:00
.gitignore Add a .gitignore. 2013-09-02 12:58:57 +04:00
README.rst Renaming all Savanna references to Sahara 2014-03-13 15:26:47 +04:00

README.rst

Diskimage-builder tools for creation cloud images

Steps how to create cloud image with Apache Hadoop installed using diskimage-builder project:

  1. Clone the repository "https://github.com/openstack/diskimage-builder" locally. Note: Make sure you have commit 43b96d91 in your clone, it provides a mapping for default-jre.
git clone https://github.com/openstack/diskimage-builder
  1. Add ~/diskimage-builder/bin/ directory to your path (for example, PATH=$PATH:/home/$USER/diskimage-builder/bin/ ).
  2. Export the following variable ELEMENTS_PATH=/home/$USER/diskimage-builder/elements/ to your .bashrc. Then source it.
  3. Copy file "img-build-sudoers" from ~/disk-image-builder/sudoers.d/ to your /etc/sudoers.d/.
chmod 440 /etc/sudoers.d/img-build-sudoers
chown root:root /etc/sudoers.d/img-build-sudoers
  1. Export sahara-elements commit id variable (from sahara-extra directory):
export SAHARA_ELEMENTS_COMMIT_ID=`git show --format=%H | head -1`
  1. Move elements/ directory to disk-image-builder/elements/
mv elements/*  /path_to_disk_image_builder/diskimage-builder/elements/
  1. Export DIB commit id variable (from DIB directory):
export DIB_COMMIT_ID=`git show --format=%H | head -1`
  1. Call the following command to create cloud image is able to run on OpenStack:

8.1. Ubuntu cloud image

JAVA_FILE=jdk-7u21-linux-x64.tar.gz DIB_HADOOP_VERSION=1.2.1 OOZIE_FILE=oozie-4.0.0.tar.gz disk-image-create base vm hadoop oozie ubuntu root-passwd -o ubuntu_hadoop_1_2_1

8.2. Fedora cloud image

JAVA_FILE=jdk-7u21-linux-x64.tar.gz DIB_HADOOP_VERSION=1.2.1 OOZIE_FILE=oozie-4.0.0.tar.gz DIB_IMAGE_SIZE=10 disk-image-create base vm fedora hadoop root-passwd oozie -o fedora_hadoop_1_2_1

Note: If you are building this image from Ubuntu or Fedora 18 OS host, you should add element 'selinux-permissive'.

JAVA_FILE=jdk-7u21-linux-x64.tar.gz DIB_HADOOP_VERSION=1.2.1 OOZIE_FILE=oozie-4.0.0.tar.gz DIB_IMAGE_SIZE=10 disk-image-create base vm fedora hadoop root-passwd oozie selinux-permissive -o fedora_hadoop_1_2_1

In this command 'DIB_HADOOP_VERSION' parameter is version of hadoop needs to be installed. You can use 'JAVA_DOWNLOAD_URL' parameter to specify download link for JDK (tarball or bin). 'DIB_IMAGE_SIZE' is parameter that specifes a volume of hard disk of instance. You need to specify it because Fedora and CentOS don't use all available volume. If you have already downloaded the jdk package, move it to "elements/hadoop/install.d/" and use its filename as 'JAVA_FILE' parameter. In order of working EDP components with Sahara DIB images you need pre-installed Oozie libs. Use OOZIE_DOWNLOAD_URL to specify link to Oozie archive (tar.gz). For example we have built Oozie libs here: http://sahara-files.mirantis.com/oozie-4.0.0.tar.gz If you have already downloaded archive, move it to "elements/oozie/install.d/" and use its filename as 'OOZIE_FILE' parameter.