History

Sergey Lukjanov 7e6844aef5 Hadoop-Swift integration jar moved to the CDN All related docs are already duplicated at savanna.rtfd.org Change-Id: I9c7988bd9cffba6cca2ab4125cbb81b28b52e799		2013-08-23 00:13:30 +04:00
..
hadoop	Using 'selinux-permissive' element instead of command 'setenforce 0'	2013-08-14 14:34:42 +04:00
oozie	Fix Oozie element	2013-08-14 17:08:51 +04:00
root-passwd	Setup password for root using variable 'DIB_PASSWORD'	2013-07-25 17:14:56 +04:00
savanna-version/install.d	Add element savanna-version that write commit id into the image	2013-08-13 14:32:13 +04:00
swift_hadoop	Hadoop-Swift integration jar moved to the CDN	2013-08-23 00:13:30 +04:00
.gitignore	Add a .gitignore.	2013-06-07 10:58:11 +12:00
README.rst	Using 'selinux-permissive' element instead of command 'setenforce 0'	2013-08-14 14:34:42 +04:00

README.rst

Diskimage-builder tools for creation cloud images

Steps how to create cloud image with Apache Hadoop installed using diskimage-builder project:

Clone the repository "https://github.com/stackforge/diskimage-builder" locally.

git clone https://github.com/stackforge/diskimage-builder

Add ~/diskimage-builder/bin/ directory to your path (for example, PATH=$PATH:/home/$USER/diskimage-builder/bin/ ).
Export the following variable ELEMENTS_PATH=/home/$USER/diskimage-builder/elements/ to your .bashrc. Then source it.
Copy file "img-build-sudoers" from ~/disk-image-builder/sudoers.d/ to your /etc/sudoers.d/.

chmod 440 /etc/sudoers.d/img-build-sudoers
chown root:root /etc/sudoers.d/img-build-sudoers

Export savanna-elements commit id variable (from savanna-extra directory):

export SAVANNA_ELEMENTS_COMMIT_ID=`git show --format=%H | head -1`

Move elements/ directory to disk-image-builder/elements/

mv elements/*  /path_to_disk_image_builder/diskimage-builder/elements/

Export DIB commit id variable (from DIB directory):

export DIB_COMMIT_ID=`git show --format=%H | head -1`

Call the following command to create cloud image is able to run on OpenStack:

8.1. Ubuntu cloud image

JAVA_FILE=jdk-7u21-linux-x64.tar.gz DIB_HADOOP_VERSION=1.1.2 OOZIE_FILE=oozie-3.3.2.tar.gz disk-image-create base vm hadoop oozie ubuntu root-passwd -o ubuntu_hadoop_1_1_2

8.2. Fedora cloud image

JAVA_FILE=jdk-7u21-linux-x64.tar.gz DIB_HADOOP_VERSION=1.1.2 OOZIE_FILE=oozie-3.3.2.tar.gz DIB_IMAGE_SIZE=10 disk-image-create base vm fedora hadoop root-passwd oozie -o fedora_hadoop_1_1_2

Note: If you are building this image from Ubuntu or Fedora 18 OS host, you should add element 'selinux-permissive'.

JAVA_FILE=jdk-7u21-linux-x64.tar.gz DIB_HADOOP_VERSION=1.1.2 OOZIE_FILE=oozie-3.3.2.tar.gz DIB_IMAGE_SIZE=10 disk-image-create base vm fedora hadoop root-passwd oozie selinux-permissive -o fedora_hadoop_1_1_2

In this command 'DIB_HADOOP_VERSION' parameter is version of hadoop needs to be installed. You can use 'JAVA_DOWNLOAD_URL' parameter to specify download link for JDK (tarball or bin). 'DIB_IMAGE_SIZE' is parameter that specifes a volume of hard disk of instance. You need to specify it because Fedora doesn't use all available volume. If you have already downloaded the jdk package, move it to "elements/hadoop/install.d/" and use its filename as 'JAVA_FILE' parameter. In order of working EDP components with Savanna DIB images you need pre-installed Oozie libs. Use OOZIE_DOWNLOAD_URL to specify link to Oozie archive (tar.gz). For example we have built Oozie libs here: http://a8e0dce84b3f00ed7910-a5806ff0396addabb148d230fde09b7b.r31.cf1.rackcdn.com/oozie-3.3.2.tar.gz If you have already downloaded archive, move it to "elements/oozie/install.d/" and use its filename as 'OOZIE_FILE' parameter.