5.8 KiB

Raw Blame History

A Mesos cluster with Heat

These Heat templates will deploy a Mesos cluster.

Requirements

OpenStack

These templates will work with the Kilo version of Heat.

Guest image

These templates will work with Ubuntu 14.04 base image with the following middleware pre-installed:

docker
zookeeper
mesos
marathon

Building an image

If you do not have a suitable image you can build one easily using one of two methods:

Disk Image Builder

elements directory contains diskimage-builder elements to build an image which contains mesos and its frameworks required to use the heat template mesoscluster.yaml.

Currently, only Ubuntu 14.04 is supported. An example Ubuntu based image can be built and uploaded to glance as follows:

$ sudo apt-get update
$ sudo apt-get install git qemu-utils python-pip

$ git clone https://git.openstack.org/openstack/magnum
$ git clone https://git.openstack.org/openstack/diskimage-builder.git
$ git clone https://git.openstack.org/openstack/dib-utils.git
$ git clone https://git.openstack.org/openstack/tripleo-image-elements.git
$ git clone https://git.openstack.org/openstack/heat-templates.git
$ export PATH="${PWD}/dib-utils/bin:$PATH"
$ export ELEMENTS_PATH=tripleo-image-elements/elements:heat-templates/hot/software-config/elements:magnum/magnum/templates/mesos/elements
$ export DIB_RELEASE=trusty

$ diskimage-builder/bin/disk-image-create ubuntu vm docker mesos \
    os-collect-config os-refresh-config os-apply-config \
    heat-config heat-config-script \
    -o ubuntu-mesos.qcow2

$ glance image-create --name ubuntu-mesos --visibility public \
    --disk-format=qcow2 --container-format=bare \
    --os-distro=ubuntu --file=ubuntu-mesos.qcow2

Docker

Install docker using curl -sSL http://get.docker.com | sudo bash or use the appropriate system packaging.

Use the provided Dockerfile to build the image (it uses the same DIB scripts as above). The resultant image will be saved as /tmp/ubuntu-mesos.qcow2

$ sudo docker build -t magnum/mesos-builder .
$ sudo docker run -v /tmp:/output --rm -ti --privileged magnum/mesos-builder
...
Image file /output/ubuntu-mesos.qcow2 created...
$ glance image-create --name ubuntu-mesos --visibility public \
        --disk-format=qcow2 --container-format=bare \
        --os-distro=ubuntu --file=/tmp/ubuntu-mesos.qcow2

Creating the stack

Creating an environment file local.yaml with parameters specific to your environment:

parameters:
  ssh_key_name: testkey
  external_network: public
  dns_nameserver: 8.8.8.8
  server_image: ubuntu-mesos

The parameters above will create a stack with one master node. If you want to create a stack with multiple master nodes (HA mode), create a file like below:

parameters:
  ssh_key_name: testkey
  external_network: public
  dns_nameserver: 8.8.8.8
  server_image: ubuntu-mesos
  number_of_masters: 3

And then create the stack, referencing that environment file:

heat stack-create -f mesoscluster.yaml -e local.yaml my-mesos-cluster

You must provide value for:

ssh_key_name

You can optionally provide values for:

server_image (ubuntu-mesos if not provided)
external_network (public if not provided)
dns_nameserver (8.8.8.8 if not provided)

Interacting with Mesos

You can get the ip address of the Mesos master using the heat output-show command:

$ heat output-show my-mesos-cluster mesos_master
[
  "192.168.200.86"
]

You can ssh into that server as the ubuntu user:

$ ssh ubuntu@192.168.200.86

You can log into your agents using the ubuntu user as well. You can get a list of agents addresses by running:

$ heat output-show my-mesos-cluster mesos_agents
[
  "192.168.200.182"
]

Testing

Docker containers can be deployed via Marathon's REST API. Marathon is a mesos framework for long running applications.

We can 'post' a JSON app description to http://${MASTER_IP}:8080/apps to deploy a Docker container. In this example, the ${MASTER_IP} is 192.168.200.86.

$ cat > app.json << END
{
  "container": {
    "type": "DOCKER",
    "docker": {
      "image": "libmesos/ubuntu"
    }
  },
  "id": "ubuntu",
  "instances": 1,
  "cpus": 0.5,
  "mem": 512,
  "uris": [],
  "cmd": "while sleep 10; do date -u +%T; done"
}
END
$ MASTER_IP=$(heat output-show my-mesos-cluster api_address | tr -d '"')
$ curl -X POST -H "Content-Type: application/json" \
    http://${MASTER_IP}:8080/v2/apps -d@app.json

Using the Marathon web console (at http://${MASTER_IP}:8080/), you will see the application you created.

License

Licensed under the Apache License, Version 2.0 (the "License"); you may not use these files except in compliance with the License. You may obtain a copy of the License at

http://www.apache.org/licenses/LICENSE-2.0

Unless required by applicable law or agreed to in writing, software distributed under the License is distributed on an "AS IS" BASIS, WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied. See the License for the specific language governing permissions and limitations under the License.

5.8 KiB Raw Blame History