fuel-library/deployment/puppet/rabbitmq
Bogdan Dobrelya f0ce9c4e4a Adjust rmq stats collector settings
The stats collector falls behind under
high load on the messaging system.
The suggested optimization is to increase
the stats polling and disable rates
processing in management UI:
rabbit.collect_statistics_interval=30000
rabbitmq_management.rates_mode=none.
The new hiera parameter rabbit_config_management_variables
may be used to override the rates_mode to other values.

Related upstream PR
https://github.com/puppetlabs/puppetlabs-rabbitmq/pull/407

DocImpact
Closes-bug: #1510835

Change-Id: I9a3179a4f002064c9b6d2621a49bb0aa9aa707c7
Signed-off-by: Bogdan Dobrelya <bdobrelia@mirantis.com>
2015-10-28 14:57:48 +01:00
..
files Rabbitmq ocf master/slave (WORK IN PROGRESS) 2014-06-19 11:52:15 +00:00
lib Change rabbitmq internal api call to public one 2015-08-03 19:38:25 +00:00
manifests Adjust rmq stats collector settings 2015-10-28 14:57:48 +01:00
spec Adjust rmq stats collector settings 2015-10-28 14:57:48 +01:00
templates Adjust rmq stats collector settings 2015-10-28 14:57:48 +01:00
tests Sync puppetlabs rabbitmq module 2015-01-09 16:11:20 +01:00
.fixtures.yml Sync puppetlabs rabbitmq module 2015-01-09 16:11:20 +01:00
.gitignore Sync puppetlabs rabbitmq module 2015-01-09 16:11:20 +01:00
.nodeset.yml Sync puppetlabs rabbitmq module 2015-01-09 16:11:20 +01:00
.travis.yml Adapt rabbitmq module for Fuel 2015-01-09 16:11:28 +01:00
CHANGELOG Sync puppetlabs rabbitmq module 2015-01-09 16:11:20 +01:00
CHANGELOG.md Adapt rabbitmq module for Fuel 2015-01-09 16:11:28 +01:00
Gemfile Adapt rabbitmq module for Fuel 2015-01-09 16:11:28 +01:00
LICENSE Sync puppetlabs rabbitmq module 2015-01-09 16:11:20 +01:00
metadata.json Adapt rabbitmq module for Fuel 2015-01-09 16:11:28 +01:00
Rakefile Adapt rabbitmq module for Fuel 2015-01-09 16:11:28 +01:00
README.md Adjust rmq stats collector settings 2015-10-28 14:57:48 +01:00
TODO updated README and TODO. 2011-06-14 11:19:31 -07:00

#rabbitmq

####Table of Contents

  1. Overview
  2. Module Description - What the module does and why it is useful
  3. Setup - The basics of getting started with rabbitmq
  4. Usage - Configuration options and additional functionality
  5. Reference - An under-the-hood peek at what the module is doing and how
  6. Limitations - OS compatibility, etc.
  7. Development - Guide for contributing to the module

##Overview

This module manages RabbitMQ (www.rabbitmq.com)

##Module Description The rabbitmq module sets up rabbitmq and has a number of providers to manage everything from vhosts to exchanges after setup.

This module has been tested against 2.7.1 and is known to not support all features against earlier versions.

##Setup

###What rabbitmq affects

  • rabbitmq repository files.
  • rabbitmq package.
  • rabbitmq configuration file.
  • rabbitmq service.

###Beginning with rabbitmq

include '::rabbitmq'

##Usage

All options and configuration can be done through interacting with the parameters on the main rabbitmq class. These are documented below.

##rabbitmq class

To begin with the rabbitmq class controls the installation of rabbitmq. In here you can control many parameters relating to the package and service, such as disabling puppet support of the service:

class { '::rabbitmq':
  service_manage    => false,
  port              => '5672',
  delete_guest_user => true,
}

Or such as offline installation from intranet or local mirrors:

class { '::rabbitmq':
   key_content      => template('openstack/rabbit.pub.key'),
   package_gpg_key  => '/tmp/rabbit.pub.key',
}

And this one will use external package key source for any (apt/rpm) package provider:

class { '::rabbitmq':
   package_gpg_key  => 'http://www.some_site.some_domain/some_key.pub.key',
}

Environment Variables

To use RabbitMQ Environment Variables, use the parameters environment_variables e.g.:

class { 'rabbitmq':
  port              => '5672',
  environment_variables   => {
    'NODENAME'     => 'node01',
    'SERVICENAME'  => 'RabbitMQ'
  }
}

Variables Configurable in rabbitmq.config

To change RabbitMQ Config Variables in rabbitmq.config, use the parameters config_variables e.g.:

class { 'rabbitmq':
  port              => '5672',
  config_variables   => {
    'hipe_compile'  => true,
    'frame_max'     => 131072,
    'log_levels'    => "[{connection, info}]"
  }
}

To change Erlang Kernel Config Variables in rabbitmq.config, use the parameters config_kernel_variables e.g.:

class { 'rabbitmq':
  port              => '5672',
  config_kernel_variables  => {
    'inet_dist_listen_min' => 9100,
    'inet_dist_listen_max' => 9105,
  }
}

To change Management Plugin Config Variables in rabbitmq.config, use the parameters config_rabbitmq_management_variables e.g.:

class { 'rabbitmq':
  config_rabbitmq_management_variables  => {
    'rates_mode' => 'basic',
  }
}

Clustering

To use RabbitMQ clustering facilities, use the rabbitmq parameters config_cluster, cluster_nodes, and cluster_node_type, e.g.:

class { 'rabbitmq':
  config_cluster    => true,
  cluster_nodes     => ['rabbit1', 'rabbit2'],
  cluster_node_type => 'ram',
}

##Reference

##Classes

  • rabbitmq: Main class for installation and service management.
  • rabbitmq::config: Main class for rabbitmq configuration/management.
  • rabbitmq::install: Handles package installation.
  • rabbitmq::params: Different configuration data for different systems.
  • rabbitmq::service: Handles the rabbitmq service.
  • rabbitmq::repo::apt: Handles apt repo for Debian systems.
  • rabbitmq::repo::rhel: Handles rpm repo for Redhat systems.

###Parameters

####admin_enable

Boolean, if enabled sets up the management interface/plugin for RabbitMQ.

####cluster_node_type

Choose between disk and ram nodes.

####cluster_nodes

An array of nodes for clustering.

####cluster_partition_handling

Value to set for cluster_partition_handling RabbitMQ configuration variable.

####config

The file to use as the rabbitmq.config template.

####config_cluster

Boolean to enable or disable clustering support.

####config_kernel_variables

Hash of Erlang kernel configuration variables to set (see Variables Configurable in rabbitmq.config).

####config_mirrored_queues

DEPRECATED

Configuring queue mirroring should be done by setting the according policy for the queue. You can read more about it here

####config_path

The path to write the RabbitMQ configuration file to.

####config_stomp

Boolean to enable or disable stomp.

####config_variables

To set config variables in rabbitmq.config

####default_user

Username to set for the default_user in rabbitmq.config.

####default_pass

Password to set for the default_user in rabbitmq.config.

####delete_guest_user

Boolean to decide if we should delete the default guest user.

####env_config

The template file to use for rabbitmq_env.config.

####env_config_path

The path to write the rabbitmq_env.config file to.

####environment_variables

RabbitMQ Environment Variables in rabbitmq_env.config

####erlang_cookie

The erlang cookie to use for clustering - must be the same between all nodes. This value has no default and must be set explicitly if using clustering.

###key_content

Uses content method for Debian OS family. Should be a template for apt::source class. Overrides package_gpg_key behavior, if enabled. Undefined by default.

####ldap_auth

Boolean, set to true to enable LDAP auth.

####ldap_server

LDAP server to use for auth.

####ldap_user_dn_pattern

User DN pattern for LDAP auth.

####ldap_use_ssl

Boolean, set to true to use SSL for the LDAP server.

####ldap_port

Numeric port for LDAP server.

####ldap_log

Boolean, set to true to log LDAP auth.

####manage_repos

Boolean, whether or not to manage package repositories.

####management_port

The port for the RabbitMQ management interface.

####node_ip_address

The value of NODE_IP_ADDRESS in rabbitmq_env.config

####package_ensure

Determines the ensure state of the package. Set to installed by default, but could be changed to latest.

####package_gpg_key

RPM package GPG key to import. Uses source method. Should be a URL for Debian/RedHat OS family, or a file name for RedHat OS family. Set to http://www.rabbitmq.com/rabbitmq-signing-key-public.asc by default. Note, that key_content, if specified, would override this parameter for Debian OS family.

####package_name

The name of the package to install.

####package_provider

What provider to use to install the package.

####package_source

Where should the package be installed from?

On Debian- and Arch-based systems using the default package provider, this parameter is ignored and the package is installed from the rabbitmq repository, if enabled with manage_repo => true, or from the system repository otherwise. If you want to use dpkg as the package_provider, you must specify a local package_source.

####plugin_dir

Location of RabbitMQ plugins.

####port

The RabbitMQ port.

####service_ensure

The state of the service.

####service_manage

Determines if the service is managed.

####service_name

The name of the service to manage.

####ssl

Configures the service for using SSL.

####ssl_only

Configures the service to only use SSL. No cleartext TCP listeners will be created. Requires that ssl => true also.

####ssl_cacert

CA cert path to use for SSL.

####ssl_cert

Cert to use for SSL.

####ssl_key

Key to use for SSL.

####ssl_management_port

SSL management port.

####ssl_stomp_port

SSL stomp port.

####ssl_verify

rabbitmq.config SSL verify setting.

####ssl_fail_if_no_peer_cert

rabbitmq.config fail_if_no_peer_cert setting.

####stomp_port

The port to use for Stomp.

####stomp_ensure

Boolean to install the stomp plugin.

####tcp_keepalive

Boolean to enable TCP connection keepalive for RabbitMQ service.

####version

Sets the version to install.

On Debian- and Arch-based operating systems, the version parameter is ignored and the latest version is installed from the rabbitmq repository, if enabled with manage_repo => true, or from the system repository otherwise.

####wipe_db_on_cookie_change

Boolean to determine if we should DESTROY AND DELETE the RabbitMQ database.

##Native Types

rabbitmq_user

query all current users: $ puppet resource rabbitmq_user

rabbitmq_user { 'dan':
  admin    => true,
  password => 'bar',
}

Optional parameter tags will set further rabbitmq tags like monitoring, policymaker, etc. To set the administrator tag use admin-flag.

rabbitmq_user { 'dan':
  admin    => true,
  password => 'bar',
  tags     => ['monitoring', 'tag1'],
}

rabbitmq_vhost

query all current vhosts: $ puppet resource rabbitmq_vhost

rabbitmq_vhost { 'myhost':
  ensure => present,
}

rabbitmq_exchange

rabbitmq_exchange { 'myexchange@myhost':
  user     => 'dan',
  password => 'bar',
  type     => 'topic',
  ensure   => present,
}

rabbitmq_user_permissions

rabbitmq_user_permissions { 'dan@myhost':
  configure_permission => '.*',
  read_permission      => '.*',
  write_permission     => '.*',
}

rabbitmq_policy

rabbitmq_policy { 'ha-all@myhost':
  pattern    => '.*',
  priority   => 0,
  applyto    => 'all',
  definition => {
    'ha-mode'      => 'all',
    'ha-sync-mode' => 'automatic',
  },
}

rabbitmq_plugin

query all currently enabled plugins $ puppet resource rabbitmq_plugin

rabbitmq_plugin {'rabbitmq_stomp':
  ensure => present,
}

This is essentially a private type used by the rabbitmq::config class to manage the erlang cookie. It replaces the rabbitmq_erlang_cookie fact from earlier versions of this module. It manages the content of the cookie usually located at /var/lib/rabbitmq/.erlang.cookie, which includes stopping the rabbitmq service and wiping out the database at /var/lib/rabbitmq/mnesia if the user agrees to it. We don't recommend using this type directly.

##Limitations

This module has been built on and tested against Puppet 3.x.

The module has been tested on:

  • RedHat Enterprise Linux 5/6
  • Debian 6/7
  • CentOS 5/6
  • Ubuntu 12.04/14.04

Testing on other platforms has been light and cannot be guaranteed.

Module dependencies

If running CentOS/RHEL, and using the yum provider, ensure the epel repo is present.

To have a suitable erlang version installed on RedHat and Debian systems, you have to install another puppet module from http://forge.puppetlabs.com/garethr/erlang with:

puppet module install garethr-erlang

This module handles the packages for erlang. To use the module, add the following snippet to your site.pp or an appropriate profile class:

For RedHat systems:

include 'erlang'
class { 'erlang': epel_enable => true}

For Debian systems:

include 'erlang'
package { 'erlang-base':
  ensure => 'latest',
}

Downgrade Issues

Be advised that there were configuration file syntax and other changes made between RabbitMQ versions 2 and 3. In order to downgrade from 3 to 2 (not that this is a terribly good idea) you will need to manually remove all RabbitMQ configuration files (/etc/rabbitmq) and the mnesia directory (usually /var/lib/rabbitmq/mnesia). The latter action will delete any and all messages stored to disk.

Failure to do this will result in RabbitMQ failing to start with a cryptic error message about "init terminating in do_boot", containing "rabbit_upgrade,maybe_upgrade_mnesia".

##Development

Puppet Labs modules on the Puppet Forge are open projects, and community contributions are essential for keeping them great. We cant access the huge number of platforms and myriad of hardware, software, and deployment configurations that Puppet is intended to serve.

We want to keep it as easy as possible to contribute changes so that our modules work in your environment. There are a few guidelines that we need contributors to follow so that we can have a chance of keeping on top of things.

You can read the complete module contribution guide on the Puppet Labs wiki.

Authors