RETIRED, Chef Cookbook - common OpenStack configuration
Go to file
Jens Harbott 29e07f27b2 Clean up URI handling
The two functions auth_uri_transform() and identity_uri_transform()
implicitly assume that the identity endpoint has no path component other
than 'v2.0'. This blocks modern deployment designs, so drop these
functions.

Probably will need some dependencies to clean up consumers of these
functions.

Change-Id: I711ff0c0f8d35c581d2a419debe50425ec0d51c2
2019-07-17 08:18:17 +00:00
.delivery Add delivery config 2018-04-11 22:09:31 -07:00
attributes Drop admin endpoints 2019-04-30 13:55:33 +00:00
libraries Clean up URI handling 2019-07-17 08:18:17 +00:00
providers Increment etcd to 5.5 2018-07-16 15:17:21 -07:00
recipes Pin setuptools and wheels packages 2018-12-13 23:50:51 -08:00
resources replaced libraries/database with lwrp 2015-06-08 10:58:13 +02:00
spec Clean up URI handling 2019-07-17 08:18:17 +00:00
templates/default Make configuration files more readable 2017-11-02 08:51:18 +01:00
.gitignore add a Rakefile to structure test runs 2014-09-29 13:44:38 +02:00
.gitreview Update .gitreview file for project rename 2015-06-12 23:12:29 +00:00
.rubocop_todo.yml starting rocky development patch 2018-08-03 06:20:56 -07:00
.rubocop.yml Transport url fix 2017-01-09 04:25:57 +00:00
.zuul.yaml Rename openstack-chef-repo references to openstack-chef 2018-08-06 21:49:17 -07:00
Berksfile common refactor for Pike and Chef 13 2018-01-11 17:42:41 +00:00
bootstrap.sh Replace openstack.org git:// URLs with https:// 2019-03-24 20:33:22 +00:00
CONTRIBUTING.md Workflow documentation is now in infra-manual 2014-12-05 03:30:43 +00:00
LICENSE Initial commit 2012-11-07 20:52:47 -05:00
metadata.rb Change openstack-dev to openstack-discuss 2018-12-04 23:20:57 -05:00
Rakefile Rename openstack-chef-repo references to openstack-chef 2018-08-06 21:49:17 -07:00
README.md Drop admin endpoints 2019-04-30 13:55:33 +00:00
TESTING.md Sync stackforge/cookbook* to openstack/cookbook* for common cookbook 2015-06-15 17:15:53 +08:00

Team and repository tags

Team and repository tags

Chef OpenStack Logo

Description

This cookbook provides common setup recipes, helper methods and attributes that describe an OpenStack deployment as part of the OpenStack reference deployment Chef for OpenStack.

Please relate to the official OpenStack Configuration Reference for a more detailed documentation on operating and administration of an OpenStack cluster:

http://docs.openstack.org/mitaka/config-reference/index.html

Requirements

  • Chef 12 or higher
  • chefdk 0.15.15 for testing (also includes berkshelf for cookbook dependency resolution)

Platform

  • ubuntu
  • redhat
  • centos

Cookbooks

The following cookbooks are dependencies:

  • 'apt', '~> 2.8'
  • 'database', '~> 4.0.2'
  • 'mariadb', '~> 0.3.1'
  • 'mysql', '~> 6.0.13'
  • 'yum', '~> 3.5.4'
  • 'yum-epel', '~> 0.6.0'
  • 'galera', '~> 0.4.1'

Attributes

Please see the extensive inline documentation in attributes/*.rb for descriptions of all the settable attributes for this cookbook.

Note that all attributes are in the default["openstack"] "namespace"

Attributes to generate OpenStack service configuration files

Since the mitaka release, we moved to a completely new way to generate all OpenStack service configuration files. The base template is the 'openstack-service.conf.erb' included in the templates of this cookbook. In each of the service cookbook (e.g. openstack-network, openstack-identity or openstack-compute), the service configuration file (e.g neutron.conf, keystone.conf or nova.conf) gets generated directly from attributes set inside of the cookbook. To merge all the configuration options (including the secrets) properly, before handing them over as '@service_config' to the mentioned template above, we use the methods defined in 'libraries/config_helpers'.

For examples how to use these attributes, please refer to the attribute files included in the service cookbooks (e.g. attributes/neutron_conf.rb in openstack-network or attributes/keystone_conf.rb in openstack-identity). The basic structure of all these attributes always follows this model:

# usual config option that should evventually be saved to the node object
default['openstack'][service]['conf'][section][key][value]
# configuration options like passwords that should not be saved in the node
# object
default['openstack'][service]['conf_secrets'][section][key][value]

Recipes

openstack-common::client

  • Install the common python openstack client package

openstack-common::default

  • Installs/Configures common recipes

openstack-common::logging

  • Installs/Configures common logging

openstack-common::sysctl

  • Iterates over the contents of the node['openstack']['sysctl'] hash and writes the entries to /etc/sysctl.d/60-openstack.conf.

Data Bags

This cookbook contains Libraries to work with passwords and secrets in databags. Databags can be unencrypted (for dev) or encrypted (for prod). In addition to traditionally encrypted data bags they can also be created as chef-vault items. To read more about chef-vault and how to use it, go to https://docs.chef.io/chef_vault.html.

Documentation for Attributes for selecting databag format can be found in the attributes section of this cookbook.

Documentation for format of these Databags can be found in the Openstack Chef Repo repository.

Resources

This cookbook provides the openstack_common_database LWRP, which replaces the old database library function 'db_create_with_user'. When this cookbook is included as dependency, this LWRP can be used to create databases needed by the OpenStack services.

depends 'openstack-common'
openstack_common_database 'compute' do
  service 'compute' # name_attribute
  user 'nova'
  pass 'supersecret'
end

An example of the usage can be seen here https://github.com/stackforge/cookbook-openstack-ops-database/blob/master/recipes/openstack-db.rb.

Libraries

This cookbook exposes a set of default library routines:

  • cli -- Used to call openstack CLIs
  • endpoint -- Used to return a ::URI object representing the named OpenStack endpoint
  • internal_endpoint -- Used to return a ::URI object representing the named OpenStack internal endpoint if one was specified. Otherwise, it will return the same value as endpoint.
  • public_endpoint -- Used to return a ::URI object representing the named OpenStack public endpoint if one was specified. Otherwise, it will return the same value as endpoint.
  • endpoints -- Useful for operating on all OpenStack endpoints
  • db -- Returns a Hash of information about a named OpenStack database
  • db_uri -- Returns the SQLAlchemy RFC-1738 DB URI (see: http://rfc.net/rfc1738.html) for a named OpenStack database
  • secret -- Returns the value of an encrypted data bag for a named OpenStack secret key and key-section
  • get_password -- Ease-of-use helper that returns the decrypted password for a named database, service or keystone user.
  • matchers -- A custom matcher(render_config_file) for testing ini format file section content by with_section_content.

Examples

The following are code examples showing the above library routines in action. Remember when using the library routines exposed by this library to include the Openstack routines in your recipe's ::Chef::Recipe namespace, like so:

class ::Chef::Recipe
  include ::Openstack
end

Example of using the endpoint routine:

nova_api_ep = endpoint "compute-api"
::Chef::Log.info("Using Openstack Compute API endpoint at #{nova_api_ep.to_s}")

# Note that endpoint URIs may contain variable interpolation markers such
# as `%(tenant_id)s`, so you may need to decode them. Do so like this:

require "uri"

puts ::URI.decode nova_api_ap.to_s

Example of using the get_password and db_uri routine:

db_pass = get_password "db" "cinder"
db_user = node["cinder"]["db"]["user"]
sql_connection = db_uri "volume", db_user, db_pass

template "/etc/cinder/cinder.conf" do
  source "cinder.conf.erb"
  owner  node["cinder"]["user"]
  group  node["cinder"]["group"]
  mode   00644
  variables(
    "sql_connection" => sql_connection
  )
end

URI Operations

Use the Openstack::uri_from_hash routine to helpfully return a ::URI::Generic object for a hash that contains any of the following keys:

  • host
  • uri
  • port
  • path
  • scheme

If the uri key is in the hash, that will be used as the URI, otherwise the URI will be constructed from the various parts of the hash corresponding to the keys above.

# Suppose node hash contains the following subhash in the :identity_service key:
# {
#   :host => 'identity.example.com',
#   :port => 5000,
#   :scheme => 'https'
# }
uri = ::Openstack::uri_from_hash(node[:identity_service])
# uri.to_s would == "https://identity.example.com:5000"

The routine will return nil if neither a uri or host key exists in the supplied hash.

Using the library without prefixing with ::Openstack

Don't like prefixing calls to the library's routines with ::Openstack? Do this:

class ::Chef::Recipe
  include ::Openstack
end

in your recipe.

License and Author

Author Jay Pipes (jaypipes@att.com)
Author John Dewey (jdewey@att.com)
Author Matt Ray (matt@opscode.com)
Author Craig Tracey (craigtracey@gmail.com)
Author Sean Gallagher (sean.gallagher@att.com)
Author Ionut Artarisi (iartarisi@suse.cz)
Author Chen Zhiwei (zhiwchen@cn.ibm.com)
Author Brett Campbell (brett.campbell@rackspace.com)
Author Mark Vanderwiel (vanderwl@us.ibm.com)
Author Jan Klare (j.klare@cloudbau.de)
Author Christoph Albers (c.albers@x-ion.de)
Copyright Copyright (c) 2012-2013, AT&T Services, Inc.
Copyright Copyright (c) 2013, Opscode, Inc.
Copyright Copyright (c) 2013, Craig Tracey
Copyright Copyright (c) 2013-2014, SUSE Linux GmbH
Copyright Copyright (c) 2013-2015, IBM, Corp.
Copyright Copyright (c) 2013-2014, Rackspace US, Inc.

Licensed under the Apache License, Version 2.0 (the "License"); you may not use this file except in compliance with the License. You may obtain a copy of the License at

http://www.apache.org/licenses/LICENSE-2.0

Unless required by applicable law or agreed to in writing, software distributed under the License is distributed on an "AS IS" BASIS, WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied. See the License for the specific language governing permissions and limitations under the License.