MySQL InnoDB Cluster Charm
MySQL InnoDB Cluster Charm deploys and manages the lifecycle of a MySQL InnoDB Cluster.
This commit is contained in:
commit
5d213c699a
|
@ -0,0 +1,13 @@
|
||||||
|
.tox
|
||||||
|
.stestr
|
||||||
|
*__pycache__*
|
||||||
|
*.pyc
|
||||||
|
build
|
||||||
|
interfaces
|
||||||
|
layers
|
||||||
|
README.ex
|
||||||
|
|
||||||
|
# Remove these
|
||||||
|
src/tests/mysqlsh.snap
|
||||||
|
src/tests/bundles/overlays/local-charm-overlay.yaml.j2
|
||||||
|
manual-attach.sh
|
|
@ -0,0 +1,202 @@
|
||||||
|
|
||||||
|
Apache License
|
||||||
|
Version 2.0, January 2004
|
||||||
|
http://www.apache.org/licenses/
|
||||||
|
|
||||||
|
TERMS AND CONDITIONS FOR USE, REPRODUCTION, AND DISTRIBUTION
|
||||||
|
|
||||||
|
1. Definitions.
|
||||||
|
|
||||||
|
"License" shall mean the terms and conditions for use, reproduction,
|
||||||
|
and distribution as defined by Sections 1 through 9 of this document.
|
||||||
|
|
||||||
|
"Licensor" shall mean the copyright owner or entity authorized by
|
||||||
|
the copyright owner that is granting the License.
|
||||||
|
|
||||||
|
"Legal Entity" shall mean the union of the acting entity and all
|
||||||
|
other entities that control, are controlled by, or are under common
|
||||||
|
control with that entity. For the purposes of this definition,
|
||||||
|
"control" means (i) the power, direct or indirect, to cause the
|
||||||
|
direction or management of such entity, whether by contract or
|
||||||
|
otherwise, or (ii) ownership of fifty percent (50%) or more of the
|
||||||
|
outstanding shares, or (iii) beneficial ownership of such entity.
|
||||||
|
|
||||||
|
"You" (or "Your") shall mean an individual or Legal Entity
|
||||||
|
exercising permissions granted by this License.
|
||||||
|
|
||||||
|
"Source" form shall mean the preferred form for making modifications,
|
||||||
|
including but not limited to software source code, documentation
|
||||||
|
source, and configuration files.
|
||||||
|
|
||||||
|
"Object" form shall mean any form resulting from mechanical
|
||||||
|
transformation or translation of a Source form, including but
|
||||||
|
not limited to compiled object code, generated documentation,
|
||||||
|
and conversions to other media types.
|
||||||
|
|
||||||
|
"Work" shall mean the work of authorship, whether in Source or
|
||||||
|
Object form, made available under the License, as indicated by a
|
||||||
|
copyright notice that is included in or attached to the work
|
||||||
|
(an example is provided in the Appendix below).
|
||||||
|
|
||||||
|
"Derivative Works" shall mean any work, whether in Source or Object
|
||||||
|
form, that is based on (or derived from) the Work and for which the
|
||||||
|
editorial revisions, annotations, elaborations, or other modifications
|
||||||
|
represent, as a whole, an original work of authorship. For the purposes
|
||||||
|
of this License, Derivative Works shall not include works that remain
|
||||||
|
separable from, or merely link (or bind by name) to the interfaces of,
|
||||||
|
the Work and Derivative Works thereof.
|
||||||
|
|
||||||
|
"Contribution" shall mean any work of authorship, including
|
||||||
|
the original version of the Work and any modifications or additions
|
||||||
|
to that Work or Derivative Works thereof, that is intentionally
|
||||||
|
submitted to Licensor for inclusion in the Work by the copyright owner
|
||||||
|
or by an individual or Legal Entity authorized to submit on behalf of
|
||||||
|
the copyright owner. For the purposes of this definition, "submitted"
|
||||||
|
means any form of electronic, verbal, or written communication sent
|
||||||
|
to the Licensor or its representatives, including but not limited to
|
||||||
|
communication on electronic mailing lists, source code control systems,
|
||||||
|
and issue tracking systems that are managed by, or on behalf of, the
|
||||||
|
Licensor for the purpose of discussing and improving the Work, but
|
||||||
|
excluding communication that is conspicuously marked or otherwise
|
||||||
|
designated in writing by the copyright owner as "Not a Contribution."
|
||||||
|
|
||||||
|
"Contributor" shall mean Licensor and any individual or Legal Entity
|
||||||
|
on behalf of whom a Contribution has been received by Licensor and
|
||||||
|
subsequently incorporated within the Work.
|
||||||
|
|
||||||
|
2. Grant of Copyright License. Subject to the terms and conditions of
|
||||||
|
this License, each Contributor hereby grants to You a perpetual,
|
||||||
|
worldwide, non-exclusive, no-charge, royalty-free, irrevocable
|
||||||
|
copyright license to reproduce, prepare Derivative Works of,
|
||||||
|
publicly display, publicly perform, sublicense, and distribute the
|
||||||
|
Work and such Derivative Works in Source or Object form.
|
||||||
|
|
||||||
|
3. Grant of Patent License. Subject to the terms and conditions of
|
||||||
|
this License, each Contributor hereby grants to You a perpetual,
|
||||||
|
worldwide, non-exclusive, no-charge, royalty-free, irrevocable
|
||||||
|
(except as stated in this section) patent license to make, have made,
|
||||||
|
use, offer to sell, sell, import, and otherwise transfer the Work,
|
||||||
|
where such license applies only to those patent claims licensable
|
||||||
|
by such Contributor that are necessarily infringed by their
|
||||||
|
Contribution(s) alone or by combination of their Contribution(s)
|
||||||
|
with the Work to which such Contribution(s) was submitted. If You
|
||||||
|
institute patent litigation against any entity (including a
|
||||||
|
cross-claim or counterclaim in a lawsuit) alleging that the Work
|
||||||
|
or a Contribution incorporated within the Work constitutes direct
|
||||||
|
or contributory patent infringement, then any patent licenses
|
||||||
|
granted to You under this License for that Work shall terminate
|
||||||
|
as of the date such litigation is filed.
|
||||||
|
|
||||||
|
4. Redistribution. You may reproduce and distribute copies of the
|
||||||
|
Work or Derivative Works thereof in any medium, with or without
|
||||||
|
modifications, and in Source or Object form, provided that You
|
||||||
|
meet the following conditions:
|
||||||
|
|
||||||
|
(a) You must give any other recipients of the Work or
|
||||||
|
Derivative Works a copy of this License; and
|
||||||
|
|
||||||
|
(b) You must cause any modified files to carry prominent notices
|
||||||
|
stating that You changed the files; and
|
||||||
|
|
||||||
|
(c) You must retain, in the Source form of any Derivative Works
|
||||||
|
that You distribute, all copyright, patent, trademark, and
|
||||||
|
attribution notices from the Source form of the Work,
|
||||||
|
excluding those notices that do not pertain to any part of
|
||||||
|
the Derivative Works; and
|
||||||
|
|
||||||
|
(d) If the Work includes a "NOTICE" text file as part of its
|
||||||
|
distribution, then any Derivative Works that You distribute must
|
||||||
|
include a readable copy of the attribution notices contained
|
||||||
|
within such NOTICE file, excluding those notices that do not
|
||||||
|
pertain to any part of the Derivative Works, in at least one
|
||||||
|
of the following places: within a NOTICE text file distributed
|
||||||
|
as part of the Derivative Works; within the Source form or
|
||||||
|
documentation, if provided along with the Derivative Works; or,
|
||||||
|
within a display generated by the Derivative Works, if and
|
||||||
|
wherever such third-party notices normally appear. The contents
|
||||||
|
of the NOTICE file are for informational purposes only and
|
||||||
|
do not modify the License. You may add Your own attribution
|
||||||
|
notices within Derivative Works that You distribute, alongside
|
||||||
|
or as an addendum to the NOTICE text from the Work, provided
|
||||||
|
that such additional attribution notices cannot be construed
|
||||||
|
as modifying the License.
|
||||||
|
|
||||||
|
You may add Your own copyright statement to Your modifications and
|
||||||
|
may provide additional or different license terms and conditions
|
||||||
|
for use, reproduction, or distribution of Your modifications, or
|
||||||
|
for any such Derivative Works as a whole, provided Your use,
|
||||||
|
reproduction, and distribution of the Work otherwise complies with
|
||||||
|
the conditions stated in this License.
|
||||||
|
|
||||||
|
5. Submission of Contributions. Unless You explicitly state otherwise,
|
||||||
|
any Contribution intentionally submitted for inclusion in the Work
|
||||||
|
by You to the Licensor shall be under the terms and conditions of
|
||||||
|
this License, without any additional terms or conditions.
|
||||||
|
Notwithstanding the above, nothing herein shall supersede or modify
|
||||||
|
the terms of any separate license agreement you may have executed
|
||||||
|
with Licensor regarding such Contributions.
|
||||||
|
|
||||||
|
6. Trademarks. This License does not grant permission to use the trade
|
||||||
|
names, trademarks, service marks, or product names of the Licensor,
|
||||||
|
except as required for reasonable and customary use in describing the
|
||||||
|
origin of the Work and reproducing the content of the NOTICE file.
|
||||||
|
|
||||||
|
7. Disclaimer of Warranty. Unless required by applicable law or
|
||||||
|
agreed to in writing, Licensor provides the Work (and each
|
||||||
|
Contributor provides its Contributions) on an "AS IS" BASIS,
|
||||||
|
WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or
|
||||||
|
implied, including, without limitation, any warranties or conditions
|
||||||
|
of TITLE, NON-INFRINGEMENT, MERCHANTABILITY, or FITNESS FOR A
|
||||||
|
PARTICULAR PURPOSE. You are solely responsible for determining the
|
||||||
|
appropriateness of using or redistributing the Work and assume any
|
||||||
|
risks associated with Your exercise of permissions under this License.
|
||||||
|
|
||||||
|
8. Limitation of Liability. In no event and under no legal theory,
|
||||||
|
whether in tort (including negligence), contract, or otherwise,
|
||||||
|
unless required by applicable law (such as deliberate and grossly
|
||||||
|
negligent acts) or agreed to in writing, shall any Contributor be
|
||||||
|
liable to You for damages, including any direct, indirect, special,
|
||||||
|
incidental, or consequential damages of any character arising as a
|
||||||
|
result of this License or out of the use or inability to use the
|
||||||
|
Work (including but not limited to damages for loss of goodwill,
|
||||||
|
work stoppage, computer failure or malfunction, or any and all
|
||||||
|
other commercial damages or losses), even if such Contributor
|
||||||
|
has been advised of the possibility of such damages.
|
||||||
|
|
||||||
|
9. Accepting Warranty or Additional Liability. While redistributing
|
||||||
|
the Work or Derivative Works thereof, You may choose to offer,
|
||||||
|
and charge a fee for, acceptance of support, warranty, indemnity,
|
||||||
|
or other liability obligations and/or rights consistent with this
|
||||||
|
License. However, in accepting such obligations, You may act only
|
||||||
|
on Your own behalf and on Your sole responsibility, not on behalf
|
||||||
|
of any other Contributor, and only if You agree to indemnify,
|
||||||
|
defend, and hold each Contributor harmless for any liability
|
||||||
|
incurred by, or claims asserted against, such Contributor by reason
|
||||||
|
of your accepting any such warranty or additional liability.
|
||||||
|
|
||||||
|
END OF TERMS AND CONDITIONS
|
||||||
|
|
||||||
|
APPENDIX: How to apply the Apache License to your work.
|
||||||
|
|
||||||
|
To apply the Apache License to your work, attach the following
|
||||||
|
boilerplate notice, with the fields enclosed by brackets "[]"
|
||||||
|
replaced with your own identifying information. (Don't include
|
||||||
|
the brackets!) The text should be enclosed in the appropriate
|
||||||
|
comment syntax for the file format. We also recommend that a
|
||||||
|
file or class name and description of purpose be included on the
|
||||||
|
same "printed page" as the copyright notice for easier
|
||||||
|
identification within third-party archives.
|
||||||
|
|
||||||
|
Copyright [yyyy] [name of copyright owner]
|
||||||
|
|
||||||
|
Licensed under the Apache License, Version 2.0 (the "License");
|
||||||
|
you may not use this file except in compliance with the License.
|
||||||
|
You may obtain a copy of the License at
|
||||||
|
|
||||||
|
http://www.apache.org/licenses/LICENSE-2.0
|
||||||
|
|
||||||
|
Unless required by applicable law or agreed to in writing, software
|
||||||
|
distributed under the License is distributed on an "AS IS" BASIS,
|
||||||
|
WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
|
||||||
|
See the License for the specific language governing permissions and
|
||||||
|
limitations under the License.
|
|
@ -0,0 +1,7 @@
|
||||||
|
# This file is managed centrally. If you find the need to modify this as a
|
||||||
|
# one-off, please don't. Intead, consult #openstack-charms and ask about
|
||||||
|
# requirements management in charms via bot-control. Thank you.
|
||||||
|
#
|
||||||
|
# Build requirements
|
||||||
|
charm-tools>=2.4.4
|
||||||
|
simplejson
|
|
@ -0,0 +1,24 @@
|
||||||
|
# Overview
|
||||||
|
|
||||||
|
This charm is developed as part of the OpenStack Charms project, and as such you
|
||||||
|
should refer to the [OpenStack Charm Development Guide](https://github.com/openstack/charm-guide) for details on how
|
||||||
|
to contribute to this charm.
|
||||||
|
|
||||||
|
You can find its source code here: <https://github.com/openstack-charmers/charm-mysql-innodb-cluster>.
|
||||||
|
|
||||||
|
# To Do
|
||||||
|
|
||||||
|
Actions:
|
||||||
|
Backups
|
||||||
|
Password change
|
||||||
|
Pause Resume
|
||||||
|
Service stop/start
|
||||||
|
Rejoin unit
|
||||||
|
cluster.rejoinInstance()
|
||||||
|
Bootstrap
|
||||||
|
|
||||||
|
Cold Start
|
||||||
|
|
||||||
|
Testing
|
||||||
|
Destruction of RW node testing
|
||||||
|
Juju leader changes
|
|
@ -0,0 +1,20 @@
|
||||||
|
options:
|
||||||
|
source:
|
||||||
|
type: string
|
||||||
|
default: distro
|
||||||
|
description: |
|
||||||
|
Repository from which to install. May be one of the following:
|
||||||
|
distro (default), ppa:somecustom/ppa, a deb url sources entry,
|
||||||
|
or a supported Ubuntu Cloud Archive e.g.
|
||||||
|
.
|
||||||
|
cloud:<series>-<openstack-release>
|
||||||
|
cloud:<series>-<openstack-release>/updates
|
||||||
|
cloud:<series>-<openstack-release>/staging
|
||||||
|
cloud:<series>-<openstack-release>/proposed
|
||||||
|
.
|
||||||
|
See https://wiki.ubuntu.com/OpenStack/CloudArchive for info on which
|
||||||
|
cloud archives are available and supported.
|
||||||
|
cluster-name:
|
||||||
|
type: string
|
||||||
|
description: Cluster name for the InnoDB cluster. Must be unique.
|
||||||
|
default: jujuCluster
|
File diff suppressed because one or more lines are too long
After Width: | Height: | Size: 15 KiB |
|
@ -0,0 +1,22 @@
|
||||||
|
includes:
|
||||||
|
- layer:leadership
|
||||||
|
- layer:snap
|
||||||
|
- layer:openstack-principle
|
||||||
|
- interface:mysql-shared
|
||||||
|
- interface:mysql-router
|
||||||
|
- interface:mysql-innodb-cluster
|
||||||
|
options:
|
||||||
|
basic:
|
||||||
|
use_venv: True
|
||||||
|
packages: [ 'libmysqlclient-dev']
|
||||||
|
snap:
|
||||||
|
mysql-shell:
|
||||||
|
channel: edge
|
||||||
|
devmode: True
|
||||||
|
repo: https://github.com/openstack-charmers/charm-mysql-innodb-cluster
|
||||||
|
config:
|
||||||
|
deletes:
|
||||||
|
- verbose
|
||||||
|
- openstack-origin
|
||||||
|
- use-internal-endpoints
|
||||||
|
- debug
|
|
@ -0,0 +1,543 @@
|
||||||
|
# Copyright 2019 Canonicauh Ltd
|
||||||
|
#
|
||||||
|
# Licensed under the Apache License, Version 2.0 (the "License");
|
||||||
|
# you may not use this file except in compliance with the License.
|
||||||
|
# You may obtain a copy of the License at
|
||||||
|
#
|
||||||
|
# http://www.apache.org/licenses/LICENSE-2.0
|
||||||
|
#
|
||||||
|
# Unless required by applicable law or agreed to in writing, software
|
||||||
|
# distributed under the License is distributed on an "AS IS" BASIS,
|
||||||
|
# WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
|
||||||
|
# See the License for the specific language governing permissions and
|
||||||
|
# limitations under the License.
|
||||||
|
|
||||||
|
import json
|
||||||
|
import subprocess
|
||||||
|
import tempfile
|
||||||
|
import uuid
|
||||||
|
|
||||||
|
import charms_openstack.charm
|
||||||
|
import charms_openstack.adapters
|
||||||
|
|
||||||
|
import charms.leadership as leadership
|
||||||
|
import charms.reactive as reactive
|
||||||
|
|
||||||
|
import charmhelpers.core as ch_core
|
||||||
|
import charmhelpers.contrib.network.ip as ch_net_ip
|
||||||
|
|
||||||
|
import charmhelpers.contrib.database.mysql as mysql
|
||||||
|
|
||||||
|
|
||||||
|
MYSQLD_CNF = "/etc/mysql/mysql.conf.d/mysqld.cnf"
|
||||||
|
|
||||||
|
|
||||||
|
@charms_openstack.adapters.config_property
|
||||||
|
def server_id(cls):
|
||||||
|
unit_num = int(ch_core.hookenv.local_unit().split("/")[1])
|
||||||
|
return str(unit_num + 1000)
|
||||||
|
|
||||||
|
|
||||||
|
@charms_openstack.adapters.config_property
|
||||||
|
def cluster_address(cls):
|
||||||
|
return ch_net_ip.get_relation_ip("cluster")
|
||||||
|
|
||||||
|
|
||||||
|
@charms_openstack.adapters.config_property
|
||||||
|
def shared_db_address(cls):
|
||||||
|
return ch_net_ip.get_relation_ip("shared-db")
|
||||||
|
|
||||||
|
|
||||||
|
@charms_openstack.adapters.config_property
|
||||||
|
def db_router_address(cls):
|
||||||
|
return ch_net_ip.get_relation_ip("db-router")
|
||||||
|
|
||||||
|
|
||||||
|
class MySQLInnoDBClusterCharm(charms_openstack.charm.OpenStackCharm):
|
||||||
|
"""Charm class for the MySQLInnoDBCluster charm."""
|
||||||
|
name = "mysql"
|
||||||
|
release = "stein"
|
||||||
|
# TODO: Current versions of the mysql-shell snap require libpython2.7
|
||||||
|
# This will not be available in 20.04
|
||||||
|
# Fix the mysql-shell snap and remove the package here
|
||||||
|
packages = ["mysql-router", "mysql-server-8.0", "python3-dnspython",
|
||||||
|
"libpython2.7"]
|
||||||
|
python_version = 3
|
||||||
|
default_service = "mysql"
|
||||||
|
services = ["mysql"]
|
||||||
|
restart_map = {
|
||||||
|
MYSQLD_CNF: services,
|
||||||
|
}
|
||||||
|
release_pkg = "mysql-server"
|
||||||
|
group = "mysql"
|
||||||
|
required_relations = ["cluster"]
|
||||||
|
source_config_key = "source"
|
||||||
|
|
||||||
|
# For internal use with get_db_data
|
||||||
|
_unprefixed = "MICUP"
|
||||||
|
|
||||||
|
@property
|
||||||
|
def mysqlsh_bin(self):
|
||||||
|
return "/snap/bin/mysqlsh"
|
||||||
|
|
||||||
|
def install(self):
|
||||||
|
"""Custom install function.
|
||||||
|
"""
|
||||||
|
|
||||||
|
# Set root password in packaging before installation
|
||||||
|
self.configure_mysql_root_password(self.root_password)
|
||||||
|
|
||||||
|
# TODO: charms.openstack should probably do this
|
||||||
|
# Need to configure source first
|
||||||
|
self.configure_source()
|
||||||
|
super().install()
|
||||||
|
|
||||||
|
# Render mysqld.cnf and cause a restart
|
||||||
|
self.render_all_configs()
|
||||||
|
|
||||||
|
def get_db_helper(self):
|
||||||
|
return mysql.MySQL8Helper(
|
||||||
|
rpasswdf_template="/var/lib/charm/{}/mysql.passwd"
|
||||||
|
.format(ch_core.hookenv.service_name()),
|
||||||
|
upasswdf_template="/var/lib/charm/{}/mysql-{{}}.passwd"
|
||||||
|
.format(ch_core.hookenv.service_name()))
|
||||||
|
|
||||||
|
def create_cluster_user(
|
||||||
|
self, cluster_address, cluster_user, cluster_password):
|
||||||
|
|
||||||
|
SQL_REMOTE_CLUSTER_USER_CREATE = (
|
||||||
|
"CREATE USER '{user}'@'{host}' "
|
||||||
|
"IDENTIFIED BY '{password}'")
|
||||||
|
|
||||||
|
SQL_LOCAL_CLUSTER_USER_CREATE = (
|
||||||
|
"CREATE USER '{user}'@'localhost' "
|
||||||
|
"IDENTIFIED BY '{password}'")
|
||||||
|
|
||||||
|
SQL_CLUSTER_USER_GRANT = (
|
||||||
|
"GRANT {permissions} ON *.* "
|
||||||
|
"TO 'clusteruser'@'{host}'")
|
||||||
|
|
||||||
|
m_helper = self.get_db_helper()
|
||||||
|
m_helper.connect(password=m_helper.get_mysql_root_password())
|
||||||
|
try:
|
||||||
|
m_helper.execute(SQL_REMOTE_CLUSTER_USER_CREATE.format(
|
||||||
|
user=cluster_user,
|
||||||
|
host=cluster_address,
|
||||||
|
password=cluster_password)
|
||||||
|
)
|
||||||
|
except mysql.MySQLdb._exceptions.OperationalError:
|
||||||
|
ch_core.hookenv.log("Remote user {} already exists."
|
||||||
|
.format(cluster_user), "WARNING")
|
||||||
|
|
||||||
|
if cluster_address in self.cluster_address:
|
||||||
|
try:
|
||||||
|
m_helper.execute(SQL_LOCAL_CLUSTER_USER_CREATE.format(
|
||||||
|
user=cluster_user,
|
||||||
|
password=cluster_password)
|
||||||
|
)
|
||||||
|
except mysql.MySQLdb._exceptions.OperationalError:
|
||||||
|
ch_core.hookenv.log("Local user {} already exists."
|
||||||
|
.format(cluster_user), "WARNING")
|
||||||
|
|
||||||
|
m_helper.execute(SQL_CLUSTER_USER_GRANT.format(
|
||||||
|
permissions="ALL PRIVILEGES",
|
||||||
|
user=cluster_user,
|
||||||
|
host=cluster_address)
|
||||||
|
)
|
||||||
|
m_helper.execute(SQL_CLUSTER_USER_GRANT.format(
|
||||||
|
permissions="GRANT OPTION",
|
||||||
|
user=cluster_user,
|
||||||
|
host=cluster_address)
|
||||||
|
)
|
||||||
|
|
||||||
|
m_helper.execute("flush privileges")
|
||||||
|
|
||||||
|
def configure_db_for_hosts(self, hosts, database, username):
|
||||||
|
"""Hosts may be a json-encoded list of hosts or a single hostname."""
|
||||||
|
if not all([hosts, database, username]):
|
||||||
|
ch_core.hookenv.log("Remote data incomplete.", "WARNING")
|
||||||
|
return
|
||||||
|
try:
|
||||||
|
hosts = json.loads(hosts)
|
||||||
|
ch_core.hookenv.log("Multiple hostnames provided by relation: {}"
|
||||||
|
.format(', '.join(hosts)), "DEBUG")
|
||||||
|
except ValueError:
|
||||||
|
ch_core.hookenv.log(
|
||||||
|
"Single hostname provided by relation: {}".format(hosts),
|
||||||
|
level="DEBUG")
|
||||||
|
hosts = [hosts]
|
||||||
|
|
||||||
|
db_helper = self.get_db_helper()
|
||||||
|
|
||||||
|
for host in hosts:
|
||||||
|
password = db_helper.configure_db(host, database, username)
|
||||||
|
|
||||||
|
return password
|
||||||
|
|
||||||
|
def configure_db_router(self, hosts, username):
|
||||||
|
"""Hosts may be a json-encoded list of hosts or a single hostname."""
|
||||||
|
if not all([hosts, username]):
|
||||||
|
ch_core.hookenv.log("Remote data incomplete.", "WARNING")
|
||||||
|
return
|
||||||
|
try:
|
||||||
|
hosts = json.loads(hosts)
|
||||||
|
ch_core.hookenv.log("Multiple hostnames provided by relation: {}"
|
||||||
|
.format(', '.join(hosts)), "DEBUG")
|
||||||
|
except ValueError:
|
||||||
|
ch_core.hookenv.log(
|
||||||
|
"Single hostname provided by relation: {}".format(hosts),
|
||||||
|
level="DEBUG")
|
||||||
|
hosts = [hosts]
|
||||||
|
|
||||||
|
db_helper = self.get_db_helper()
|
||||||
|
|
||||||
|
for host in hosts:
|
||||||
|
password = db_helper.configure_router(host, username)
|
||||||
|
|
||||||
|
return password
|
||||||
|
|
||||||
|
def _get_password(self, key):
|
||||||
|
"""Retrieve named password
|
||||||
|
|
||||||
|
This function will ensure that a consistent named password
|
||||||
|
is used across all units in the pxc cluster; the lead unit
|
||||||
|
will generate or use the root-password configuration option
|
||||||
|
to seed this value into the deployment.
|
||||||
|
|
||||||
|
Once set, it cannot be changed.
|
||||||
|
|
||||||
|
@requires: str: named password or None if unable to retrieve
|
||||||
|
at this point in time
|
||||||
|
"""
|
||||||
|
_password = ch_core.hookenv.leader_get(key)
|
||||||
|
if not _password and ch_core.hookenv.is_leader():
|
||||||
|
_password = ch_core.hookenv.config(key) or ch_core.host.pwgen()
|
||||||
|
ch_core.hookenv.leader_set({key: _password})
|
||||||
|
return _password
|
||||||
|
|
||||||
|
@property
|
||||||
|
def root_password(self):
|
||||||
|
# TODO: Change me to mysql.password
|
||||||
|
# Change reactive handler leader setting check too
|
||||||
|
return self._get_password("root-password")
|
||||||
|
|
||||||
|
@property
|
||||||
|
def cluster_password(self):
|
||||||
|
return self._get_password("cluster-password")
|
||||||
|
|
||||||
|
@property
|
||||||
|
def cluster_address(self):
|
||||||
|
return self.options.cluster_address
|
||||||
|
|
||||||
|
@property
|
||||||
|
def cluster_user(self):
|
||||||
|
return "clusteruser"
|
||||||
|
|
||||||
|
@property
|
||||||
|
def shared_db_address(self):
|
||||||
|
return self.options.shared_db_address
|
||||||
|
|
||||||
|
@property
|
||||||
|
def db_router_address(self):
|
||||||
|
return self.options.db_router_address
|
||||||
|
|
||||||
|
def configure_instance(self, address):
|
||||||
|
|
||||||
|
if reactive.is_flag_set(
|
||||||
|
"leadership.set.cluster-instance-configured-{}"
|
||||||
|
.format(address)):
|
||||||
|
ch_core.hookenv.log("Instance: {}, already configured."
|
||||||
|
.format(address), "WARNING")
|
||||||
|
return
|
||||||
|
|
||||||
|
ch_core.hookenv.log("Configuring instance for clustering: {}."
|
||||||
|
.format(address), "INFO")
|
||||||
|
_script_template = """
|
||||||
|
dba.configureInstance('{}:{}@{}');
|
||||||
|
var myshell = shell.connect('{}:{}@{}');
|
||||||
|
myshell.runSql("RESTART;");
|
||||||
|
"""
|
||||||
|
|
||||||
|
with tempfile.NamedTemporaryFile(mode="w", suffix=".js") as _script:
|
||||||
|
_script.write(_script_template.format(
|
||||||
|
self.cluster_user, self.cluster_password, address,
|
||||||
|
self.cluster_user, self.cluster_password, address))
|
||||||
|
_script.flush()
|
||||||
|
|
||||||
|
cmd = ([self.mysqlsh_bin, "--no-wizard", "-f", _script.name])
|
||||||
|
try:
|
||||||
|
output = subprocess.check_output(cmd, stderr=subprocess.STDOUT)
|
||||||
|
except subprocess.CalledProcessError as e:
|
||||||
|
ch_core.hookenv.log(
|
||||||
|
"Failed configuring instance {}: {}"
|
||||||
|
.format(address, e.output.decode("UTF-8")), "ERROR")
|
||||||
|
return
|
||||||
|
ch_core.hookenv.log("Instance Configured {}: {}"
|
||||||
|
.format(address, output.decode("UTF-8")),
|
||||||
|
level="DEBUG")
|
||||||
|
leadership.leader_set({"cluster-instance-configured-{}"
|
||||||
|
.format(address): True})
|
||||||
|
|
||||||
|
@property
|
||||||
|
def cluster_name(self):
|
||||||
|
return self.options.cluster_name
|
||||||
|
|
||||||
|
def create_cluster(self):
|
||||||
|
|
||||||
|
if reactive.is_flag_set("leadership.set.cluster-created"):
|
||||||
|
ch_core.hookenv.log("Cluster: {}, already created"
|
||||||
|
.format(self.options.cluster_name), "WARNING")
|
||||||
|
return
|
||||||
|
|
||||||
|
if not reactive.is_flag_set(
|
||||||
|
"leadership.set.cluster-instance-configured-{}"
|
||||||
|
.format(self.cluster_address)):
|
||||||
|
ch_core.hookenv.log("This insance is not yet configured for "
|
||||||
|
"clustering, delaying cluster creation.",
|
||||||
|
"WARNING")
|
||||||
|
return
|
||||||
|
|
||||||
|
_script_template = """
|
||||||
|
shell.connect("{}:{}@{}")
|
||||||
|
var cluster = dba.createCluster("{}");
|
||||||
|
"""
|
||||||
|
|
||||||
|
ch_core.hookenv.log("Creating cluster: {}."
|
||||||
|
.format(self.options.cluster_name), "INFO")
|
||||||
|
with tempfile.NamedTemporaryFile(mode="w", suffix=".js") as _script:
|
||||||
|
_script.write(_script_template.format(
|
||||||
|
self.cluster_user, self.cluster_password, self.cluster_address,
|
||||||
|
self.options.cluster_name,
|
||||||
|
self.cluster_user,
|
||||||
|
self.cluster_address,
|
||||||
|
self.cluster_password))
|
||||||
|
_script.flush()
|
||||||
|
|
||||||
|
cmd = ([self.mysqlsh_bin, "--no-wizard", "-f", _script.name])
|
||||||
|
try:
|
||||||
|
output = subprocess.check_output(cmd, stderr=subprocess.STDOUT)
|
||||||
|
except subprocess.CalledProcessError as e:
|
||||||
|
ch_core.hookenv.log(
|
||||||
|
"Failed creating cluster: {}"
|
||||||
|
.format(e.output.decode("UTF-8")), "ERROR")
|
||||||
|
return
|
||||||
|
ch_core.hookenv.log("Cluster Created: {}"
|
||||||
|
.format(output.decode("UTF-8")),
|
||||||
|
level="DEBUG")
|
||||||
|
leadership.leader_set({"cluster-instance-clustered-{}"
|
||||||
|
.format(self.cluster_address): True})
|
||||||
|
leadership.leader_set({"cluster-created": str(uuid.uuid4())})
|
||||||
|
|
||||||
|
def add_instance_to_cluster(self, address):
|
||||||
|
|
||||||
|
if reactive.is_flag_set(
|
||||||
|
"leadership.set.cluster-instance-clustered-{}"
|
||||||
|
.format(address)):
|
||||||
|
ch_core.hookenv.log("Instance: {}, already clustered."
|
||||||
|
.format(address), "WARNING")
|
||||||
|
return
|
||||||
|
|
||||||
|
ch_core.hookenv.log("Adding instance, {}, to the cluster."
|
||||||
|
.format(address), "INFO")
|
||||||
|
_script_template = """
|
||||||
|
shell.connect("{}:{}@{}")
|
||||||
|
var cluster = dba.getCluster("{}");
|
||||||
|
|
||||||
|
print("Adding instances to the cluster.");
|
||||||
|
cluster.addInstance(
|
||||||
|
{{user: "{}", host: "{}", password: "{}", port: "3306"}},
|
||||||
|
{{recoveryMethod: "clone"}});
|
||||||
|
"""
|
||||||
|
|
||||||
|
with tempfile.NamedTemporaryFile(mode="w", suffix=".js") as _script:
|
||||||
|
_script.write(_script_template.format(
|
||||||
|
self.cluster_user, self.cluster_password, self.cluster_address,
|
||||||
|
self.options.cluster_name,
|
||||||
|
self.cluster_user, address, self.cluster_password))
|
||||||
|
_script.flush()
|
||||||
|
|
||||||
|
cmd = ([self.mysqlsh_bin, "--no-wizard", "-f", _script.name])
|
||||||
|
try:
|
||||||
|
output = subprocess.check_output(cmd, stderr=subprocess.STDOUT)
|
||||||
|
except subprocess.CalledProcessError as e:
|
||||||
|
ch_core.hookenv.log(
|
||||||
|
"Failed adding instance {} to cluster: {}"
|
||||||
|
.format(address, e.output.decode("UTF-8")), "ERROR")
|
||||||
|
return
|
||||||
|
ch_core.hookenv.log("Instance Clustered {}: {}"
|
||||||
|
.format(address, output.decode("UTF-8")),
|
||||||
|
level="DEBUG")
|
||||||
|
leadership.leader_set({"cluster-instance-clustered-{}"
|
||||||
|
.format(address): True})
|
||||||
|
|
||||||
|
def states_to_check(self, required_relations=None):
|
||||||
|
"""Custom state check function for charm specific state check needs.
|
||||||
|
|
||||||
|
"""
|
||||||
|
states_to_check = super().states_to_check(required_relations)
|
||||||
|
states_to_check["charm"] = [
|
||||||
|
("charm.installed",
|
||||||
|
"waiting",
|
||||||
|
"MySQL not installed"),
|
||||||
|
("leadership.set.cluster-instance-configured-{}"
|
||||||
|
.format(self.cluster_address),
|
||||||
|
"waiting",
|
||||||
|
"Instance not yet configured for clustering"),
|
||||||
|
("leadership.set.cluster-created",
|
||||||
|
"waiting",
|
||||||
|
"Cluster {} not yet created by leader"
|
||||||
|
.format(self.cluster_name)),
|
||||||
|
("leadership.set.cluster-instances-configured",
|
||||||
|
"waiting",
|
||||||
|
"Not all instances configured for clustering"),
|
||||||
|
("leadership.set.cluster-instance-clustered-{}"
|
||||||
|
.format(self.cluster_address),
|
||||||
|
"waiting",
|
||||||
|
"Instance not yet in the cluster"),
|
||||||
|
("leadership.set.cluster-instances-clustered",
|
||||||
|
"waiting",
|
||||||
|
"Not all instances clustered")]
|
||||||
|
|
||||||
|
return states_to_check
|
||||||
|
|
||||||
|
def check_mysql_connection(self, password=None):
|
||||||
|
"""Check if local instance of mysql is accessible.
|
||||||
|
|
||||||
|
Attempt a connection to the local instance of mysql to determine if it
|
||||||
|
is running and accessible.
|
||||||
|
|
||||||
|
:param password: Password to use for connection test.
|
||||||
|
:type password: str
|
||||||
|
:side effect: Uses get_db_helper to execute a connection to the DB.
|
||||||
|
:returns: boolean
|
||||||
|
"""
|
||||||
|
|
||||||
|
m_helper = self.get_db_helper()
|
||||||
|
password = password or m_helper.get_mysql_root_password()
|
||||||
|
try:
|
||||||
|
m_helper.connect(password=password)
|
||||||
|
return True
|
||||||
|
except mysql.MySQLdb._exceptions.OperationalError:
|
||||||
|
ch_core.hookenv.log("Could not connect to db", "DEBUG")
|
||||||
|
return False
|
||||||
|
|
||||||
|
def custom_assess_status_check(self):
|
||||||
|
|
||||||
|
# Start with default checks
|
||||||
|
for f in [self.check_if_paused,
|
||||||
|
self.check_interfaces,
|
||||||
|
self.check_mandatory_config]:
|
||||||
|
state, message = f()
|
||||||
|
if state is not None:
|
||||||
|
ch_core.hookenv.status_set(state, message)
|
||||||
|
return state, message
|
||||||
|
|
||||||
|
# We should not get here until there is a connection to the
|
||||||
|
# cluster
|
||||||
|
if not self.check_mysql_connection():
|
||||||
|
return "blocked", "MySQL is down"
|
||||||
|
|
||||||
|
return None, None
|
||||||
|
|
||||||
|
# TODO: move to mysql charmhelper
|
||||||
|
def configure_mysql_root_password(self, password):
|
||||||
|
""" Configure debconf with root password """
|
||||||
|
dconf = subprocess.Popen(
|
||||||
|
['debconf-set-selections'], stdin=subprocess.PIPE)
|
||||||
|
# Set password options to cover packages
|
||||||
|
packages = ["mysql-server", "mysql-server-8.0"]
|
||||||
|
m_helper = self.get_db_helper()
|
||||||
|
root_pass = m_helper.get_mysql_root_password(password)
|
||||||
|
for package in packages:
|
||||||
|
dconf.stdin.write("{} {}/root_password password {}\n"
|
||||||
|
.format(package, package, root_pass)
|
||||||
|
.encode("utf-8"))
|
||||||
|
dconf.stdin.write("{} {}/root_password_again password {}\n"
|
||||||
|
.format(package, package, root_pass)
|
||||||
|
.encode("utf-8"))
|
||||||
|
dconf.communicate()
|
||||||
|
dconf.wait()
|
||||||
|
|
||||||
|
# TODO: move to mysql charmhelper
|
||||||
|
def get_allowed_units(self, database, username, relation_id):
|
||||||
|
db_helper = self.get_db_helper()
|
||||||
|
allowed_units = db_helper.get_allowed_units(
|
||||||
|
database, username, relation_id=relation_id)
|
||||||
|
allowed_units = sorted(
|
||||||
|
allowed_units, key=lambda a: int(a.split('/')[-1]))
|
||||||
|
allowed_units = ' '.join(allowed_units)
|
||||||
|
return allowed_units
|
||||||
|
|
||||||
|
# TODO: move to mysql charmhelper
|
||||||
|
def resolve_hostname_to_ip(self, hostname):
|
||||||
|
"""Resolve hostname to IP
|
||||||
|
|
||||||
|
@param hostname: hostname to be resolved
|
||||||
|
@returns IP address or None if resolution was not possible via DNS
|
||||||
|
"""
|
||||||
|
import dns.resolver
|
||||||
|
|
||||||
|
if self.options.prefer_ipv6:
|
||||||
|
if ch_net_ip.is_ipv6(hostname):
|
||||||
|
return hostname
|
||||||
|
|
||||||
|
query_type = 'AAAA'
|
||||||
|
elif ch_net_ip.is_ip(hostname):
|
||||||
|
return hostname
|
||||||
|
else:
|
||||||
|
query_type = 'A'
|
||||||
|
|
||||||
|
# This may throw an NXDOMAIN exception; in which case
|
||||||
|
# things are badly broken so just let it kill the hook
|
||||||
|
answers = dns.resolver.query(hostname, query_type)
|
||||||
|
if answers:
|
||||||
|
return answers[0].address
|
||||||
|
|
||||||
|
def create_databases_and_users(self, interface):
|
||||||
|
"""Create databases and users
|
||||||
|
|
||||||
|
:param interface: Relation data
|
||||||
|
:type interface: reative.relations.Endpoint object
|
||||||
|
:side effect: interface.set_db_connection_info is exectuted
|
||||||
|
:returns: None
|
||||||
|
:rtype: None
|
||||||
|
"""
|
||||||
|
for unit in interface.all_joined_units:
|
||||||
|
|
||||||
|
db_data = mysql.get_db_data(
|
||||||
|
dict(unit.received),
|
||||||
|
unprefixed=self._unprefixed)
|
||||||
|
|
||||||
|
db_host = ch_net_ip.get_relation_ip(interface.endpoint_name)
|
||||||
|
mysqlrouterset = {'username', 'hostname'}
|
||||||
|
singleset = {'database', 'username', 'hostname'}
|
||||||
|
|
||||||
|
for prefix in db_data:
|
||||||
|
if singleset.issubset(db_data[prefix]):
|
||||||
|
database = db_data[prefix]['database']
|
||||||
|
hostname = db_data[prefix]['hostname']
|
||||||
|
username = db_data[prefix]['username']
|
||||||
|
|
||||||
|
password = self.configure_db_for_hosts(
|
||||||
|
hostname, database, username)
|
||||||
|
|
||||||
|
allowed_units = self.get_allowed_units(
|
||||||
|
database, username,
|
||||||
|
unit.relation.relation_id)
|
||||||
|
|
||||||
|
if prefix in self._unprefixed:
|
||||||
|
prefix = None
|
||||||
|
|
||||||
|
elif mysqlrouterset.issubset(db_data[prefix]):
|
||||||
|
hostname = db_data[prefix]['hostname']
|
||||||
|
username = db_data[prefix]['username']
|
||||||
|
|
||||||
|
password = self.configure_db_router(hostname, username)
|
||||||
|
allowed_units = " ".join(
|
||||||
|
[x.unit_name for x in unit.relation.joined_units])
|
||||||
|
|
||||||
|
interface.set_db_connection_info(
|
||||||
|
unit.relation.relation_id,
|
||||||
|
db_host,
|
||||||
|
password,
|
||||||
|
allowed_units=allowed_units, prefix=prefix)
|
|
@ -0,0 +1,19 @@
|
||||||
|
name: mysql-innodb-cluster
|
||||||
|
summary: MySQL InnoDB Cluster
|
||||||
|
maintainer: OpenStack Charmers <openstack-charmers@lists.ubuntu.com>
|
||||||
|
description: |
|
||||||
|
MySQL InnoDB Cluster Charm deploys and manages the lifecycle of a
|
||||||
|
MySQL InnoDB Cluster.
|
||||||
|
tags:
|
||||||
|
- databases
|
||||||
|
subordinate: false
|
||||||
|
series:
|
||||||
|
- eoan
|
||||||
|
provides:
|
||||||
|
shared-db:
|
||||||
|
interface: mysql-shared
|
||||||
|
db-router:
|
||||||
|
interface: mysql-router
|
||||||
|
peers:
|
||||||
|
cluster:
|
||||||
|
interface: mysql-innodb-cluster
|
|
@ -0,0 +1,181 @@
|
||||||
|
import charms.reactive as reactive
|
||||||
|
import charms.leadership as leadership
|
||||||
|
|
||||||
|
import charms_openstack.bus
|
||||||
|
import charms_openstack.charm as charm
|
||||||
|
|
||||||
|
import charmhelpers.core as ch_core
|
||||||
|
|
||||||
|
import charm.mysql_innodb_cluster as mysql_innodb_cluster # noqa
|
||||||
|
|
||||||
|
charms_openstack.bus.discover()
|
||||||
|
|
||||||
|
|
||||||
|
charm.use_defaults(
|
||||||
|
'config.changed',
|
||||||
|
'update-status',
|
||||||
|
'upgrade-charm',
|
||||||
|
'certificates.available')
|
||||||
|
|
||||||
|
|
||||||
|
@reactive.when_not('cluster-instances-clustered')
|
||||||
|
def debug():
|
||||||
|
print("DEBUG")
|
||||||
|
for flag in reactive.flags.get_flags():
|
||||||
|
print(flag)
|
||||||
|
|
||||||
|
|
||||||
|
@reactive.when('leadership.is_leader')
|
||||||
|
@reactive.when('snap.installed.mysql-shell')
|
||||||
|
@reactive.when_not('charm.installed')
|
||||||
|
def leader_install():
|
||||||
|
with charm.provide_charm_instance() as instance:
|
||||||
|
instance.install()
|
||||||
|
reactive.set_flag("charm.installed")
|
||||||
|
instance.assess_status()
|
||||||
|
|
||||||
|
|
||||||
|
@reactive.when('leadership.set.root-password')
|
||||||
|
@reactive.when_not('leadership.is_leader')
|
||||||
|
@reactive.when_not('charm.installed')
|
||||||
|
def non_leader_install():
|
||||||
|
# Wait for leader to set root-password
|
||||||
|
with charm.provide_charm_instance() as instance:
|
||||||
|
instance.install()
|
||||||
|
reactive.set_flag("charm.installed")
|
||||||
|
instance.assess_status()
|
||||||
|
|
||||||
|
|
||||||
|
@reactive.when('charm.installed')
|
||||||
|
@reactive.when_not('local.cluster.user-created')
|
||||||
|
def create_local_cluster_user():
|
||||||
|
ch_core.hookenv.log("Creating local cluster user.", "DEBUG")
|
||||||
|
with charm.provide_charm_instance() as instance:
|
||||||
|
instance.create_cluster_user(
|
||||||
|
instance.cluster_address,
|
||||||
|
instance.cluster_user,
|
||||||
|
instance.cluster_password)
|
||||||
|
reactive.set_flag("local.cluster.user-created")
|
||||||
|
instance.assess_status()
|
||||||
|
|
||||||
|
|
||||||
|
@reactive.when('local.cluster.user-created')
|
||||||
|
@reactive.when('cluster.connected')
|
||||||
|
@reactive.when_not('cluster.available')
|
||||||
|
def send_cluster_connection_info(cluster):
|
||||||
|
ch_core.hookenv.log("Send cluster connection information.", "DEBUG")
|
||||||
|
with charm.provide_charm_instance() as instance:
|
||||||
|
cluster.set_cluster_connection_info(
|
||||||
|
instance.cluster_address,
|
||||||
|
instance.cluster_user,
|
||||||
|
instance.cluster_password)
|
||||||
|
instance.assess_status()
|
||||||
|
|
||||||
|
|
||||||
|
@reactive.when_not('local.cluster.all-users-created')
|
||||||
|
@reactive.when('cluster.available')
|
||||||
|
def create_remote_cluster_user(cluster):
|
||||||
|
ch_core.hookenv.log("Creating remote users.", "DEBUG")
|
||||||
|
with charm.provide_charm_instance() as instance:
|
||||||
|
for unit in cluster.all_joined_units:
|
||||||
|
instance.create_cluster_user(
|
||||||
|
unit.received['cluster-address'],
|
||||||
|
unit.received['cluster-user'],
|
||||||
|
unit.received['cluster-password'])
|
||||||
|
|
||||||
|
# Optimize clustering by causing a cluster relation changed
|
||||||
|
cluster.set_unit_configure_ready()
|
||||||
|
reactive.set_flag('local.cluster.all-users-created')
|
||||||
|
instance.assess_status()
|
||||||
|
|
||||||
|
|
||||||
|
@reactive.when('leadership.is_leader')
|
||||||
|
@reactive.when('local.cluster.user-created')
|
||||||
|
@reactive.when_not('leadership.set.cluster-created')
|
||||||
|
def initialize_cluster():
|
||||||
|
ch_core.hookenv.log("Initializing InnoDB cluster.", "DEBUG")
|
||||||
|
with charm.provide_charm_instance() as instance:
|
||||||
|
instance.configure_instance(instance.cluster_address)
|
||||||
|
instance.create_cluster()
|
||||||
|
instance.assess_status()
|
||||||
|
|
||||||
|
|
||||||
|
@reactive.when('leadership.is_leader')
|
||||||
|
@reactive.when('leadership.set.cluster-created')
|
||||||
|
@reactive.when('local.cluster.all-users-created')
|
||||||
|
@reactive.when('cluster.available')
|
||||||
|
@reactive.when_not('leadership.set.cluster-instances-configured')
|
||||||
|
def configure_instances_for_clustering(cluster):
|
||||||
|
ch_core.hookenv.log("Configuring instances for clustering.", "DEBUG")
|
||||||
|
with charm.provide_charm_instance() as instance:
|
||||||
|
for unit in cluster.all_joined_units:
|
||||||
|
if unit.received['unit-configure-ready']:
|
||||||
|
instance.configure_instance(
|
||||||
|
unit.received['cluster-address'])
|
||||||
|
instance.add_instance_to_cluster(
|
||||||
|
unit.received['cluster-address'])
|
||||||
|
# Verify all are configured
|
||||||
|
for unit in cluster.all_joined_units:
|
||||||
|
if not reactive.is_flag_set(
|
||||||
|
"leadership.set.cluster-instance-configured-{}"
|
||||||
|
.format(unit.received['cluster-address'])):
|
||||||
|
return
|
||||||
|
# All have been configured
|
||||||
|
leadership.leader_set(
|
||||||
|
{"cluster-instances-configured": True})
|
||||||
|
instance.assess_status()
|
||||||
|
|
||||||
|
|
||||||
|
@reactive.when('leadership.is_leader')
|
||||||
|
@reactive.when('leadership.set.cluster-created')
|
||||||
|
@reactive.when('leadership.set.cluster-instances-configured')
|
||||||
|
@reactive.when('cluster.available')
|
||||||
|
@reactive.when_not('leadership.set.cluster-instances-clustered')
|
||||||
|
def add_instances_to_cluster(cluster):
|
||||||
|
ch_core.hookenv.log("Adding instances to cluster.", "DEBUG")
|
||||||
|
with charm.provide_charm_instance() as instance:
|
||||||
|
for unit in cluster.all_joined_units:
|
||||||
|
instance.add_instance_to_cluster(
|
||||||
|
unit.received['cluster-address'])
|
||||||
|
|
||||||
|
# Verify all are clustered
|
||||||
|
for unit in cluster.all_joined_units:
|
||||||
|
if not reactive.is_flag_set(
|
||||||
|
"leadership.set.cluster-instance-clustered-{}"
|
||||||
|
.format(unit.received['cluster-address'])):
|
||||||
|
return
|
||||||
|
# All have been clustered
|
||||||
|
leadership.leader_set(
|
||||||
|
{"cluster-instances-clustered": True})
|
||||||
|
instance.assess_status()
|
||||||
|
|
||||||
|
|
||||||
|
@reactive.when_not('leadership.is_leader')
|
||||||
|
@reactive.when('leadership.set.cluster-created')
|
||||||
|
@reactive.when('cluster.available')
|
||||||
|
def signal_clustered(cluster):
|
||||||
|
# Optimize clustering by causing a cluster relation changed
|
||||||
|
with charm.provide_charm_instance() as instance:
|
||||||
|
if reactive.is_flag_set(
|
||||||
|
"leadership.set.cluster-instance-clustered-{}"
|
||||||
|
.format(instance.cluster_address)):
|
||||||
|
cluster.set_unit_clustered()
|
||||||
|
instance.assess_status()
|
||||||
|
|
||||||
|
|
||||||
|
@reactive.when('leadership.is_leader')
|
||||||
|
@reactive.when('leadership.set.cluster-instances-clustered')
|
||||||
|
@reactive.when('shared-db.available')
|
||||||
|
def shared_db_respond(shared_db):
|
||||||
|
with charm.provide_charm_instance() as instance:
|
||||||
|
instance.create_databases_and_users(shared_db)
|
||||||
|
instance.assess_status()
|
||||||
|
|
||||||
|
|
||||||
|
@reactive.when('leadership.is_leader')
|
||||||
|
@reactive.when('leadership.set.cluster-instances-clustered')
|
||||||
|
@reactive.when('db-router.available')
|
||||||
|
def db_router_respond(db_router):
|
||||||
|
with charm.provide_charm_instance() as instance:
|
||||||
|
instance.create_databases_and_users(db_router)
|
||||||
|
instance.assess_status()
|
|
@ -0,0 +1,94 @@
|
||||||
|
#
|
||||||
|
# The MySQL database server configuration file.
|
||||||
|
#
|
||||||
|
# One can use all long options that the program supports.
|
||||||
|
# Run program with --help to get a list of available options and with
|
||||||
|
# --print-defaults to see which it would actually understand and use.
|
||||||
|
#
|
||||||
|
# For explanations see
|
||||||
|
# http://dev.mysql.com/doc/mysql/en/server-system-variables.html
|
||||||
|
|
||||||
|
# Here is entries for some specific programs
|
||||||
|
# The following values assume you have at least 32M ram
|
||||||
|
|
||||||
|
[mysqld]
|
||||||
|
#
|
||||||
|
# * Basic Settings
|
||||||
|
#
|
||||||
|
user = mysql
|
||||||
|
# pid-file = /var/run/mysqld/mysqld.pid
|
||||||
|
# socket = /var/run/mysqld/mysqld.sock
|
||||||
|
# port = 3306
|
||||||
|
# datadir = /var/lib/mysql
|
||||||
|
|
||||||
|
|
||||||
|
# If MySQL is running as a replication slave, this should be
|
||||||
|
# changed. Ref https://dev.mysql.com/doc/refman/8.0/en/server-system-variables.html#sysvar_tmpdir
|
||||||
|
# tmpdir = /tmp
|
||||||
|
#
|
||||||
|
# Instead of skip-networking the default is now to listen only on
|
||||||
|
# localhost which is more compatible and is not less secure.
|
||||||
|
bind-address = {{ options.cluster_address }}
|
||||||
|
report_host = {{ options.cluster_address }}
|
||||||
|
#
|
||||||
|
# * Fine Tuning
|
||||||
|
#
|
||||||
|
key_buffer_size = 16M
|
||||||
|
# max_allowed_packet = 64M
|
||||||
|
# thread_stack = 256K
|
||||||
|
|
||||||
|
# thread_cache_size = -1
|
||||||
|
|
||||||
|
# This replaces the startup script and checks MyISAM tables if needed
|
||||||
|
# the first time they are touched
|
||||||
|
myisam-recover-options = BACKUP
|
||||||
|
|
||||||
|
# max_connections = 151
|
||||||
|
|
||||||
|
# table_open_cache = 4000
|
||||||
|
|
||||||
|
#
|
||||||
|
# * Logging and Replication
|
||||||
|
#
|
||||||
|
# Both location gets rotated by the cronjob.
|
||||||
|
#
|
||||||
|
# Log all queries
|
||||||
|
# Be aware that this log type is a performance killer.
|
||||||
|
# general_log_file = /var/log/mysql/query.log
|
||||||
|
# general_log = 1
|
||||||
|
#
|
||||||
|
# Error log - should be very few entries.
|
||||||
|
#
|
||||||
|
log_error = /var/log/mysql/error.log
|
||||||
|
#
|
||||||
|
# Here you can see queries with especially long duration
|
||||||
|
# slow_query_log = 1
|
||||||
|
# slow_query_log_file = /var/log/mysql/mysql-slow.log
|
||||||
|
# long_query_time = 2
|
||||||
|
# log-queries-not-using-indexes
|
||||||
|
#
|
||||||
|
# The following can be used as easy to replay backup logs or for replication.
|
||||||
|
# note: if you are setting up a replication slave, see README.Debian about
|
||||||
|
# other settings you may need to change.
|
||||||
|
# server-id = 1
|
||||||
|
# log_bin = /var/log/mysql/mysql-bin.log
|
||||||
|
# binlog_expire_logs_seconds = 2592000
|
||||||
|
max_binlog_size = 100M
|
||||||
|
# binlog_do_db = include_database_name
|
||||||
|
# binlog_ignore_db = include_database_name
|
||||||
|
#
|
||||||
|
# InnoDB Clustering Settings
|
||||||
|
# +--------------------------+---------------+----------------
|
||||||
|
# | Variable | Current Value | Required Value
|
||||||
|
# +--------------------------+---------------+----------------
|
||||||
|
# | binlog_checksum | CRC32 | NONE
|
||||||
|
# | enforce_gtid_consistency | OFF | ON
|
||||||
|
# | gtid_mode | OFF | ON
|
||||||
|
# | server_id | 1 | <unique ID>
|
||||||
|
# +--------------------------+---------------+----------------
|
||||||
|
binlog_checksum = NONE
|
||||||
|
enforce_gtid_consistency = ON
|
||||||
|
gtid_mode = ON
|
||||||
|
server_id = {{ options.server_id }}
|
||||||
|
|
||||||
|
skip_name_resolve = ON
|
|
@ -0,0 +1,3 @@
|
||||||
|
# zaza
|
||||||
|
git+https://github.com/openstack-charmers/zaza.git#egg=zaza
|
||||||
|
git+https://github.com/openstack-charmers/zaza-openstack-tests.git#egg=zaza.openstack
|
|
@ -0,0 +1 @@
|
||||||
|
eoan.yaml
|
|
@ -0,0 +1,14 @@
|
||||||
|
series: eoan
|
||||||
|
relations:
|
||||||
|
- ["keystone:shared-db", "mysql-innodb-cluster:shared-db"]
|
||||||
|
applications:
|
||||||
|
mysql-innodb-cluster:
|
||||||
|
series: eoan
|
||||||
|
charm: ../../../mysql-innodb-cluster
|
||||||
|
num_units: 3
|
||||||
|
options:
|
||||||
|
source: distro-proposed
|
||||||
|
keystone:
|
||||||
|
series: eoan
|
||||||
|
charm: cs:~openstack-charmers-next/keystone
|
||||||
|
num_units: 1
|
|
@ -0,0 +1,9 @@
|
||||||
|
applications:
|
||||||
|
keystone:
|
||||||
|
num_units: 3
|
||||||
|
options:
|
||||||
|
vip: {{OS_VIP00}}
|
||||||
|
hacluster:
|
||||||
|
charm: cs:~openstack-charmers-next/hacluster
|
||||||
|
relations:
|
||||||
|
- ["keystone:ha", "hacluster:ha"]
|
|
@ -0,0 +1,13 @@
|
||||||
|
charm_name: mysql-innodb-cluster
|
||||||
|
configure:
|
||||||
|
# Validates database queries
|
||||||
|
- zaza.openstack.charm_tests.keystone.setup.add_demo_user
|
||||||
|
tests:
|
||||||
|
# Validates database queries
|
||||||
|
- zaza.openstack.charm_tests.keystone.tests.AuthenticationAuthorizationTest
|
||||||
|
dev_bundles:
|
||||||
|
gate_bundles:
|
||||||
|
- eoan
|
||||||
|
- eoan-ha
|
||||||
|
smoke_bundles:
|
||||||
|
- eoan
|
|
@ -0,0 +1,35 @@
|
||||||
|
[tox]
|
||||||
|
envlist = pep8
|
||||||
|
skipsdist = True
|
||||||
|
|
||||||
|
[testenv]
|
||||||
|
setenv = VIRTUAL_ENV={envdir}
|
||||||
|
PYTHONHASHSEED=0
|
||||||
|
whitelist_externals = juju
|
||||||
|
passenv = HOME TERM CS_API_* OS_* AMULET_*
|
||||||
|
deps = -r{toxinidir}/test-requirements.txt
|
||||||
|
install_command =
|
||||||
|
pip install {opts} {packages}
|
||||||
|
|
||||||
|
[testenv:pep8]
|
||||||
|
basepython = python3
|
||||||
|
deps=charm-tools
|
||||||
|
commands = charm-proof
|
||||||
|
|
||||||
|
[testenv:func-noop]
|
||||||
|
basepython = python3
|
||||||
|
commands =
|
||||||
|
true
|
||||||
|
|
||||||
|
[testenv:func]
|
||||||
|
basepython = python3
|
||||||
|
commands =
|
||||||
|
functest-run-suite --keep-model
|
||||||
|
|
||||||
|
[testenv:func-smoke]
|
||||||
|
basepython = python3
|
||||||
|
commands =
|
||||||
|
functest-run-suite --keep-model --smoke
|
||||||
|
|
||||||
|
[testenv:venv]
|
||||||
|
commands = {posargs}
|
|
@ -0,0 +1,3 @@
|
||||||
|
jinja2
|
||||||
|
psutil
|
||||||
|
mysqlclient
|
|
@ -0,0 +1,13 @@
|
||||||
|
# This file is managed centrally. If you find the need to modify this as a
|
||||||
|
# one-off, please don't. Intead, consult #openstack-charms and ask about
|
||||||
|
# requirements management in charms via bot-control. Thank you.
|
||||||
|
#
|
||||||
|
# Lint and unit test requirements
|
||||||
|
flake8>=2.2.4,<=2.4.1
|
||||||
|
stestr>=2.2.0
|
||||||
|
requests>=2.18.4
|
||||||
|
charms.reactive
|
||||||
|
mock>=1.2
|
||||||
|
nose>=1.3.7
|
||||||
|
coverage>=3.6
|
||||||
|
git+https://github.com/openstack/charms.openstack.git#egg=charms.openstack
|
|
@ -0,0 +1,80 @@
|
||||||
|
# Source charm: ./tox.ini
|
||||||
|
# This file is managed centrally by release-tools and should not be modified
|
||||||
|
# within individual charm repos.
|
||||||
|
[tox]
|
||||||
|
skipsdist = True
|
||||||
|
envlist = pep8,py3
|
||||||
|
|
||||||
|
[testenv]
|
||||||
|
setenv = VIRTUAL_ENV={envdir}
|
||||||
|
PYTHONHASHSEED=0
|
||||||
|
TERM=linux
|
||||||
|
CHARM_LAYER_PATH={toxinidir}/layers
|
||||||
|
CHARM_INTERFACES_DIR={toxinidir}/interfaces
|
||||||
|
JUJU_REPOSITORY={toxinidir}/build
|
||||||
|
passenv = http_proxy https_proxy OS_*
|
||||||
|
install_command =
|
||||||
|
pip install {opts} {packages}
|
||||||
|
deps =
|
||||||
|
-r{toxinidir}/requirements.txt
|
||||||
|
|
||||||
|
[testenv:build]
|
||||||
|
basepython = python3
|
||||||
|
commands =
|
||||||
|
charm-build --log-level DEBUG -o {toxinidir}/build src {posargs}
|
||||||
|
|
||||||
|
[testenv:py3]
|
||||||
|
basepython = python3
|
||||||
|
deps = -r{toxinidir}/test-requirements.txt
|
||||||
|
commands = stestr run {posargs}
|
||||||
|
|
||||||
|
[testenv:py35]
|
||||||
|
basepython = python3.5
|
||||||
|
deps = -r{toxinidir}/test-requirements.txt
|
||||||
|
commands = stestr run {posargs}
|
||||||
|
|
||||||
|
[testenv:py36]
|
||||||
|
basepython = python3.6
|
||||||
|
deps = -r{toxinidir}/test-requirements.txt
|
||||||
|
commands = stestr run {posargs}
|
||||||
|
|
||||||
|
[testenv:pep8]
|
||||||
|
basepython = python3
|
||||||
|
deps = -r{toxinidir}/test-requirements.txt
|
||||||
|
commands = flake8 {posargs} src unit_tests
|
||||||
|
|
||||||
|
[testenv:cover]
|
||||||
|
# Technique based heavily upon
|
||||||
|
# https://github.com/openstack/nova/blob/master/tox.ini
|
||||||
|
basepython = python3
|
||||||
|
deps = -r{toxinidir}/requirements.txt
|
||||||
|
-r{toxinidir}/test-requirements.txt
|
||||||
|
setenv =
|
||||||
|
{[testenv]setenv}
|
||||||
|
PYTHON=coverage run
|
||||||
|
commands =
|
||||||
|
coverage erase
|
||||||
|
stestr run {posargs}
|
||||||
|
coverage combine
|
||||||
|
coverage html -d cover
|
||||||
|
coverage xml -o cover/coverage.xml
|
||||||
|
coverage report
|
||||||
|
|
||||||
|
[coverage:run]
|
||||||
|
branch = True
|
||||||
|
concurrency = multiprocessing
|
||||||
|
parallel = True
|
||||||
|
source =
|
||||||
|
.
|
||||||
|
omit =
|
||||||
|
.tox/*
|
||||||
|
*/charmhelpers/*
|
||||||
|
unit_tests/*
|
||||||
|
|
||||||
|
[testenv:venv]
|
||||||
|
basepython = python3
|
||||||
|
commands = {posargs}
|
||||||
|
|
||||||
|
[flake8]
|
||||||
|
# E402 ignore necessary for path append before sys module import in actions
|
||||||
|
ignore = E402
|
|
@ -0,0 +1,32 @@
|
||||||
|
# Copyright 2019 Canonical Ltd
|
||||||
|
#
|
||||||
|
# Licensed under the Apache License, Version 2.0 (the "License");
|
||||||
|
# you may not use this file except in compliance with the License.
|
||||||
|
# You may obtain a copy of the License at
|
||||||
|
#
|
||||||
|
# http://www.apache.org/licenses/LICENSE-2.0
|
||||||
|
#
|
||||||
|
# Unless required by applicable law or agreed to in writing, software
|
||||||
|
# distributed under the License is distributed on an "AS IS" BASIS,
|
||||||
|
# WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
|
||||||
|
# See the License for the specific language governing permissions and
|
||||||
|
# limitations under the License.
|
||||||
|
|
||||||
|
import os
|
||||||
|
import sys
|
||||||
|
|
||||||
|
# Mock out charmhelpers so that we can test without it.
|
||||||
|
import charms_openstack.test_mocks # noqa
|
||||||
|
charms_openstack.test_mocks.mock_charmhelpers()
|
||||||
|
|
||||||
|
_path = os.path.dirname(os.path.realpath(__file__))
|
||||||
|
_src = os.path.abspath(os.path.join(_path, 'src'))
|
||||||
|
_lib = os.path.abspath(os.path.join(_path, 'src/lib'))
|
||||||
|
|
||||||
|
|
||||||
|
def _add_path(path):
|
||||||
|
if path not in sys.path:
|
||||||
|
sys.path.insert(1, path)
|
||||||
|
|
||||||
|
_add_path(_src)
|
||||||
|
_add_path(_lib)
|
Loading…
Reference in New Issue