openstack/monasca-api
Code Issues Proposed changes
c36c2c69a4
monasca-api/devstack/settings

257 lines
10 KiB
Plaintext
Raw Normal View History

Add copyright headers Add copyright headers to devstack plugin files. Change-Id: Ia839c59161e093b8dfa3ec23fae80ab32a8adfd9
2015-09-21 08:48:12 -06:00
#
Enabling Postgres + ORM in devstack Following commit provides: - possibility of using postgres as database backend - possibility of using ORM mapping in monasca: - API - Thresh - Notification Additionally: - different approach of providing configuration settings - removed unused winchester schema - reworked execution phases of the plugin: -- installing dependencies in the beginning Implements: blueprint postgres-cli-support Change-Id: Iae561b0c7e6b90cc7c9f5b122c0e4b37bc5ef843
2016-10-28 22:10:08 +02:00
# (C) Copyright 2015 Hewlett Packard Enterprise Development LP
# Copyright 2017 FUJITSU LIMITED
Add copyright headers Add copyright headers to devstack plugin files. Change-Id: Ia839c59161e093b8dfa3ec23fae80ab32a8adfd9
2015-09-21 08:48:12 -06:00
#
# Licensed under the Apache License, Version 2.0 (the "License");
# you may not use this file except in compliance with the License.
# You may obtain a copy of the License at
#
#    http://www.apache.org/licenses/LICENSE-2.0
#
# Unless required by applicable law or agreed to in writing, software
# distributed under the License is distributed on an "AS IS" BASIS,
# WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or
# implied.
# See the License for the specific language governing permissions and
# limitations under the License.
#
Added missing comment markers Change-Id: I90c8ed32cd217d667ce29ae52e7743311bd76081
2015-10-08 13:37:05 -06:00
# The following two variables allow switching between java and python for the implementations
Monasca DevStack integration Add the following Monasca components: - monasca-persister (python) - monasca-api (python) Change-Id: I40e714924c7bff109592de8021a09ec78b5025d0
2015-10-07 17:15:20 -06:00
# of the Monasca API and the Monasca Persister. These variables can be set here
# or in the DevStack local.conf file.
Monasca DevStack integration Add the following Monasca components: - monasca-persister (java) - monasca-notification - storm - monasca-thresh - monasca-keystone-credentials - monasca-agent - monasca-smoke-test Change-Id: Ic6410895c36e70e9eea208d8868ead743132d331
2015-09-29 10:52:29 -06:00
Add support for Vertica in the DevStack plugin Change-Id: I9691bdbb8e3ce6f613a16370f99e5216c4a07ca1
2016-03-05 13:45:20 -07:00
# MONASCA_API_IMPLEMENTATION_LANG=${MONASCA_API_IMPLEMENTATION_LANG:-java}
Make devstack-gate work Make changes to plugin.sh to get devstack-gate to run. Disable all tempest tests but one Change-Id: Ice6c7915c81314e7f286b64c81a065e25f8f5005
2015-10-27 16:37:39 -06:00
MONASCA_API_IMPLEMENTATION_LANG=${MONASCA_API_IMPLEMENTATION_LANG:-python}
Monasca DevStack integration Add the following Monasca components: - monasca-persister (java) - monasca-notification - storm - monasca-thresh - monasca-keystone-credentials - monasca-agent - monasca-smoke-test Change-Id: Ic6410895c36e70e9eea208d8868ead743132d331
2015-09-29 10:52:29 -06:00
Add support for Vertica in the DevStack plugin Change-Id: I9691bdbb8e3ce6f613a16370f99e5216c4a07ca1
2016-03-05 13:45:20 -07:00
# MONASCA_PERSISTER_IMPLEMENTATION_LANG=${MONASCA_PERSISTER_IMPLEMENTATION_LANG:-java}
Make devstack-gate work Make changes to plugin.sh to get devstack-gate to run. Disable all tempest tests but one Change-Id: Ice6c7915c81314e7f286b64c81a065e25f8f5005
2015-10-27 16:37:39 -06:00
MONASCA_PERSISTER_IMPLEMENTATION_LANG=${MONASCA_PERSISTER_IMPLEMENTATION_LANG:-python}
Monasca DevStack integration Add the following Monasca components: - monasca-persister (java) - monasca-notification - storm - monasca-thresh - monasca-keystone-credentials - monasca-agent - monasca-smoke-test Change-Id: Ic6410895c36e70e9eea208d8868ead743132d331
2015-09-29 10:52:29 -06:00
Add support for Vertica in the DevStack plugin Change-Id: I9691bdbb8e3ce6f613a16370f99e5216c4a07ca1
2016-03-05 13:45:20 -07:00
# MONASCA_METRICS_DB=${MONASCA_METRICS_DB:-vertica}
Add Cassandra support to devstack Change-Id: I76af9bb58240ee7401cd9bddf991bc65410154c7 Implements: blueprint monasca-cassandra Depends-on: I9ddbd2037fb6b989dee5e33945df9dd08afa84e8 Depends-on: I2152057ef4843b555a21118cb20bd9eff36c3b7a
2016-08-02 10:24:39 +09:00
# MONASCA_METRICS_DB=${MONASCA_METRICS_DB:-cassandra}
Add support for Vertica in the DevStack plugin Change-Id: I9691bdbb8e3ce6f613a16370f99e5216c4a07ca1
2016-03-05 13:45:20 -07:00
MONASCA_METRICS_DB=${MONASCA_METRICS_DB:-influxdb}
Monasca DevStack integration Add the following Monasca components: - monasca-persister (java) - monasca-notification - storm - monasca-thresh - monasca-keystone-credentials - monasca-agent - monasca-smoke-test Change-Id: Ic6410895c36e70e9eea208d8868ead743132d331
2015-09-29 10:52:29 -06:00
# Turn on all the Monasca services by default. Currently enabling specific services
# has no effect. All services are enabled by default. There is currently no mechanism
Added missing comment markers Change-Id: I90c8ed32cd217d667ce29ae52e7743311bd76081
2015-10-08 13:37:05 -06:00
# implemented to turn off specific Monasca services.
Start devstack integration Change-Id: I46047b57cc54abc79b8589b16236e091886d926d
2015-09-17 16:45:01 -06:00
Refine the monasca services in the plugin.sh file Explicitly state the services that monasca depends on and show their dependencies. Change-Id: I314a32407f45bcb6bfae3eed5410c28e57332408
2015-09-21 15:44:04 -06:00
#
# Monasca top level service that enables all other services
#
enable_service monasca
#
# Monasca infrastructure services
#
Start devstack integration Change-Id: I46047b57cc54abc79b8589b16236e091886d926d
2015-09-17 16:45:01 -06:00
Use devstack dlm-zookeeper functionality Devstack provides zookeeper OOTB. This patch removes the need of manual installation of zookeeper. Change-Id: I3278ee57023fe4a9e8acc9a6f40eac43b865ed55
2016-10-29 03:37:07 +02:00
# devstack zookeeper
Restore zookeeper to devstack openstack/devstack-dev has removed zookeeper support. For details see [1]. Following commits brings back zookeper as it was previously installed from devstack. Extra: * added concepts of devstack dependencies. That speeds up installation a bit as common packages are installed prior to the plugin code Ref: [1] https://github.com/openstack-dev/devstack/commit/c0d16c279ad2a24bd13e2dbd6ae6986c37c4f230 Change-Id: I0323eacb5cbba8418550e3322189104c35cf4c36
2017-05-26 10:48:14 +02:00
enable_service monasca-zookeeper
Use devstack dlm-zookeeper functionality Devstack provides zookeeper OOTB. This patch removes the need of manual installation of zookeeper. Change-Id: I3278ee57023fe4a9e8acc9a6f40eac43b865ed55
2016-10-29 03:37:07 +02:00
Refine the monasca services in the plugin.sh file Explicitly state the services that monasca depends on and show their dependencies. Change-Id: I314a32407f45bcb6bfae3eed5410c28e57332408
2015-09-21 15:44:04 -06:00
# Monasca databases
# MySQL is already enabled in devstack
enable_service monasca-influxdb
Start devstack integration Change-Id: I46047b57cc54abc79b8589b16236e091886d926d
2015-09-17 16:45:01 -06:00
Refine the monasca services in the plugin.sh file Explicitly state the services that monasca depends on and show their dependencies. Change-Id: I314a32407f45bcb6bfae3eed5410c28e57332408
2015-09-21 15:44:04 -06:00
# Apache Storm
enable_service monasca-storm
Better handling of storm processes Use devstack utilities to launch storm processes and be able to see their logs. Change-Id: Iccc30d411a49b9e47d6625909427f071397aedfd
2017-09-26 08:00:34 +02:00
enable_service monasca-storm-nimbus
enable_service monasca-storm-supervisor
Enable ui & logviewer locally Commit enables storm-{logviewer,ui} for the purposes of the local development but keeps them disabled in the gate runs. Depends-On: Iccc30d411a49b9e47d6625909427f071397aedfd Change-Id: I8cc2d6c616eff9ab058b24f837c655228b84f184
2017-09-26 13:25:29 +02:00
disable_service monasca-storm-ui
disable_service monasca-storm-logviewer
Refine the monasca services in the plugin.sh file Explicitly state the services that monasca depends on and show their dependencies. Change-Id: I314a32407f45bcb6bfae3eed5410c28e57332408
2015-09-21 15:44:04 -06:00
Restore zookeeper to devstack openstack/devstack-dev has removed zookeeper support. For details see [1]. Following commits brings back zookeper as it was previously installed from devstack. Extra: * added concepts of devstack dependencies. That speeds up installation a bit as common packages are installed prior to the plugin code Ref: [1] https://github.com/openstack-dev/devstack/commit/c0d16c279ad2a24bd13e2dbd6ae6986c37c4f230 Change-Id: I0323eacb5cbba8418550e3322189104c35cf4c36
2017-05-26 10:48:14 +02:00
# monasca-kafka depends on monasca-zookeeper
Refine the monasca services in the plugin.sh file Explicitly state the services that monasca depends on and show their dependencies. Change-Id: I314a32407f45bcb6bfae3eed5410c28e57332408
2015-09-21 15:44:04 -06:00
enable_service monasca-kafka
#
# Monasca core services
#
# monasca-api depends on monasca-influxdb, MySQL, monasca-kafka
Start devstack integration Change-Id: I46047b57cc54abc79b8589b16236e091886d926d
2015-09-17 16:45:01 -06:00
enable_service monasca-api
Refine the monasca services in the plugin.sh file Explicitly state the services that monasca depends on and show their dependencies. Change-Id: I314a32407f45bcb6bfae3eed5410c28e57332408
2015-09-21 15:44:04 -06:00
# monasca-persister depends on monasca-influxdb, monasca-kafka
Start devstack integration Change-Id: I46047b57cc54abc79b8589b16236e091886d926d
2015-09-17 16:45:01 -06:00
enable_service monasca-persister
Refine the monasca services in the plugin.sh file Explicitly state the services that monasca depends on and show their dependencies. Change-Id: I314a32407f45bcb6bfae3eed5410c28e57332408
2015-09-21 15:44:04 -06:00
# monasca-notification depends on MySQL, monasca-kafka
Start devstack integration Change-Id: I46047b57cc54abc79b8589b16236e091886d926d
2015-09-17 16:45:01 -06:00
enable_service monasca-notification
Refine the monasca services in the plugin.sh file Explicitly state the services that monasca depends on and show their dependencies. Change-Id: I314a32407f45bcb6bfae3eed5410c28e57332408
2015-09-21 15:44:04 -06:00
# monasca-thresh depends on MySQL, monasca-kafka, monasca-storm
Start devstack integration Change-Id: I46047b57cc54abc79b8589b16236e091886d926d
2015-09-17 16:45:01 -06:00
enable_service monasca-thresh
Refine the monasca services in the plugin.sh file Explicitly state the services that monasca depends on and show their dependencies. Change-Id: I314a32407f45bcb6bfae3eed5410c28e57332408
2015-09-21 15:44:04 -06:00
# monasca-agent depends on monasca-api
Start devstack integration Change-Id: I46047b57cc54abc79b8589b16236e091886d926d
2015-09-17 16:45:01 -06:00
enable_service monasca-agent
Refine the monasca services in the plugin.sh file Explicitly state the services that monasca depends on and show their dependencies. Change-Id: I314a32407f45bcb6bfae3eed5410c28e57332408
2015-09-21 15:44:04 -06:00
# monasca-cli depends on monasca-api
enable_service monasca-cli
Upgrade Influxdb to 0.9.5 Add the version of Influxdb, Storm and Kafka to settings file to make it easier to test new versions Change-Id: I0009d99861c6663160278382a6d65195bf841bd8
2015-11-22 22:45:37 -07:00
Update devstack plugin to support new api Merge log-api and api Story: 2003881 Task: 36195 Depends-On: https://review.opendev.org/681419/ Change-Id: Idb2361e5ab701cd3dee4eabb4b43116f6e1205c4
2019-07-23 13:06:58 +02:00
#
# Monasca logs services
#
enable_service kibana
enable_service elasticsearch
enable_service monasca-log
enable_service monasca-log-persister
enable_service monasca-log-transformer
enable_service monasca-log-metrics
enable_service monasca-log-agent
Upgrade Influxdb to 0.9.5 Add the version of Influxdb, Storm and Kafka to settings file to make it easier to test new versions Change-Id: I0009d99861c6663160278382a6d65195bf841bd8
2015-11-22 22:45:37 -07:00
#
# Dependent Software Versions
#
Add support for InfluxDB 0.11.0 to 1.1.0 in the Python API In InfluxDB version 0.11.0 the result set for SHOW SERIES changed. See https://github.com/influxdata/influxdb/blob/master/CHANGELOG.md#v0110-2016-03-22 Modifed the code to be compatible with either the old or new result set. In InfluxDB version 1.0.0 the config file changed. See https://github.com/influxdata/influxdb/blob/master/CHANGELOG.md#v100-2016-09-08 Modified the config file deployed by DevStack to be compatible with either the old or new config file. In some other InfluxDB release several database ops, such as CREATE DATABASE, were modified from http GET to POST. Modified how databases are created in the DevStack plugin.sh. Change-Id: I33188f4e64150d2cb24c0a06979c06f03c803da4
2016-12-07 16:49:32 -07:00
# Set the InfluxDB version to use for the Java and Python API
# InfluxDB has modified the result sets for SHOW SERIES. The
# Python API has been modified to support those changes, but the
# Java API hasn't yet. These two environment variables allow you
# to deploy either the Java or Python API without having to
# also set the INFLUXDB_VERSION when switching between the two.
INFLUXDB_JAVA_VERSION=${INFLUXDB_JAVA_VERSION:-0.9.5}
Upgrade InfluxDB to latest release (v1.7.6) Updated default config to use InfluxDB v1.7.6. This appears to work, at least for viewing metrics, persisting them, and some CLI commands. Updated influxdb.conf to bring in line with sample config. Drops support for configs of older versions. Story: 2005624 Task: 30877 Co-Authored-By: Isaac Prior <isaac@stackhpc.com> Change-Id: Ib73151e6e7d0934303c9e801bb018bc22f1716ae
2019-05-10 11:56:20 +01:00
INFLUXDB_PYTHON_VERSION=${INFLUXDB_PYTHON_VERSION:-1.7.6}
Add support for InfluxDB 0.11.0 to 1.1.0 in the Python API In InfluxDB version 0.11.0 the result set for SHOW SERIES changed. See https://github.com/influxdata/influxdb/blob/master/CHANGELOG.md#v0110-2016-03-22 Modifed the code to be compatible with either the old or new result set. In InfluxDB version 1.0.0 the config file changed. See https://github.com/influxdata/influxdb/blob/master/CHANGELOG.md#v100-2016-09-08 Modified the config file deployed by DevStack to be compatible with either the old or new config file. In some other InfluxDB release several database ops, such as CREATE DATABASE, were modified from http GET to POST. Modified how databases are created in the DevStack plugin.sh. Change-Id: I33188f4e64150d2cb24c0a06979c06f03c803da4
2016-12-07 16:49:32 -07:00
# To set the same version of InfluxDB for both languages use the
# following variable. This will override both the Java and Python
# specific variables above.
# INFLUXDB_VERSION=${INFLUXDB_VERSION:-0.9.5}
Fix Vertica provisioning on Xenial Fix Vertica flavored devstack failed to provision on Ubuntu Xenial. Update Vertica version to 8.0.0-0. Change-Id: I0c0118d0416b9c821c3c86d7bb3cef13e512670f
2016-11-29 13:51:45 +09:00
VERTICA_VERSION=${VERTICA_VERSION:-8.0.0-0}
Add cassandra support Support Cassandra db installation and Cassandra related configurations for Monasca api and persister services in devstack. Add Monasca rest API Cassandra plugin for retrieving metric, dimension, measurement, statistics and alarms. Change-Id: Ie60d668692e1f25f555dda2355f4e513d582736c story: 2001231 task: 5759
2017-08-31 14:47:47 -07:00
CASSANDRA_VERSION=${CASSANDRA_VERSION:-311x}
[goal] Migrate testing to ubuntu focal As per victoria cycle testing runtime and community goal[1] we need to migrate upstream CI/CD to Ubuntu Focal(20.04). -Bump the lower constraints for required deps which added python3.8 support in their later version. -Changing the way to install and configure Zookeeper. Installing Zookeeper from official Apache's tarball. Adding the possiblity to set the specific Zookeeper version. Minor change in zookeeper logger. -Use mariadb JDBC for monasca-thresh in devstack, since Drizzle isn't compatible with MySql Server v8.0.x which is default in Focal -Python 3.8 doesn't seem to like dictionary keys changing during iteration. Fixing RuntimeError: dictionary keys changed during iteration. Tech. details: It runs well in py27: 5 iterations It runs risky in py37: 7 iterations It is forbbiden in py38: raised RuntimeError Fixed with list(dic.items()) or tuple(dic.items()) dic = {'1': 'a', '2': 'b', '3': 'c', '4': 'd', '5': 'e'} for key, value in dic.items(): print("Key: {0} Value: {1}".format(key,value)) del dic[key] print(dic) dic[key] = value print(dic) Story: #2007865 Task: #40197 Depends-On: https://review.opendev.org/756859 Change-Id: Ieb4cf38038ffb4d1a152f8ab3b64a14098c7cbb3
2020-09-29 11:19:29 +02:00
ZOOKEEPER_VERSION=${ZOOKEEPER_VERSION:-3.4.13} # 3.4.13 default in Focal; 3.4.10 default in Bionic
Upgrade Influxdb to 0.9.5 Add the version of Influxdb, Storm and Kafka to settings file to make it easier to test new versions Change-Id: I0009d99861c6663160278382a6d65195bf841bd8
2015-11-22 22:45:37 -07:00
# Kafka deb consists of the version of scala plus the version of kafka
Upgrade Apache Kafka to version 2.0.1 Upgrade Apache Kafka to current stable version 2.0.1. Issues have been observed with legacy Kafka producer being used in notification engine together with newer Kafka broker versions. Following changes are included: * Deprecated configuration option `advertised.host.name` is replaced with `listeners`. * Default `log4j.properties` is used. Story: 2005624 Task: 30933 Change-Id: I898b511b2ab8f68e4850faab2098044cd3f94ee7
2019-07-15 22:27:30 +02:00
BASE_KAFKA_VERSION=${BASE_KAFKA_VERSION:-2.0.1}
SCALA_VERSION=${SCALA_VERSION:-2.12}
Upgrade Influxdb to 0.9.5 Add the version of Influxdb, Storm and Kafka to settings file to make it easier to test new versions Change-Id: I0009d99861c6663160278382a6d65195bf841bd8
2015-11-22 22:45:37 -07:00
KAFKA_VERSION=${KAFKA_VERSION:-${SCALA_VERSION}-${BASE_KAFKA_VERSION}}
Upgrade Storm to 1.2.2 This is the current release and has been running in Kolla for some time, see notes here: https://storm.apache.org/2018/06/04/storm122-released.html Change-Id: I73c5118912ca07d73d99ba893bc6e20f74774a6e Story: 2005624 Task: 30934
2019-05-10 14:54:24 +01:00
STORM_VERSION=${STORM_VERSION:-1.2.2}
Move versions to settings Software versions are defined in settings file not in plugin.sh. Change-Id: Ic714b343a1dc706ade5af3d618981056fdb309c1
2016-10-20 06:39:11 +02:00
GO_VERSION=${GO_VERSION:-"1.7.1"}
NODE_JS_VERSION=${NODE_JS_VERSION:-"4.0.0"}
Use devstack git_clone Following commits changes manual git clone to git_clone from devstack common functions. That allows monasca devstack plugin to use globals ``ERROR_ON_CLONE``, ``OFFLINE`` and ``RECLONE`` as defined by devstack. Also it will be possible to specify branches and repositories for monasca components directly before stacking for the first time Closes-Bug: 1625488 Change-Id: I3d16eca203a3428749de6e478da3dd92327ea7bf
2016-10-11 20:56:28 +00:00
NVM_VERSION=${NVM_VERSION:-"0.32.1"}
[DevStack] Allow testing different Kibana versions Kibana API has changed between the versions. To allow testing different Kibana versions `kibana_version` option should be set in tempest.conf. This is a partial port of https://review.opendev.org/727195 Change-Id: I0a21bd99c942ab05ce1eae51226132691518bd91
2020-05-25 17:05:09 +02:00
KIBANA_VERSION=${KIBANA_VERSION:-7.3.0}
Upgrade Elkstack in new API The commit contains upgrade of Elk components, default index pattern creation in new API. Story: 2006376 Task: 38125 Depends-On: https://review.opendev.org/#/c/679781 Change-Id: Ib0b966c0d7db993802b5372156c41b3ebdf1a77f
2019-12-03 16:57:53 +01:00
LOGSTASH_VERSION=${LOGSTASH_VERSION:-7.3.0}
ELASTICSEARCH_VERSION=${ELASTICSEARCH_VERSION:-7.3.0}
LOGSTASH_OUTPUT_MONASCA_VERSION=${LOGSTASH_OUTPUT_MONASCA_VERSION:-2.0.0}
Use devstack git_clone Following commits changes manual git clone to git_clone from devstack common functions. That allows monasca devstack plugin to use globals ``ERROR_ON_CLONE``, ``OFFLINE`` and ``RECLONE`` as defined by devstack. Also it will be possible to specify branches and repositories for monasca components directly before stacking for the first time Closes-Bug: 1625488 Change-Id: I3d16eca203a3428749de6e478da3dd92327ea7bf
2016-10-11 20:56:28 +00:00
Add build and installation for monasca-kibana-plugin in new API Story: 2006376 Task: 38335 Depends-On: https://review.opendev.org/#/c/680075/ Change-Id: I5887c75dbf499027b21b86c2850370f6729fb451
2020-01-21 18:58:12 +01:00
# Needed for plugin build environment initialization
KIBANA_DEV_BRANCH=${KIBANA_DEV_BRANCH:-7.3}
KIBANA_DEV_REPO="https://github.com/elastic/kibana"
MONASCA_KIBANA_PLUGIN_REPO=${MONASCA_KIBANA_PLUGIN_REPO:-${GIT_BASE}/openstack/monasca-kibana-plugin.git}
MONASCA_KIBANA_PLUGIN_BRANCH=${MONASCA_KIBANA_PLUGIN_BRANCH:-master}
MONASCA_KIBANA_PLUGIN_DIR=${DEST}/monasca-kibana-plugin
Use devstack git_clone Following commits changes manual git clone to git_clone from devstack common functions. That allows monasca devstack plugin to use globals ``ERROR_ON_CLONE``, ``OFFLINE`` and ``RECLONE`` as defined by devstack. Also it will be possible to specify branches and repositories for monasca components directly before stacking for the first time Closes-Bug: 1625488 Change-Id: I3d16eca203a3428749de6e478da3dd92327ea7bf
2016-10-11 20:56:28 +00:00
# Path settings
MONASCA_BASE=${DEST}
Enabling Postgres + ORM in devstack Following commit provides: - possibility of using postgres as database backend - possibility of using ORM mapping in monasca: - API - Thresh - Notification Additionally: - different approach of providing configuration settings - removed unused winchester schema - reworked execution phases of the plugin: -- installing dependencies in the beginning Implements: blueprint postgres-cli-support Change-Id: Iae561b0c7e6b90cc7c9f5b122c0e4b37bc5ef843
2016-10-28 22:10:08 +02:00
MONASCA_SCHEMA_DIR=${DEST}/monasca/schema
Use devstack git_clone Following commits changes manual git clone to git_clone from devstack common functions. That allows monasca devstack plugin to use globals ``ERROR_ON_CLONE``, ``OFFLINE`` and ``RECLONE`` as defined by devstack. Also it will be possible to specify branches and repositories for monasca components directly before stacking for the first time Closes-Bug: 1625488 Change-Id: I3d16eca203a3428749de6e478da3dd92327ea7bf
2016-10-11 20:56:28 +00:00
# Repository settings
MONASCA_API_REPO=${MONASCA_API_REPO:-${GIT_BASE}/openstack/monasca-api.git}
MONASCA_API_BRANCH=${MONASCA_API_BRANCH:-master}
MONASCA_API_DIR=${MONASCA_BASE}/monasca-api
MONASCA_PERSISTER_REPO=${MONASCA_PERSISTER_REPO:-${GIT_BASE}/openstack/monasca-persister.git}
MONASCA_PERSISTER_BRANCH=${MONASCA_PERSISTER_BRANCH:-master}
MONASCA_PERSISTER_DIR=${MONASCA_BASE}/monasca-persister
MONASCA_NOTIFICATION_REPO=${MONASCA_NOTIFICATION_REPO:-${GIT_BASE}/openstack/monasca-notification.git}
MONASCA_NOTIFICATION_BRANCH=${MONASCA_NOTIFICATION_BRANCH:-master}
MONASCA_NOTIFICATION_DIR=${MONASCA_BASE}/monasca-notification
MONASCA_THRESH_REPO=${MONASCA_THRESH_REPO:-${GIT_BASE}/openstack/monasca-thresh.git}
MONASCA_THRESH_BRANCH=${MONASCA_THRESH_BRANCH:-master}
MONASCA_THRESH_DIR=${MONASCA_BASE}/monasca-thresh
MONASCA_CLIENT_REPO=${MONASCA_CLIENT_REPO:-${GIT_BASE}/openstack/python-monascaclient.git}
MONASCA_CLIENT_BRANCH=${MONASCA_CLIENT_BRANCH:-master}
MONASCA_CLIENT_DIR=${MONASCA_BASE}/python-monascaclient
MONASCA_AGENT_REPO=${MONASCA_AGENT_REPO:-${GIT_BASE}/openstack/monasca-agent.git}
MONASCA_AGENT_BRANCH=${MONASCA_AGENT_BRANCH:-master}
MONASCA_AGENT_DIR=${MONASCA_BASE}/monasca-agent
MONASCA_UI_REPO=${MONASCA_UI_REPO:-${GIT_BASE}/openstack/monasca-ui.git}
MONASCA_UI_BRANCH=${MONASCA_UI_BRANCH:-master}
MONASCA_UI_DIR=${MONASCA_BASE}/monasca-ui
MONASCA_COMMON_REPO=${MONASCA_COMMON_REPO:-${GIT_BASE}/openstack/monasca-common.git}
MONASCA_COMMON_BRANCH=${MONASCA_COMMON_BRANCH:-master}
MONASCA_COMMON_DIR=${MONASCA_BASE}/monasca-common
Refactor monasca libraries Refactor the code about cloning and installing monasca-common and monasca-statsd repos. Provide new variables in settings for monasca-statsd. Removed installation of monasca-common or monasca-statsd where it was not needed. Change-Id: I226e42655c834a9a8ac7e58989ac86018d7d4576
2017-01-23 12:11:11 +01:00
MONASCA_STATSD_REPO=${MONASCA_STATSD_REPO:-${GIT_BASE}/openstack/monasca-statsd.git}
MONASCA_STATSD_BRANCH=${MONASCA_STATSD_BRANCH:-master}
MONASCA_STATSD_DIR=${MONASCA_BASE}/monasca-statsd
Use devstack git_clone Following commits changes manual git clone to git_clone from devstack common functions. That allows monasca devstack plugin to use globals ``ERROR_ON_CLONE``, ``OFFLINE`` and ``RECLONE`` as defined by devstack. Also it will be possible to specify branches and repositories for monasca components directly before stacking for the first time Closes-Bug: 1625488 Change-Id: I3d16eca203a3428749de6e478da3dd92327ea7bf
2016-10-11 20:56:28 +00:00
MONASCA_GRAFANA_DATASOURCE_REPO=${MONASCA_GRAFANA_DATASOURCE_REPO:-${GIT_BASE}/openstack/monasca-grafana-datasource.git}
MONASCA_GRAFANA_DATASOURCE_BRANCH=${MONASCA_GRAFANA_DATASOURCE_BRANCH:-master}
MONASCA_GRAFANA_DATASOURCE_DIR=${MONASCA_BASE}/monasca-grafana-datasource
Use monasca/grafana repository in devstack sapcc/grafana repository is not maintained anymore. Change-Id: I389a6b95825d7cfb052aeb7a2b6066377a277a2d
2017-12-08 09:36:08 +01:00
GRAFANA_REPO=${GRAFANA_REPO:-"https://github.com/monasca/grafana.git"}
GRAFANA_BRANCH=${GRAFANA_BRANCH:-"grafana4"}
Use devstack git_clone Following commits changes manual git clone to git_clone from devstack common functions. That allows monasca devstack plugin to use globals ``ERROR_ON_CLONE``, ``OFFLINE`` and ``RECLONE`` as defined by devstack. Also it will be possible to specify branches and repositories for monasca components directly before stacking for the first time Closes-Bug: 1625488 Change-Id: I3d16eca203a3428749de6e478da3dd92327ea7bf
2016-10-11 20:56:28 +00:00
GRAFANA_DIR=${MONASCA_BASE}/grafana
Add grafana init Change-Id: I6c625272396c6b893f297265ae2389207e60b364 Story: 2003623 Task: 25752
2018-08-28 10:43:44 +02:00
GRAFANA_INIT_LOG_LEVEL=DEBUG
GRAFANA_URL=http://localhost:3000
GRAFANA_USERNAME=mini-mon
GRAFANA_PASSWORD=password
DATASOURCE_TYPE=monasca
DATASOURCE_URL=http://localhost/metrics
DATASOURCE_ACCESS_MODE=proxy
DATASOURCE_AUTH=Keystone
DASHBOARDS_DIR=/dashboards.d
Define common function to download files Add function to download file from specific URL that's integrated with OFFLINE flag. It will download file only when it not exists or there is newer version of same file. Useful for local development. Move installing and cleaning Go to separate function. Change-Id: Ia2b5efc0d82366c6ad75e688512df9606cb2f1ed
2016-11-28 11:52:34 +01:00
Adjust monasca-api installation Adjust monasca-api Python installation with changes: - start/stop of monasca-api proces handles through run_process and stop_process and no service files - setting up environment with devstack function - use USE_VENV for monasca-api - installing monasca-api dependencies from git - remove configuration file from devstack/files/monasca-api/python - setup up configuration files with iniset Change-Id: I2faf48d17fb5e958e1d7ad2383c125ade3faaaf0
2017-05-31 12:22:10 +02:00
GITDIR["python-monascaclient"]=${MONASCA_CLIENT_DIR}
GITDIR["monasca-common"]=${MONASCA_COMMON_DIR}
GITDIR["monasca-statsd"]=${MONASCA_STATSD_DIR}
Add policies to monasca-ui Adds copying policies of monasca dashboard into horizon policies directory. Extra: * reworked installation process (now using setup_develop) * installing python-monascaclient using setup_lib and cloning it directly from referenced MONASCA_CLIENT_BRANCH Depends-On: I273f06332fa11a81ea8de2c13059dce9d160e90d Change-Id: I2cf1ae62e8b80aefe14d093a499f7103a5c288a5
2017-06-12 07:56:39 +02:00
Enabling Postgres + ORM in devstack Following commit provides: - possibility of using postgres as database backend - possibility of using ORM mapping in monasca: - API - Thresh - Notification Additionally: - different approach of providing configuration settings - removed unused winchester schema - reworked execution phases of the plugin: -- installing dependencies in the beginning Implements: blueprint postgres-cli-support Change-Id: Iae561b0c7e6b90cc7c9f5b122c0e4b37bc5ef843
2016-10-28 22:10:08 +02:00
# Database settings
MONASCA_DATABASE_USE_ORM=false
Define common function to download files Add function to download file from specific URL that's integrated with OFFLINE flag. It will download file only when it not exists or there is newer version of same file. Useful for local development. Move installing and cleaning Go to separate function. Change-Id: Ia2b5efc0d82366c6ad75e688512df9606cb2f1ed
2016-11-28 11:52:34 +01:00
# Other settings
DOWNLOAD_FILE_TIMEOUT=${DOWNLOAD_FILE_TIMEOUT:-30}
Restore zookeeper to devstack openstack/devstack-dev has removed zookeeper support. For details see [1]. Following commits brings back zookeper as it was previously installed from devstack. Extra: * added concepts of devstack dependencies. That speeds up installation a bit as common packages are installed prior to the plugin code Ref: [1] https://github.com/openstack-dev/devstack/commit/c0d16c279ad2a24bd13e2dbd6ae6986c37c4f230 Change-Id: I0323eacb5cbba8418550e3322189104c35cf4c36
2017-05-26 10:48:14 +02:00
PLUGIN_FILES=$MONASCA_API_DIR/devstack/files
Allow to enforce APACHE_MIRROR In some cases APACHE_MIRROR that is picked points at the server from which it is not possible to download the binaries. Change-Id: I08f1d48cc8bdac7d9d489684e0f6e45c29b95119
2017-06-22 09:55:59 +02:00
# APACHE_MIRROR= # force specific APACHE_MIRROR if the one that got picked fails
Download Kafka from Apache Archives Apache Kafka 0.9.0.1 is not available on mirrors any more. Change-Id: I47e0a9d1718bd5268610b2183397dec22911947a
2017-11-20 18:35:40 +01:00
# Apache Kafka 0.9.0.1 is only available in Apache Archives
APACHE_ARCHIVES=${APACHE_ARCHIVES:-"https://archive.apache.org/dist/"}
Make statsd options configurable Configure statsd host and port from variables. Change-Id: Ic772f2e68951ed12c6ff80d23562dded4fd2dee7
2016-12-02 12:17:39 +01:00
# Public configuration
Migrate keystone setup to devstack helpers Following commit migrates from usage of custom python script to create users, roles, projects, service and endpoint to the usage of builtin devstack's function meant to manage keystone entities. Benefits of doing so is that is the monasca plugin will not depend directly on python-keystoneclient, which API may change and may result in broken gate. Such situation happened before, at least once. Also new code is much more verbose and easier to understand by simply refererring to documentation of aforementioned functions. Change-Id: Ie26021916a0c8a4190b3572743f99de3179671d2
2017-03-02 23:20:43 +01:00
## monasca-statsd
Enabling Postgres + ORM in devstack Following commit provides: - possibility of using postgres as database backend - possibility of using ORM mapping in monasca: - API - Thresh - Notification Additionally: - different approach of providing configuration settings - removed unused winchester schema - reworked execution phases of the plugin: -- installing dependencies in the beginning Implements: blueprint postgres-cli-support Change-Id: Iae561b0c7e6b90cc7c9f5b122c0e4b37bc5ef843
2016-10-28 22:10:08 +02:00
MONASCA_STATSD_PORT=${MONASCA_STATSD_PORT:-8125}
Migrate keystone setup to devstack helpers Following commit migrates from usage of custom python script to create users, roles, projects, service and endpoint to the usage of builtin devstack's function meant to manage keystone entities. Benefits of doing so is that is the monasca plugin will not depend directly on python-keystoneclient, which API may change and may result in broken gate. Such situation happened before, at least once. Also new code is much more verbose and easier to understand by simply refererring to documentation of aforementioned functions. Change-Id: Ie26021916a0c8a4190b3572743f99de3179671d2
2017-03-02 23:20:43 +01:00
## monasca-api
MONASCA_API_SERVICE_HOST=${MONASCA_API_SERVICE_HOST:-${SERVICE_HOST}}
MONASCA_API_SERVICE_PORT=${MONASCA_API_SERVICE_PORT:-8070}
MONASCA_API_ADMIN_PORT=${MONASCA_API_ADMIN_PORT:-8081} # for java
MONASCA_API_SERVICE_PROTOCOL=${MONASCA_API_SERVICE_PROTOCOL:-${SERVICE_PROTOCOL}}
MONASCA_API_SERVICE_TIMEOUT=${MONASCA_API_SERVICE_TIMEOUT:-${SERVICE_TIMEOUT}}
Adjust monasca-api installation Adjust monasca-api Python installation with changes: - start/stop of monasca-api proces handles through run_process and stop_process and no service files - setting up environment with devstack function - use USE_VENV for monasca-api - installing monasca-api dependencies from git - remove configuration file from devstack/files/monasca-api/python - setup up configuration files with iniset Change-Id: I2faf48d17fb5e958e1d7ad2383c125ade3faaaf0
2017-05-31 12:22:10 +02:00
MONASCA_API_CONF_DIR=${MONASCA_API_CONF_DIR:-/etc/monasca}
Replace api-config.conf with monasca-api.conf api-config.conf is the deprecated path for the configuration file. The new path is /etc/monasca/monasca-api.conf . Story: 2004708 Task: 28987 Change-Id: If06d9114529c3ef4520247dfc7c32d3769f07084
2019-01-07 12:20:55 +01:00
MONASCA_API_CONF=${MONASCA_API_CONF:-$MONASCA_API_CONF_DIR/monasca-api.conf}
Adjust monasca-api installation Adjust monasca-api Python installation with changes: - start/stop of monasca-api proces handles through run_process and stop_process and no service files - setting up environment with devstack function - use USE_VENV for monasca-api - installing monasca-api dependencies from git - remove configuration file from devstack/files/monasca-api/python - setup up configuration files with iniset Change-Id: I2faf48d17fb5e958e1d7ad2383c125ade3faaaf0
2017-05-31 12:22:10 +02:00
MONASCA_API_PASTE_INI=${MONASCA_API_PASTE_INI:-$MONASCA_API_CONF_DIR/api-config.ini}
MONASCA_API_LOGGING_CONF=${MONASCA_API_LOGGING_CONF:-$MONASCA_API_CONF_DIR/api-logging.conf}
Raise influxdb version to 1.2.4 The influxdb 1.2.x branch provides a significant performance improvement (over factor 2) for writes, so it's good to use the latest and greatest. Change-Id: Ia0d9220dd53890d3b42ebcf4bc9f349bc43ba83d
2017-07-06 13:42:36 +02:00
MONASCA_API_LOG_DIR=${MONASCA_API_LOG_DIR:-/var/log/monasca/api}
Enable uWSGI support in devstack Story: 2001464 Task: 6181 Change-Id: If4329e51feebeb68538917d7a68aad53ae469b07
2018-04-12 14:45:49 +02:00
MONASCA_API_USE_MOD_WSGI=${MONASCA_API_USE_MOD_WSGI:-$ENABLE_HTTPD_MOD_WSGI_SERVICES}
MONASCA_API_UWSGI_CONF=${MONASCA_API_UWSGI_CONF:-$MONASCA_API_CONF_DIR/api-uwsgi.ini}
Update devstack plugin to support new api Merge log-api and api Story: 2003881 Task: 36195 Depends-On: https://review.opendev.org/681419/ Change-Id: Idb2361e5ab701cd3dee4eabb4b43116f6e1205c4
2019-07-23 13:06:58 +02:00
# OLD LOG-API CONFIGURATION
MONASCA_LOG_API_SERVICE_HOST=${MONASCA_LOG_API_SERVICE_HOST:-${SERVICE_HOST}}
MONASCA_LOG_API_SERVICE_PORT=${MONASCA_LOG_API_SERVICE_PORT:-5607}
MONASCA_LOG_API_REPO=${MONASCA_LOG_API_REPO:-${GIT_BASE}/openstack/monasca-log-api.git}
MONASCA_LOG_API_BRANCH=${MONASCA_LOG_API_BRANCH:-master}
MONASCA_LOG_API_DIR=${DEST}/monasca-log-api
MONASCA_LOG_API_DEPLOY=uwsgi
MONASCA_LOG_API_CONF_DIR=${MONASCA_LOG_API_CONF_DIR:-/etc/monasca}
MONASCA_LOG_API_LOG_DIR=${MONASCA_LOG_API_LOG_DIR:-/var/log/monasca}
MONASCA_LOG_API_CACHE_DIR=${MONASCA_LOG_API_CACHE_DIR:-/var/cache/monasca-log-api}
MONASCA_LOG_API_WSGI_DIR=${MONASCA_LOG_API_WSGI_DIR:-/var/www/monasca-log-api}
MONASCA_LOG_API_CONF=${MONASCA_LOG_API_CONF:-$MONASCA_LOG_API_CONF_DIR/monasca-log-api.conf}
MONASCA_LOG_API_PASTE=${MONASCA_LOG_API_PASTE:-$MONASCA_LOG_API_CONF_DIR/log-api-paste.ini}
MONASCA_LOG_API_LOGGING_CONF=${MONASCA_LOG_API_LOGGING_CONF:-$MONASCA_LOG_API_CONF_DIR/log-api-logging.conf}
MONASCA_LOG_API_UWSGI_CONF=${MONASCA_LOG_API_UWSGI_CONF:-$MONASCA_LOG_API_CONF_DIR/log-api-uwsgi.ini}
USE_PYTHON3=${USE_PYTHON3:-true}
USE_OLD_LOG_API=${USE_OLD_LOG_API:-false}
Enable ui & logviewer locally Commit enables storm-{logviewer,ui} for the purposes of the local development but keeps them disabled in the gate runs. Depends-On: Iccc30d411a49b9e47d6625909427f071397aedfd Change-Id: I8cc2d6c616eff9ab058b24f837c655228b84f184
2017-09-26 13:25:29 +02:00
## storm settings
STORM_UI_HOST=${STORM_UI_HOST:-${SERVICE_HOST}}
STORM_UI_PORT=${STORM_UI_PORT:-8089}
STORM_LOGVIEWER_PORT=${STORM_LOGVIEWER_PORT:-8090}
Update devstack plugin to support new api Merge log-api and api Story: 2003881 Task: 36195 Depends-On: https://review.opendev.org/681419/ Change-Id: Idb2361e5ab701cd3dee4eabb4b43116f6e1205c4
2019-07-23 13:06:58 +02:00
KAFKA_SERVICE_HOST=${KAFKA_SERVICE_HOST:-${SERVICE_HOST}}
KAFKA_SERVICE_PORT=${KAFKA_SERVICE_PORT:-9092}
Copy Permalink