Monasca Database Persister
You can not select more than 25 topics Topics must start with a letter or number, can include dashes ('-') and can be up to 35 characters long.
Zuul d23898d407 Merge "Disable monasca-tempest-java-influxdb job" 1 day ago
common Replace URLs with URLs 1 month ago
config-generator Update documentation to use new default config 4 months ago
docker Merge "Support cache_size option in docker env" 1 week ago
etc/monasca Turn logging down from DEBUG in persister-logging.conf 9 months ago
java Disable ClassPathURLCheck for Java build 8 months ago
monasca_persister Merge "Add tests for cassandra/" 4 days ago
perf Fix the misspelling of "available" 5 months ago
playbooks Push Docker image to Docker Hub 3 months ago
releasenotes Adds release note warning of InfluxDB recommended version change 2 weeks ago
.coveragerc Add coverage report display 3 months ago
.gitignore Add job for releasenotes 4 months ago
.gitreview OpenDev Migration Patch 2 months ago
.stestr.conf Add .stestr.conf . 1 year ago
.testr.conf Add unit tests 2 years ago
.zuul.yaml Merge "Disable monasca-tempest-java-influxdb job" 1 day ago
LICENSE Added copyright header and LICENSE file. 5 years ago
README.rst README.rst: make it us-ascii 3 months ago
bindep.txt Add bindep.txt 2 years ago
lower-constraints.txt Change lower-constraints for cassandra-driver 1 week ago
pom.xml Upper pom version to 1.3.0 1 year ago
requirements.txt Updated from global requirements 1 year ago Ensure the same branch is used for common build 3 years ago
setup.cfg Merge "Change lower-constraints for cassandra-driver" 4 days ago Updated from global requirements 2 years ago
test-requirements.txt Change lower-constraints for cassandra-driver 1 week ago
tox.ini Add Python 3 Train unit tests 1 week ago


Team and repository tags



The Monitoring Persister consumes metrics and alarm state transitions from the Message Queue and stores them in the Metrics and Alarms database.

Although the Persister isn't primarily a Web service it uses DropWizard,, which provides a nice Web application framework to expose an http endpoint that provides an interface through which metrics about the Persister can be queried as well as health status.

The basic design of the Persister is to have one Kafka consumer publish to a Disruptor,, that has output processors. The output processors use prepared batch statements to write to the Metrics and Alarms database.

The number of output processors/threads in the Persister can be specified to scale to more messages. To horizontally scale and provide fault-tolerance any number of Persisters can be started as consumers from the Message Queue.


Requires monasca-common from Download and build following instructions in its Then build monasca-persister by:

mvn clean package


A sample configuration file is available in java/src/deb/etc/persister-config.yml-sample.

A second configuration file is provided in java/src/main/resources/persister-config.yml for use with the vagrant "mini-mon" development environment.


  • Purge metrics on shutdown
  • Add more robust offset management in Kafka. Currently, the offset is advanced as each message is read. If the Persister stops after the metric has been read and prior to it being committed to the Metrics and Alarms database, the metric will be lost.
  • Add better handling of SQL exceptions.
  • Complete health check.
  • Specify and document the names of the metrics that are available for monitoring of the Persister.
  • Document the yaml configuration parameters.


Copyright (c) 2014 Hewlett-Packard Development Company, L.P.

Licensed under the Apache License, Version 2.0 (the "License"); you may not use this file except in compliance with the License. You may obtain a copy of the License at

Unless required by applicable law or agreed to in writing, software distributed under the License is distributed on an "AS IS" BASIS, WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied. See the License for the specific language governing permissions and limitations under the License.


To install the Python monasca-persister modules, git clone the source and run the following command:

$ sudo python install

To run the unit tests use:

$ tox -e py27,py35