We had multiple fields that would reference either an empty strig or
empty dict, which would cause indexing errors on Elastic. This commit is
to create a standard of empty dict for args.
Closes bug 1678107
Change-Id: Id5b2ad924bac4f1b4aee74e9d6f407f9d5e2ca10
This commit enanbles Ansible linting and does some
minor refactoring to make existing Ansible roles
compatible with the new rules.
Several Ansible linting rules have been excluded to keep the number
of changes from being too onerous.
Also a new script in ci-scripts is used to check very config file
included in the Browbeat repo for validity using the template
Browbeat uses when it runs.
Here's a list of the new linting rules
* Ansible tasks must have names
* When you use shell you must use become not sudo
* Using become_user without using become is not allowed
* If a repo is pulled it must be a pinned version of commit, not latest
* Always_run is deprecated don't use it
* Variables without {{}} and not in when statements are deprecated don't use them
* No Trailing whitepaces
* YAML checking, catches big syntax errors but not less obvious ones
Change-Id: Ic531c91c408996d4e7d8899afe8b21d364998680
Making the mask small enough to let user create a large number
of subnets_per_network. Also this value by default causes IpAddress
generation failures in neutron-server logs.
Change-Id: I7ee9ecf928abd5608b22e568433dc78d61b1fdfd
+ Monitor the Ceph Mon socket on Controller-0
+ Monitor 1st Ceph OSD socket on each CephStorage Node
+ Graphs for Ceph Mon are included on the General Dashboard
+ Ceph Dashboard covers Ceph Processes + Ceph Mon Metrics
+ Small adjustments and improvements to dashboards
+ Stepped lines for queues
+ Try to use 200px for information denisty
* OSD metrics are collected but not graphed yet *
Change-Id: I97d65b98b5204e924eb5167adfba53c2c754214c
So this reshuffles the metadata to make an master-upstream and
master-downstream so that we don't get them confused with the respective
latest versions or each other. Also updated for the next couple of releases
in the name of not having to make more pointless commits.
Change-Id: I7cbd78b5c5441aadbda0b17c8db2b3312ad93df7
putting net names in the net_id field doesn't really work.
Since it's a runtime error it doesn't actually fail Rally
like a normal config error, hence it went unoticed.
Easy enough to grab the correct id while templating and insert
it.
Change-Id: I94720e90e0d9cfe00c4b1e495a1fd24739cd7632
Uses a connection to the database to count the number of keystone
tokens. Can count tokens on Undercloud and Overcloud. For Overcloud
you must provide a repo that provides "libdbi-dbd-mysql".
+ Collectd from EPEL to address when/if your OpenStack includes
collectd installed already
Change-Id: I4da4c3b02cff661572de3852a33d26875cfcdc0d
The undercloud.conf has some tunables that are important to know
so I figured I would add it to the metadata collection
Change-Id: I1d31b5a30c265807e9f37a78caa24e569687ef5b
+ Monitors both Undercloud and Overcloud rabbitmq queues
+ Monitors Object Counts (Connections, Channels, Consumers, Queues, Exchanges)
+ Monitors Cluster Queue/Message counts and rates
+ General Dashboards display Rabbitmq and Gnocchi in Order
+ Renamed httpd_groups to apache_groups for consistency
+ Included Cloud Rabbitmq Monitoring Dashboard
+ Improved collectd Gnocchi monitoring for Newton
Change-Id: Ie49ca3dcb237c8cae348fcf59129fc35a5a41a9f
The internal pipeline image mirror has a slightly different
folder structure that doesn't include the /current-tripleo/ folder
anyways this was causing Ocata pipeline builds to fail.
Change-Id: I688218dda2c32222df3752bceb771427c2ba9425
As the latest version is moved from Master to Ocata some folder structure
changes are required to make sure we get the right image. Eventually master
will point to 12 instead of 11.
Change-Id: Ie83cf1add5418c77054b67610c4f35318420b93e
See here for more details
https://review.openstack.org/#/c/437946/
The reason the old pin isn't working is that --bootstrap in quickstart
doesn't work like it should and force the reinstallation of the virtualenv
so we carry over the prep internal script that now uses extras itself.
Change-Id: I5479738565017941df71313f10816f2c9a4debea
Currently the host generation script depends on having a cloud. This
patch-set removes that dependency.
Fixes bug 1665017
Change-Id: Ifa980538254219210588b4e75e9855dc83528abe
This adds a very simple check for failed tests before Browbeat's exit
if failed tests are found Browbeat will exit with a return code of one.
This will provide Browbeat CI failure when tests fail without interuppting
ongoing tests if a single one fails.
Change-Id: I5382f684fe03d85692a275dc5c03a136004f34d9
The CI vars file is on the jenkins slave, not on the virthost where we
where trying to copy the data from. The code that was checked in has never
worked, what happened is that with a previous iteration of the commit we
created /tmp/install_vars.yml and since the jenkins machine never gets rebooted
it just stayed there. So in the future when we tried to fetch the file from the
wrong machine Ansible failed the fetch silently and we loaded the old file.
Change-Id: I8c20bdc8dc138a383e7a101cd465b48d44fa99a7
We shouldnt' be returning true after processing rally results as there still
be shaker, perfkit after that. Also the stub is for elasticsearch integration isnt
needed since we don't yet parse cli arguments for es.
Change-Id: I7fd81feeb7b094a7db8f67cf7036929ac1e68283
This work is to take an results directory and find all the
rally/Shaker/Perfkit JSONs and create the Elasticsearch JSONs that can be
pushed to Elasticsearch.
This is also a minor refactor of the Rally lib to refactor how we push
results into elasticsearch. This creates a generic function so we can
have file and/or taskid based metrics created
+ (sai) Fix way how we crawl for files
+ (sai) Exclude already postprocessed files
+ (sai) Fix filenaming of dumped postprocessed files
+ {sai) flake8
Co-Authored-By: Sai Sindhur Malleni <smalleni@redhat.com>
Change-Id: I5ca8877f26e889856c9773b51ba38f24562a80af
In 641858783778ee14b627a55df48f81ad40c94555 we removed the extra vars from
several roles. Well it's actually important in just one, and only sometimes.
Anyways if and only if the dns server gets set incorrectly on nodes (happens
when the lab is having trouble) collectd adds a DNS server, 8.8.8.8 by default
which means we go from "it might work eventually" to "guaranteed to never work"
once CollectD runs without the dns_server var changed from default.
This went unnoticed because days can pass between issues like this. Anyways
alls the builds are failing now on it, so need to readd it at least here.
Change-Id: I5a32562e19415d29764c9b22aec95fa3dc95ad85
+ Adjust boot and persist instances from 200 to 1000 instances
+ Boot and persist instances attached to a network (1000 instances)
+ Neutron context plugin to persist network over entire browbeat run
+ Added docs for the plugins
Change-Id: I58802218f1e2201063cf9ec3f82efa71b28ac1a0
This adds logic to the set_scenario() and send_to_elastic() methods to be
generic enough to support miscalleneous shaker scenarios like metadata
agent performance testing.
+ Few minor changes
Change-Id: Ib9499d23b44160fc0796827f53e9926fca5e7e88
This commit sets the variables for network creation to the
appropriate values. Since the network details are internal, this CI
variables file is being moved to internal git.
Change-Id: Ib55d2896991c74562f01e3cc56117af7110dc403
