749 Commits

Author SHA1 Message Date
Zuul
7c839c82b2 Merge "Gate: Move to K8s 1.10.8" 2018-10-06 06:30:08 +00:00
Zuul
8d9c892c69 Merge "fix tox python3 overrides" 2018-10-06 05:16:18 +00:00
Zuul
77393ab143 Merge "Libvirt: Fix image" 2018-10-06 00:58:41 +00:00
Pete Birley
f8880d27ad Libvirt: Fix image
This PS fixes the libvirt image, buy removing the ubuntu-cloud
archive repo and pinning to a good version.

Change-Id: I5097d8893b92d020f7a5a1cb5925dec0b01d4da2
Signed-off-by: Pete Birley <pete@port.direct>
2018-10-05 15:41:12 -05:00
Zuul
b4c49db89e Merge "Disable Ceph RADOS Gateway dynamic bucket resharding. Problem was discovered regarding issues being caused by RGW dynamic bucket resharding. It is at this time recommended to disable this feature." 2018-10-05 20:32:58 +00:00
Jean-Charles Lopez
05391252f8 Disable Ceph RADOS Gateway dynamic bucket resharding.
Problem was discovered regarding issues being caused by RGW dynamic
bucket resharding. It is at this time recommended to disable this feature.

Change-Id: Id524415f4ed08ee5374f7fd3b53f6e36c3ab084e
2018-10-05 16:20:10 +00:00
Doug Hellmann
e3641940dc fix tox python3 overrides
We want to default to running all tox environments under python 3, so
set the basepython value in each environment.

We do not want to specify a minor version number, because we do not
want to have to update the file every time we upgrade python.

We do not want to set the override once in testenv, because that
breaks the more specific versions used in default environments like
py35 and py36.

Change-Id: I2ced79bfdfb8dd17f966fdf985e06b2f835cfa13
Signed-off-by: Doug Hellmann <doug@doughellmann.com>
2018-10-05 16:19:35 +00:00
Gupta, Sangeet (sg774j)
a34a7d8e50 Adding Falco
This commit adds falco daemonset of the node for behavioral activity
monitor designed to detect anomalous activity.

Change-Id: I783a2acc03592471c81a8a54e1dc0df140b34a42
2018-10-05 16:18:51 +00:00
Pete Birley
19376ee9e6 Gate: Move to K8s 1.10.8
This PS moves to use k8s 1.10.8, which includes a couple of fixes
for PVC mounts.

* https://github.com/kubernetes/kubernetes/pull/66863

Change-Id: Ica30950a8200f5755897b51fd2b4d24c69a10e61
Signed-off-by: Pete Birley <pete@port.direct>
2018-10-05 07:44:42 -05:00
Chris Wedgwood
26e1b9cde6 [Calico] Update to Calico v3.2
Change-Id: I2214fea8d8c1563b08c4015c9e91a29cf071af5a
2018-10-05 01:49:42 +00:00
Pete Birley
46935734af Gate: remove unused pull images role and playbook
This PS removes the unused pull images role and playbook.

Change-Id: Ic26035c3f58efb6269fd58e570601cccfdd84949
Signed-off-by: Pete Birley <pete@port.direct>
2018-10-05 01:43:40 +00:00
Pete Birley
feeeed4d5d Gate: Remove unused helm chart deployment role and playbook
This PS removes the unused helm chart deployment role and playbook.

Change-Id: I01c58a628589ec35af2557c8cc93ea47fe084089
Signed-off-by: Pete Birley <pete@port.direct>
2018-10-05 01:43:33 +00:00
Pete Birley
16a6f7af8f Gate: Tolerate failures in log collection tasks
This PS updates the gate tasks to tollerate failures in the post
run log collection tasks.

Change-Id: I8b982112955f4112e8107a7eae35680aa68c87ab
Signed-off-by: Pete Birley <pete@port.direct>
2018-10-05 01:42:56 +00:00
Zuul
98f310eee4 Merge "Gate: Update multinode jobs to five nodes" 2018-10-04 16:00:32 +00:00
Steve Wilkerson
18346cad8a Gate: Update multinode jobs to five nodes
This updates the multinode jobs to the five node jobs to attempt
to address resource issues encountered in the multinode jobs

Change-Id: If96a33099997aae2c7914a98332380ea32f2a3fe
2018-10-03 14:35:07 -05:00
Pete Birley
25985f7b43 Libvirt: escape kube cgroups and pid reaper
This PS moves to run the Libvirt process as a transient unit
on the host, free fom k8s controlled cgroups. In addition it
also uses the cloud archive provided libvirt/qemu packages.

Change-Id: Idfe9ae6f072acd86f877df0c3dfe3db4c20902d6
Signed-off-by: Pete Birley <pete@port.direct>
2018-10-03 19:11:00 +00:00
Pete Birley
500698398d Gate: move centos to experimental untill we have optimised gates
This PS moves the centos job to experimental untill we have
done some optimisation on the gates

Change-Id: I3bfa8be9ac86025199060ec1ad9e7485bff30901
Signed-off-by: Pete Birley <pete@port.direct>
2018-10-03 12:33:35 -05:00
Chris Wedgwood
45275ffefd [Calico] Realign Calico v2 chart for upcoming v3.2 upgrade
This PS realigns Calico v2 with the pending Calico v3.2 chart in order
to minimize differences.  It's mostly refactoring with a few small fixes.

Change-Id: Ie5157b4ae324b6eb4c8ccb5cc07d8b9bc5a83ebd
2018-10-03 03:38:25 +00:00
Zuul
681dee71b7 Merge "Fluentbit: Add kernel, kubelet, and dockerd logs" 2018-10-02 17:17:18 +00:00
Zuul
7d228ef280 Merge "Mariadb: fix error logs - Invalid table or database name lost+found" 2018-10-02 04:16:06 +00:00
Zuul
b800169a17 Merge "MariaDB: init server accounts before serving externally" 2018-10-01 17:55:16 +00:00
Jawon Choo
35e633959c Mariadb: fix error logs - Invalid table or database name lost+found
This PS fixes the error logs in mariadb-server.
Each partition has its own lost+found directory and mysql consider
the directory as a database.

Change-Id: Ibce0dddb5065fd56fa841ebcb91c7c9f15de6c62
Closes-Bug: #1795381
2018-10-01 21:34:44 +09:00
Steve Wilkerson
fa09705867 Fluentbit: Add kernel, kubelet, and dockerd logs
This adds inputs for kernel logs on the host, as well as dockerd
and kubelet logs via the systemd plugin. This also adds a filter
for adding the hostname to the kernel log events, for renaming the
fields for systemd logs as kibana can not visualize fields that
begin with an underscore, and adds elasticsearch indexes for both
kernel and systemd logs

Change-Id: I026470dd45a971047f1e5bd1cd49bd0889589d12
2018-10-01 11:56:58 +00:00
Steve Wilkerson
4c532bb8f3 Prometheus: Remove Kubernetes recording rules
This removes the recording rules for Kubernetes, as these rules
add signficant overhead to the total evaluation time for rules.
Any recording rules should be handled as operator overrides and
not set by default, in order to prevent undesired overhead time
for rules that aren't currently used by the charts

Change-Id: I183d32e62619b71b5020cd3733e4707d7c9ad11b
2018-10-01 11:56:34 +00:00
Chris Wedgwood
4e1d7b67f9 [MariaDB] Allow for stable upgrades
Using a random bootstrap filename means any upgrade (even without
changes) causes MariaDB to churn and restart.

Change-Id: Ieaf577e413f8d672d24bf42c90b6110b52e542f0
2018-09-29 17:07:04 +00:00
Zuul
1371be6689 Merge "Helm: Update helm to 2.11.0" 2018-09-27 15:35:52 +00:00
Steve Wilkerson
ff116a26fd Kibana: Add session affinity to ingress
This adds session affinity to Kibana's ingress. This allows for
the use of cookies for Kibana's session affinity

Change-Id: I0863493ba7051a08350971da9c6e4d59cc2d8fa5
2018-09-25 15:38:25 -05:00
sai battina
e155c92f14 Helm: Update helm to 2.11.0
This helps to fix a bug when adding stable repos

Change-Id: I3eb28a037f7eb22016a29bc36e4a791a5bfda852
2018-09-25 18:14:49 +00:00
Tin Lam
515b6697d3 Add apparmor annotation function
This patch set adds helm toolkit functions to annotate apparmor profile
in the container's metadata section.

Change-Id: Ib0ca04e8b8527194778afb8053046797abdfdb98
Signed-off-by: Tin Lam <tin@irrational.io>
2018-09-24 03:20:50 +00:00
Zuul
bc1afb87d7 Merge "Helm-Toolkit: Add snippet for kubernetes tolerations" 2018-09-23 01:13:57 +00:00
Zuul
f93a71d82b Merge "Ceph: Add configmap hash as annotation" 2018-09-22 23:29:28 +00:00
Pete Birley
6b2d66354d MariaDB: init server accounts before serving externally
This PS updates the server init process to init desired accounts
before serving external requests.

Change-Id: Ida9e3b93ed332a621e0c2fcb39a9870886c9ffe7
Signed-off-by: Pete Birley <pete@port.direct>
2018-09-22 17:23:45 +00:00
Zuul
551be3f0dc Merge "Helm-Toolkit: Document kubernetes entrypoint macros" 2018-09-22 15:38:40 +00:00
Chinasubbareddy M
2f2cb7d567 Ceph: Add configmap hash as annotation
adding configmap  hash to following ds/deployments to trigger
rolling updates if there are any update for configmap

- ceph-mon
- ceph-mds
- ceph-mgr
- ceph-rgw

Change-Id: I4173cb12c18640c9b1a0e5a698d48f4735e250fb
2018-09-22 07:26:52 +00:00
Zuul
4cd00f3ac5 Merge "Monitor postgresql, Openstack virt resources, api, logs, pod and nodes status" 2018-09-21 12:12:00 +00:00
Zuul
87460594dd Merge "Helm-Toolkit: correct macro template filenames" 2018-09-21 11:20:15 +00:00
Pete Birley
b16b2707d8 Helm-Toolkit: Document kubernetes entrypoint macros
This PS adds documentation for the kubernetes entrypoint macros.

Change-Id: I1bec4d7a58878742462de624ebe0b77579759c09
Signed-off-by: Pete Birley <pete@port.direct>
2018-09-21 08:23:22 +00:00
rakesh-patnaik
db0d653b4d Monitor postgresql, Openstack virt resources, api, logs, pod and nodes status
Fixing opebstack API monitors

Adding additional neutron services monitors
Adding new Pod CrashLoopBaackOff status check
Adding new Host readiness check

Updated the nagios image reference(https://review.gerrithub.io/c/att-comdev/nagios/+/420590 - Pending)

This updated image provides a mechanism for querying Elasticsearch
with the goal of triggering alerts based on specified applications
and log levels.

Finally, this moves the endpoints resulting from the authenticated
endpoint lookups required for Nagios to the nagios secret instead
of handled via plain text environment variables

Change-Id: I517d8e6e6e8fa1d359382be8a131a8e45bf243e2
2018-09-21 08:22:13 +00:00
Zuul
f2271a60a6 Merge "Fluent-logging: Update fluentd configuration" 2018-09-20 23:39:25 +00:00
Zuul
d8b3ef5009 Merge "Update k8s-keystone-webhook image" 2018-09-20 23:39:24 +00:00
Zuul
ebc9b175f3 Merge "Elasticsearch S3 repo" 2018-09-20 23:39:23 +00:00
Zuul
9b6a13b577 Merge "HTK: Add s3 user/bucket scripts, snippets, manifests" 2018-09-20 23:17:55 +00:00
Zuul
c10f9ce59e Merge "Modify Ceph default settings for improved performance" 2018-09-20 22:44:11 +00:00
Zuul
4f4e9c5838 Merge "ceph-rgw: stop storage init job on each run" 2018-09-20 16:39:04 +00:00
Tin Lam
93f85d8745 Update k8s-keystone-webhook image
This patch set updates the default docker image to use the official
k8scloudprovider image for the kubernetes-keystone-webhook.

Change-Id: Ib9cc3efaf63569e20d07fa9b3ad9f45b49ab7cc9
Signed-off-by: Tin Lam <tin@irrational.io>
2018-09-20 06:42:00 +00:00
Steve Wilkerson
a084769410 Elasticsearch S3 repo
This ps adds the ability to use the ceph radosgw s3 api for
snapshot repositories. It removes the ability to use a RWM pvc, as
the radosgw solution provides a more robust approach for storing
index snapshots

Change-Id: Ie56ac41ccdc61bfadcac52b400cceb35403e9fae
2018-09-19 15:53:21 -05:00
Steve Wilkerson
a3f444299e HTK: Add s3 user/bucket scripts, snippets, manifests
This proposes adding the following:

Snippets for the environment variables for the s3 admin user and
service users for using rgw's s3 api

Scripts for creating s3 users for use by a particular service and
for creating and linking buckets to those users

Manifest templates for the jobs for creating the s3 users and for
creating and linking the buckets to those users

Change-Id: Ibd5ed0aac49d172c56faffdacd44bdd487978570
2018-09-19 15:52:36 -05:00
Zuul
00b4b9021d Merge "Fix python-pip install for centOS system" 2018-09-19 19:48:40 +00:00
Chinasubbareddy M
d5fecffdc1 ceph-rgw: stop storage init job on each run
this is to stop executing storage init job if we have ceph
deployment false under values

Change-Id: Iee3f7cf4c98a2c68c27b42011ffe6f07b278c2c4
2018-09-19 14:41:02 -05:00
Steve Wilkerson
ba736d9840 Fluent-logging: Update fluentd configuration
This updates the configuration for fluentd, providing a mechanism
for basic determination of the log level of a logged event via
entries from /var/log/containers. This log level is prepended to
the tag for that event, and also added as a new `level` key in
the resulting event. These two improvements allow for querying
specific log level events via the tag.

This also adds similar functionality to any events captured via
the oslo log fluentd handler/formatter. This allows for
elasticsearch queries akin to `error.openstack.keystone`, which
can be used by nagios or another alerting mechanism to raise
alerts when a particular level event has been captured.

Change-Id: I016ddcfcf7408de7b6511ddf7009e1e6a5f3a1d9
2018-09-19 14:22:27 -05:00