2592 Commits

Author SHA1 Message Date
Gupta, Sangeet (sg774j)
a3ebaf5b01 [mariadb] Modified start.py script
Added check to see if the file is empty before trying to read it.

Change-Id: I3e1266e8c0bb7e79d90db0485e4beacf3ad77f95
2020-07-21 16:52:11 +00:00
Andrii Ostapenko
6fa7dae7af
Add proper osh_params to jobs deploying openstack charts
Change-Id: I44fdc1ef730c697adc8f97499b4208a99f09013e
Signed-off-by: Andrii Ostapenko <andrii.ostapenko@att.com>
2020-07-21 11:50:33 -05:00
Stephen Taylor
aaf52acc27 [ceph-client] Add back a new version of reweight_osds()
https://review.opendev.org/733193 removed the reweight_osds()
function from the ceph-client and weighted OSDs as they are added
in the ceph-osd chart instead. Since then some situations have
come up where OSDs were already deployed with incorrect weights
and this function is needed in order to weight them properly later
on. This new version calculates an expected weight for each OSD,
compares it to the OSD's actual weight, and makes an adjustment if
necessary.

Change-Id: I58bc16fc03b9234a08847d29aa14067bec05f1f1
2020-07-20 19:42:52 +00:00
diwakar thyagaraj
5d50433362 Enable Application Armor to all ceph key-generator pods.
1) Changed the pod name and container name to pick name dynamically for
   osd,mon,mgr and mds.

2) Added Init container for ceph-provisioners.

Change-Id: I3e27d51c055010cff982ddb0951d01ea8adac234
Signed-off-by: diwakar thyagaraj <diwakar.chitoor.thyagaraj@att.com>
2020-07-20 01:29:42 +00:00
Zuul
6df4dfe727 Merge "Add ensure-pip role to functional jobs" 2020-07-18 23:57:04 +00:00
Zuul
4e438b88e8 Merge "[ceph] make sure hostname present in k8s" 2020-07-17 20:08:11 +00:00
Huang, Sophie (sh879n)
898f6b94ed Add namespace to database backup error logs
Namespace is added to error logs generated by database backup
main script for etcd, mariadb and postgresql database backups

Change-Id: I63d00549327c27ec0590c1a9d05966015f480c92
2020-07-17 12:11:14 +00:00
Zuul
a689846b10 Merge "[ceph-osd] Add get_lv_from_device helper function" 2020-07-17 10:03:10 +00:00
Zuul
89cdcf7771 Merge "Remove the Elasticsearch Wait job from the chart" 2020-07-17 09:59:12 +00:00
Zuul
1ae18f2a86 Merge "Add missing security-context for elasticsearch-data and elasticsearch-master" 2020-07-16 23:37:34 +00:00
Stephen Taylor
858a2b166f [ceph-osd] Add get_lv_from_device helper function
There was already a call to a nonexistent get_lv_from_device helper
function in get_lv_size_from_device. The get_lv_from_device function has
been added and the line in get_lvm_tag_from_device that gets the logical
volume has been updated to use the new helper function.

Change-Id: Ib34d7b1385e039d8c7bf82dcdb756bce2cc12bd2
2020-07-16 21:10:32 +00:00
KHIYANI, RAHUL (rk0850)
9cfb1f8509 Add missing security-context for elasticsearch-data and elasticsearch-master
This also implements security-context template to add readOnly-fs flag

Change-Id: Iaeea66dad34a2616c0620eafacc53574ed79a7b5
2020-07-16 19:54:43 +00:00
Chinasubbareddy Mallavarapu
24072c188b [ceph] make sure hostname present in k8s
This is to validate hosntame matches with node name registered with
k8 before checking for "rack" label on the node.

Change-Id: Ie78ffd16d8d732bd10b362726a57181bb5cb56cc
2020-07-16 11:38:31 -05:00
Andrii Ostapenko
e8caaac6b4
Add ensure-pip role to functional jobs
Change-Id: Idcead2d24fd30d950130a6f1f121beac039e656f
Signed-off-by: Andrii Ostapenko <andrii.ostapenko@att.com>
2020-07-16 10:52:40 -05:00
Steven Fitzpatrick
3257ed1db8 Remove the Elasticsearch Wait job from the chart
The elastic-cluster-wait job was meant to serve as a dependency check
for a couple of other jobs, such that when this wait job was complete
the other jobs could procede successfully. This goal can be achieved
by using our HTK init container's dependency check however.

The two jobs that waited on this wait job just need to use the
elasticsearch API, which is available once the `elasticsearch-logging`
service has endpoints.

Change-Id: I87e1c1fe3d61680a73701d48f85e5c48c11b6325
2020-07-16 10:16:23 -05:00
Zuul
f00916a0a9 Merge "Support images overrides" 2020-07-16 10:43:35 +00:00
Zuul
607b4d9bc4 Merge "Inherit playbook from common osh-infra parent for fuctional jobs" 2020-07-16 10:41:30 +00:00
Zuul
5c65dc7681 Merge "Explicitly specify a script directory for jobs run" 2020-07-16 10:41:28 +00:00
Zuul
570b7bfba0 Merge "[Ceph-client, ceph-osd] Update helm test" 2020-07-15 19:59:09 +00:00
Zuul
6409bb6879 Merge "feat(tls): add tls to mariadb chart" 2020-07-14 22:42:34 +00:00
Zuul
1cb419b342 Merge "Add missing security-context for ceph-rgw test pod" 2020-07-14 20:27:03 +00:00
sgupta
6e13d74c87 feat(tls): add tls to mariadb chart
This patch set makes changes for maraidb certs to be used
by all users when connecting to MariaDB.

Change-Id: Id38c9fb0b18dd8ba164a69f179d940192efc3247
2020-07-14 19:32:57 +00:00
Zuul
b51c473175 Merge "Add user account to be used for federated metric collection." 2020-07-14 19:06:26 +00:00
KHIYANI, RAHUL (rk0850)
774d85b77e Add missing security-context for ceph-rgw test pod
This updates the ceph-rgw chart to include the pod
security context on the pod template.

This also adds the container security context to set
readOnlyRootFilesystem flag to true

Change-Id: Ib6be059e387f1932a5655df07ae182f75f142538
2020-07-14 17:26:01 +00:00
Smith, David (ds3330)
a4fc3f7d78 Add user account to be used for federated metric collection.
Add federated user account for with consolidated metrics

Change-Id: I8a5e9aca0a0b29b672c8427b6491ff92797c5146
2020-07-14 13:33:35 +00:00
Zuul
b1fc699808 Merge "Elasticsearch: Improve logging in cluster wait" 2020-07-13 23:57:09 +00:00
Zuul
96d76dd983 Merge "feat(tls): add tls to mariadb chart" 2020-07-13 23:53:24 +00:00
Steven Fitzpatrick
083c9498c6 Elasticsearch: Improve logging in cluster wait
The cluster wait function can sometimes receive an invalid response,
and this would "pass" the status check condition. This change
prints the response to make it more clear what occured, and changes
the condition to explicitly wait for a "yellow" or "green" status.

Change-Id: Ifd1267a5fa19acbc6bc8bba65b1ba41409a584a3
2020-07-13 16:28:14 -05:00
Gage Hugo
c86526cfbc feat(tls): add tls to mariadb chart
This patch set provides capability to enable TLS termination for the
MariaDB chart. This will be used by the follow on patches in OSH
services patches.

Co-authored-by: Tin Lam <tin@irrational.io>
Co-authored-by: sgupta <sg774j@att.com>
Change-Id: I5ebc8db58c0aa7b4e9eb0b5c671b280250d3cd1f
2020-07-13 19:30:34 +00:00
Chinasubbareddy Mallavarapu
8d25c11e7d [ceph-osd] Get ceph crush rack names from node lables
This is to enhance the ceph rack creation logic to read the rack names
from node labels so that could avoid providing rack names as chart overrides.

Change-Id: I5a29584d105fba068516d396ada90d00e2aab49c
2020-07-13 16:37:44 +00:00
Zuul
84426374b6 Merge "Elasticsearch - Cluster Wait Function Improvements" 2020-07-13 16:06:28 +00:00
Andrii Ostapenko
0ff44fc155
Support images overrides
Adds ability to override images in osh and osh-i repositories
if docker_images dict is provided with tags following zuul-jobs
upload-docker-image naming convention.

This allows to inherit osh job from osh-images project providing
required vars.

Change-Id: I5e7acb0dd0edd6838b6f7ddb5111db0fa34912d4
Signed-off-by: Andrii Ostapenko <andrii.ostapenko@att.com>
2020-07-12 11:41:49 -05:00
Andrii Ostapenko
06ad7cc7f6 Inherit playbook from common osh-infra parent for fuctional jobs
Change-Id: I7e7d090312ee577314509cd848adf76cabda6aad
Signed-off-by: Andrii Ostapenko <andrii.ostapenko@att.com>
2020-07-12 03:08:54 +00:00
Andrii Ostapenko
32a860072a
Explicitly specify a script directory for jobs run
Required to support reusing of a job in another project.

Change-Id: I1c5968ea3d785c4902c7ab011f7538877b10ce24
Signed-off-by: Andrii Ostapenko <andrii.ostapenko@att.com>
2020-07-11 01:00:18 -05:00
Zuul
5376e3a8ab Merge "Update alertmanager image to v0.20.0" 2020-07-11 02:43:03 +00:00
Steven Fitzpatrick
57b1f3905b Elasticsearch - Cluster Wait Function Improvements
This change modifies the cluster wait function to
check the cluster health status explicitly.

Once a status of at least "yellow" has been reached,
the Elasticsearch cluster should be able to facilitate
the API calls required by the other jobs of this chart.

Change-Id: I2660422a8e8122186d648042f5422ca9a82d23c7
2020-07-10 15:01:30 -05:00
Zuul
1590c6ffc4 Merge "chore(certs): add labels" 2020-07-10 18:36:23 +00:00
Zuul
5a11226cb0 Merge "Adjust rabbitmq probes to better reflect its actual state" 2020-07-10 17:18:12 +00:00
Tin Lam
c562986aa6 chore(certs): add labels
This patch set adds in the manifests guards and labels for the
cert-manager Issuer.

Change-Id: Ibcb45f9617be2b2ebde6d2b2695bfa6b358b2079
Signed-off-by: Tin Lam <tin@irrational.io>
2020-07-10 02:34:13 +00:00
Zuul
197409be9f Merge "Enable apparmor to Ceph post-apply pods" 2020-07-10 01:03:07 +00:00
Xiaoguang(William) Zhang
09fccd6b71 Update alertmanager image to v0.20.0
Update alertmanager image from v0.11.0 to v0.20.0

Change-Id: I0ba14d1001a53964ebc28bc9ea9be999402d54fb
2020-07-09 14:24:28 -04:00
diwakar thyagaraj
a8d9477a56 [FIX] Fix Prometheus Job
Change-Id: Icc3eafccfd2f919858d35f5e1ebbc768705c3139
Signed-off-by: diwakar thyagaraj <diwakar.chitoor.thyagaraj@att.com>
2020-07-09 16:02:59 +00:00
Kabanov, Dmitrii
eecf56b8a9 [Ceph-client, ceph-osd] Update helm test
The PS updates helm test and replaces "expected_osds" variable
by the amount of OSDs available in the cluster (ceph-client).
Also the PS updates the logic of calculation of minimum amount of OSDs.

Change-Id: Ic8402d668d672f454f062bed369cac516ed1573e
2020-07-09 15:53:49 +00:00
diwakar thyagaraj
5f59695ad4 Enable apparmor to Ceph post-apply pods
Logs : https://storage.gra.cloud.ovh.net/v1/AUTH_dcaab5e32b234d56b626f72581e3644c/zuul_opendev_logs_d16/739849/5/experimental/openstack-helm-infra-apparmor/d167181/primary/objects/namespaced/ceph/pods/ceph-osd-post-apply-zr55t.yaml

Change-Id: Ic5d4fe83ad16a7fc551162275ee3aa34c543ec18
Signed-off-by: diwakar thyagaraj <diwakar.chitoor.thyagaraj@att.com>
2020-07-09 15:11:48 +00:00
Zuul
0d5aeaacbb Merge "[Ceph-osd] Avoid using lsblk/blkid." 2020-07-09 07:30:37 +00:00
Zuul
781cfcd195 Merge "[Ceph-OSD] Wait for pods before running "post-apply" job." 2020-07-08 23:44:41 +00:00
Zuul
664575e703 Merge "Add missing security context to elasticsearch pods/containers" 2020-07-08 23:20:09 +00:00
Zuul
28eb431c32 Merge "Fix ALLOW_UNAUTHENTICATED for bionic kubeadm-AIO" 2020-07-08 21:41:50 +00:00
Zuul
26c4c01ae5 Merge "allocate_data_node function improvement" 2020-07-08 21:41:48 +00:00
Zuul
b15d9a103b Merge "Add openstack-helm-single-16GB-node nodeset" 2020-07-08 21:11:08 +00:00