Commit Graph

39 Commits

Author SHA1 Message Date
Matthew Heler
aad0394963 [CEPH] Use civetweb by default for RGW with keystone
Currently there is a bug in the beast code that makes it fail
during the initial lookup for a keystone user map. For the time
being we will continue to use civetweb when keystone is present
until this issue is resolved.

Change-Id: I56bcd77f38adb3763d35f46443c1403816d1dcea
2019-02-20 20:10:21 -06:00
Zuul
045e64067b Merge "Ceph-RGW: Support rotation of s3 key pairs" 2019-02-07 20:32:26 +00:00
Zuul
b4ec10151c Merge "[CEPH] Expand the Keystone Helm tests for RGW" 2019-02-07 19:11:42 +00:00
Steve Wilkerson
cf0ed142f6 Ceph-RGW: Support rotation of s3 key pairs
This updates the helm-toolkit script for creating rgw s3 users
to first check if a user exists, then create the user if it does
not exist or modify the user's keys if it does exist. This is
accomplished by using jq to identify all existing access keys for
the specified user, removing those key pairs using the access key,
then modifies the existing user with the supplied access/secret
key pair for the given user

This also updates the ceph-rgw chart to use the helm-toolkit s3
user script for creating the admin s3 user instead of using a
similar script defined directly in the ceph-rgw chart

Change-Id: I575b66415d44db7bb752102e45595305d86e623b
2019-02-07 10:33:49 -06:00
Matthew Heler
e8ed3bcf76 [CEPH] Expand the Keystone Helm tests for RGW
- Since the admin key has been removed, we need to also replace
radosrgw-admin with openstack container commands.

- Additionally expand the helm tests for keystone to also upload
and validate an object in RGW (similiar to S3 helm tests).

Change-Id: I4be603121fc227dd48f83704e99bba94341c4c09
2019-02-06 20:43:20 -06:00
Steve Wilkerson
f4aa5dc574 Ceph-RGW: Update storage-init job application labels
This changes the application label for the ceph-rgw storage init
job to 'ceph' to match the other jobs defined for the chart, rather
than use 'ceph-rgw'

Change-Id: Ia0b679567161e91241250f0c250d24a45c5ebb92
2019-02-06 14:43:24 -06:00
Zuul
2aceca1e29 Merge "[CEPH] Extend RadosGW S3 configuration support" 2019-02-04 22:27:13 +00:00
Matthew Heler
ff18dbe5fd [CEPH] Extend RadosGW S3 configuration support
- Support using custom client params for S3 configurations
- Move common tuning for S3 and Keystone into there own
configuration option
- Cleanup the rgw helm tests, since copying the ceph admin key is
no longer required
- Cleanup duplicate portions of the code for configuring the RGW
backend and frontend port
- Add an rgw helm test check for the osh-infra-logging gates

Change-Id: I46dbb4c45b0b96f5cf555077e49d2e09a1171424
2019-02-04 14:08:09 -06:00
Zuul
e0a858b8c2 Merge "Ceph: Update default to use OSH image" 2019-02-04 02:45:41 +00:00
Pete Birley
6ea6a85198 Ceph: Update default to use OSH image
This PS udpates the default image in the chart to the latest OSH image.

Change-Id: Ib8d2a72ad48049fe02560dc4405f0088890b6f64
Signed-off-by: Pete Birley <pete@port.direct>
2019-02-01 21:25:13 +00:00
Pete Birley
0d55b9064c RGW: Fix helm-test pod template
This PS updates the helm test driven pod template:
 * places rgw keystone conditional to correct location
 * removes unrequired roles and bindings
 * adds dependency on the rgw being running
 * corrects spelling error
 * corrects s3cmd to work with version 1.6.1

Change-Id: I665dba9fdca1d840f4d864e32f07b6185af51d25
Signed-off-by: Pete Birley <pete@port.direct>
2019-02-01 21:21:10 +00:00
Matthew Heler
ec86891c8f [CEPH] select the RGW backend based on RGW version
Use the Beast backend only when Mimic binaries are installed.
Otherwise use civitweb if the binares are from Ceph Luminous.

Change-Id: Ia7cb64d8db7eed2fc0c57387b26a27163af34520
2019-01-08 10:19:26 -06:00
Matthew Heler
c0d028e245 Uplift Ceph charts to the Mimic release
Change the release of Ceph from 12.2.3 (Luminous) to latest 13.2.2
(Mimic). Additionally use supported RHEL/Centos Images rather then
Ubuntu images, which are now considered deprecated by Redhat.

- Uplift all Ceph images to the latest 13.2.2 ceph-container images.
- RadosGW by default will now use the Beast backend.
- RadosGW has relaxed settings enabled for S3 naming conventions.
- Increased RadosGW resource limits due to backend change.
- All Luminous specific tests now test for both Luminous/Mimic.
- Gate scripts will remove all none required ceph packages. This is
required to not conflict with the pid/gid that the Redhat container
uses.

Change-Id: I9c00f3baa6c427e6223596ade95c65c331e763fb
2019-01-05 14:38:38 +00:00
Chris Wedgwood
0c4e37391f 'NOP' cleanup for more consistent white-space use in charts
Where we have the style '{{ ...' we should use the style '... }}'.

Change-Id: Ic3e779e4681370d396f95d3804ca27db5b9d3642
2019-01-03 22:45:49 +00:00
Matthew Heler
54efa7922d [Ceph] Tunables for rgw buckets
Set rgw_override_bucket_index_max_shards to 8 (default: 0)

By default create 8 shards per a bucket with Ceph RagosGW. This allows
up to ~800k-1M objects to be in a bucket before seeing performance slow-
downs. The only downside to this change is that a directory listing for
a bucket may take slightly longer to finish.

Change-Id: I96c7ac81501a41d29927e102a6029bf432bd3d21
2018-12-16 19:35:00 +00:00
Zuul
6d354f0f7b Merge "Revert "Add Egress Helm-toolkit function & enforce the nework policy at OSH-INFRA"" 2018-12-16 08:57:09 +00:00
Pete Birley
0bf3674539 Revert "Add Egress Helm-toolkit function & enforce the nework policy at OSH-INFRA"
This reverts commit 8d33a2911c.

Change-Id: Ic861b9bf9b337449b47a3558da8355e7a5bcacee
2018-12-16 04:21:46 +00:00
Zuul
b90bf10b89 Merge "Add Egress Helm-toolkit function & enforce the nework policy at OSH-INFRA" 2018-12-15 09:32:21 +00:00
Mike Pham
8d33a2911c Add Egress Helm-toolkit function & enforce the nework policy at OSH-INFRA
This PS implements the helm toolkit function to generate the
Egress in kubernetes network policy manifest based on overrideable values.
It also enbale the K8s network policy at Osh-infra gate.

Change-Id: Icbe2a18c98dba795d15398dcdcac64228f6a7b4c
2018-12-14 16:32:40 -05:00
Zuul
f81e2c54d1 Merge "Update Ceph-rgw helm tests" 2018-12-13 22:39:22 +00:00
Renis Makadia
458b8f6692 Update Ceph-rgw helm tests
Change-Id: I7b328da18ef10840baf8454e2fb3abaeeb542068
2018-12-13 11:21:13 -06:00
Pete Birley
c256cce537 Ceph: Allow multiple test pods to be present in clusters
This ps allows multiple ceph test pods to be present in cluster with
more than one ceph deployment.

Change-Id: I002a8b4681d97ed6ab95af23e1938870c28f5a83
Signed-off-by: Pete Birley <pete@port.direct>
2018-12-12 07:29:01 -06:00
Renis Makadia
5aaa59f23f Disable Ceph helm test while being updated.
Change-Id: I6011ee6f41044647dea43fa2848058d723e194b8
2018-12-06 15:47:08 +00:00
Jean-Charles Lopez
f7e03d4763 Helm Tests for Ceph-RGW chart
Co-Authored-By: Renis Makadia <renis.makadia@att.com>

Change-Id: I81cc0cb498b2ca911d5b7bfa7c3bd9b8552e0e2b
2018-12-01 08:08:28 +00:00
Matthew Heler
225b85eb5f Additional Ceph RGW tuning and cleanups
Set RGW rados handles from 1 to 4
Remove support for fastcgi (it's no longer supported)

Change-Id: Ie260a3e1e5eab2065ec6a4d0637c144965a4214d
2018-11-12 20:13:33 +00:00
Matthew Heler
6ef48d3706 Further performance tuning changes for Ceph
- Throttle down snap trimming as to lessen it's performance impact
(Setting just osd_snap_trim_priority isn't effective enough to throttle
down the impact)
osd_snap_trim_sleep: 0.1 (default 0)
osd_pg_max_concurrent_snap_trims: 1 (default 2)

- Align filestore_merge_threshold with upstream Ceph values
(A negative number disables this function, no change in behavior)
filestore_merge_threshold: -10 (formerly -50, default 10)

- Increase RGW pool thread size for more concurrent connections
rgw_thread_pool_size: 512 (default 100)

- Disable in-memory logs for the ms subsytem.
debug_ms: 0/0 (default 0/5)

- Formating cleanups

Change-Id: I4aefcb6e774cb3e1252e52ca6003cec495556467
2018-10-26 15:10:50 +00:00
Pete Birley
a01e2db6ab Ceph-RGW: Use hostname not podname for pod specific config
This PS moves to use the hostname, not the pod name for the
instances specific config sections.

Change-Id: If2bc60c9f4f12038e8aa70fbd33a009cdf652b75
Signed-off-by: Pete Birley <pete@port.direct>
2018-10-17 01:38:34 +00:00
Jean-Charles Lopez
05391252f8 Disable Ceph RADOS Gateway dynamic bucket resharding.
Problem was discovered regarding issues being caused by RGW dynamic
bucket resharding. It is at this time recommended to disable this feature.

Change-Id: Id524415f4ed08ee5374f7fd3b53f6e36c3ab084e
2018-10-05 16:20:10 +00:00
Chinasubbareddy M
2f2cb7d567 Ceph: Add configmap hash as annotation
adding configmap  hash to following ds/deployments to trigger
rolling updates if there are any update for configmap

- ceph-mon
- ceph-mds
- ceph-mgr
- ceph-rgw

Change-Id: I4173cb12c18640c9b1a0e5a698d48f4735e250fb
2018-09-22 07:26:52 +00:00
Zuul
c10f9ce59e Merge "Modify Ceph default settings for improved performance" 2018-09-20 22:44:11 +00:00
Chinasubbareddy M
d5fecffdc1 ceph-rgw: stop storage init job on each run
this is to stop executing storage init job if we have ceph
deployment false under values

Change-Id: Iee3f7cf4c98a2c68c27b42011ffe6f07b278c2c4
2018-09-19 14:41:02 -05:00
Jean-Charles Lopez
c6cad19d11 Modify Ceph default settings for improved performance
Change-Id: Ia0d856e53f3bfdc1414264b468b576003dc23b6e
2018-09-13 07:47:42 -07:00
Pete Birley
bb3ff98d53 Add release uuid to pods and rc objects
This PS adds the ability to attach a release uuid to pods and rc
objects as desired. A follow up ps will add the ability to add arbitary
annotations to the same objects.

Change-Id: Iceedba457a03387f6fc44eb763a00fd57f9d84a5
Signed-off-by: Pete Birley <pete@port.direct>
2018-09-13 05:35:35 +00:00
Steve Wilkerson
7865667e35 Ceph-rgw: Update s3 default admin keys
This updates the ceph-rgw s3 admin access and secret keys to more
generic default values to avoid the possibility of a user assuming
the default keys are acceptable to use

Change-Id: I618ec16059e12c8ce74513da7580a9853af707df
2018-09-10 10:56:45 -06:00
Steve Wilkerson
fe437272b4 Ceph-RGW: Fix configmap-bin template
This changes the conditional check for including the configmap-bin
template in the ceph-rgw chart to their original state, and also
adds the rgw-s3-admin.sh script that was removed unintentionally

Change-Id: I60c3660a5bca37199effcf74f3060059345a327b
2018-09-07 13:35:14 +00:00
Zuul
090373d352 Merge "Ceph-rgw: make configmap names to be driven via chart values" 2018-09-05 00:03:42 +00:00
Renis Makadia
6be67bafea Ceph-RGW missing mon port configuration
- Adding missing changes from merged PS 590095

Change-Id: I0bae35ff08c9d422f9f284f65089171f9879766a
2018-09-04 11:56:13 -07:00
Chinasubbareddy M
b39e27891b Ceph-rgw: make configmap names to be driven via chart values
This to avoid configmap names conflicts with ther ceph charts

Change-Id: I73906fe69dd729fef0299149350caf021aab07e5
2018-09-04 13:19:02 -05:00
Steve Wilkerson
25bc83b580 Ceph: Move Ceph charts to openstack-helm-infra
This continues the work of moving infrastructure related services
out of openstack-helm, by moving the ceph charts to openstack
helm infra instead.

Change-Id: I306ccd9d494f72a7946a7850f96d5c22f36eb8a0
2018-08-28 15:03:35 -05:00