122 Commits

Author SHA1 Message Date
Zuul
06cc07ec04 Merge "CephFS: support for OSH" 2018-01-11 00:19:27 +00:00
Zuul
b17c051bfc Merge "ceph-mgr: change liveness/readiness probes" 2018-01-10 07:12:57 +00:00
portdirect
dc105fdcfa CephFS: support for OSH
This PS adds support for CephFS in OSH.

Change-Id: I54d5302b89f04cc30f151c8db59f476f02be5652
2018-01-09 15:41:45 -05:00
Huamin Chen
5cd3a087bf ceph-mgr: change liveness/readiness probes
Instead of relying on the dashboard availability
we check the ceph-mgr map

Signed-off-by: Alexandre Marangone <amarango@redhat.com>

Change-Id: I78d33a4b522ed085ed85a638b3784c2d07026e39
2018-01-09 19:28:03 +00:00
Zuul
799daefb83 Merge "Ceph: don't overwrite mon map" 2018-01-06 21:15:18 +00:00
Huamin Chen
4197b9eae5 ceph-mgr: set .spec.strategy to recreate
This PS set the Ceph MGR pod .spec.strategy to recreate.

Signed-off-by: Alexandre Marangone <amarango@redhat.com>

Change-Id: I14a817dbf8e0d1ec86345cf97911302f5acc3466
2018-01-05 21:43:31 +00:00
Huamin Chen
dddfa6651f Ceph: don't overwrite mon map
When monmap is persisted, don't overwrite it when mon pod restarts.
This helps when there is just one mon or all mons reboot

Change-Id: I9119379f4bc026c315a2fa7507a1664b12ea6205
Signed-off-by: Huamin Chen <hchen@redhat.com>
2018-01-05 14:37:39 -05:00
Zuul
6e70733dc7 Merge "Ceph: Dont create volume pool by default" 2018-01-04 00:44:54 +00:00
portdirect
d7416cac6d Ceph: Add mgr caps to the admin keyring
This PS adds mgr caps to the admin keyring and also adds the mgr
bootstrap keyring.

Change-Id: Ic88dfcb0aa00d8d017a8c28d3c64169b2d8f0022
2017-12-30 17:18:04 +00:00
portdirect
235325ba45 Ceph: Dont create volume pool by default
The Cinder chart can now manage its storage init itself. This PS
now removes the unrequired pool creation in the Ceph bootstrap job.
It also updates the `ensure_pool` to better support luminious.

Change-Id: I4a71df9a6d3a0e45c6ef6812926d66455055ae9f
2017-12-29 11:04:26 -05:00
portdirect
55f1bacf35 Cinder: Enable backup
This PS enables the cinder backup service, for RBD, Swift and Posix
based backups.

Change-Id: I5b4d5a19e187784b55fa8601b244d9a45d29fb06
2017-12-28 19:21:04 -05:00
portdirect
0f107f1b81 Ceph: update dependency logic to be more strict
This PS updates the dependency tree in ceph to take into account
the keyring jobs and also the tollerance for unready endpoints
introduced in the k8s 1.6 era.

Change-Id: If76efeafdbcbe88ee699e7553f0effd5da7ce624
2017-12-28 00:51:42 +00:00
Zuul
51056ac142 Merge "Fixed ceph mon resource definition" 2017-12-27 20:36:16 +00:00
Matt McEuen
e507dc38d9 Fixed ceph mon resource definition
The ceph mon daemonset had a typo, and referenced the osd
resource limit specification in Values instead of its own.

Change-Id: I06433b9039842322786e73eff89da2836c17bb7f
2017-12-27 07:10:19 -06:00
portdirect
fa2620d54b RBAC for OSH
This PS applys RBAC rules to OSH, based off the work
done in https://review.openstack.org/#/c/526464/

Change-Id: I541b0ac1a3972566ef2b66571ae32744dab70c17
2017-12-26 10:24:19 -05:00
Huamin Chen
eed43b8524 Ceph: luminous fixes
init osd: Ceph luminous release init osd differently. This fix detects
ceph releases and use the right process to init osd directory
mgr: Set mgr daemonset that is in Luminous

Change-Id: I99a102f24c4a8ba18a0bba873e9f752368bea594
Signed-off-by: Huamin Chen <hchen@redhat.com>
Depends-On: I17359df62a720cbd0b3ff79b1d642f99b3e81b3f
2017-12-13 15:52:36 -05:00
Zuul
8f696ab93b Merge "Add imageFormat and imageFeature support" 2017-12-11 21:27:34 +00:00
Zuul
cadccfd214 Merge "Ceph liveness scripts" 2017-12-11 16:33:20 +00:00
rong.zhang
8c6d2c8543 Add imageFormat and imageFeature support
Add imageFormat and imageFeature support

Change-Id: I441bbf82031c70da8ac49730b8dc4e5ea08a6b7e
2017-12-08 16:55:36 +08:00
dave kormann
5f3f13cc0a Ceph liveness scripts
Replace socket-based liveness checks with scripts

The current TCP socket-based liveness/readiness check for Ceph
doesn't accurately reflect when daemons are live, doesn't handle
multiple OSDs on a host, and doesn't work when hostNetworking is
in use and the Ceph network is different from the one associated
with the hostname.  This change adds new scripts for checking
Ceph monitor and OSD liveness/readiness that query the Ceph Unix
domain sockets to get daemon status and exits 0 iff all sockets
report that their daemons are in an "active" state.

This isn't perfect: we don't know how many daemons SHOULD be
active, so if only a subset is live and the others have no
sockets (yet?), we'll still claim the pod is ready.  The scripts
also don't distinguish between liveness and readiness for OSDs.

Change-Id: I5d370b4bc4025fece2e640355c3a29167afca871
2017-12-01 13:45:41 +00:00
portdirect
6325ebd72e Images: Ceph service specific explicit image names
This PS makes the service-specific images for Ceph have
explicit names, allowing simple over-riding of images for an
entire site.

Change-Id: I735c5fdc08c2a83893f25e6f6f9824089916507f
2017-11-29 04:06:15 +00:00
intlabs
0caa1fcef3 Ceph: mount mon state directory on host.
This change allows single node deployments of ceph to reboot/restart
sucessfully.

Change-Id: I9e8b7c5fa6c769483294071b9ed17db6e51eda1f
2017-10-30 17:18:28 -05:00
intlabs
fe6107cf76 Images: Update values to allow simple parse of images being used
This PS updates the values file layout for images to allow simple
parsing of the images in use by charts, allowing them to be queried
and modified much more simply. By moving the image tags to a 'tags'
key, we can extend the options used simply to accomodate extra
options simply (eg prefixing the tag for use with an internal
registry) or pre-pulling the images to reduce chart deploy failure.

Change-Id: I9ec1dbb00d997ab6cb021bf0b698f7aae740e95d
2017-10-23 10:05:20 -05:00
Hyunsun Moon
411e1bd86a Ceph: Make provision_storage_class have an effect
Currently, "general" storage class always created even if
provision_storage_class is set to false. This patch fixed
storageclass template to check the option is enabled.

Change-Id: I6397b24fa9c6517f2646e53ea0f601ad2aa4b9f8
2017-10-13 04:59:32 +00:00
Jenkins
bc280c11de Merge "Change entrypoint version" 2017-10-10 19:34:22 +00:00
Grzegorz Grasza (xek)
1fe3ca34c9 Change entrypoint version
New kubernetes-entrypoint version was released. K8s-entrypoint
authors maintain images at Quay. The image uses CoreOS, which
is more lightweight than the current Ubuntu image, so it
should lessen the burden on the infrastructure.

Change-Id: Id8c2a4d065550ffbd64476377247cccf213b58e1
Partial-Implements: blueprint entrypoint-namespaces
2017-10-10 15:59:08 +02:00
intlabs
61569d1b8b KubeAPI: Update secrets to be in conformance with k8s 1.8
Kubernetes 1.8 is stricter about the feilds in a secrets manifest,
this PS updates OpenStack-Helm to be compliant.

Change-Id: I9e19d07060d8517e0f4fd3056013191b1b4ba2da
2017-10-09 18:20:03 -05:00
Jenkins
7cdb1782ac Merge "Ceph: parameterize kubectl param" 2017-09-25 19:02:22 +00:00
Jenkins
c7c4199469 Merge "Fix for missing init container in rbd-provisioner" 2017-09-25 18:46:22 +00:00
Huamin Chen
2a75376c1c Ceph: parameterize kubectl param
Not to use hard coded labels in kubectl command

Change-Id: Ia53b4bd00071b08d1064349bad596c978814a719
Signed-off-by: Huamin Chen <hchen@redhat.com>
2017-09-22 08:10:19 -04:00
Huamin Chen
9b7fac367c Ceph: cleanup unused code
Change-Id: I81fa42b57d3ecd80c808ba92fbe5e840cd4b3dc2
Signed-off-by: Huamin Chen <hchen@redhat.com>
2017-09-21 10:43:56 -04:00
Chris Wedgwood
e4e01362f7 ceph: skip rgw keyring-generator when not needed
Change-Id: I12d151587963b30a910146edaead54e55505077e
2017-09-20 18:33:29 +00:00
Mateusz Blaszkowski
06edf20328 Fix for missing init container in rbd-provisioner
Change-Id: Iadf05b6b233448f233866048d64d7167d8857438
Signed-off-by: Mateusz Blaszkowski <mateusz.blaszkowski@intel.com>
2017-09-20 02:08:06 -04:00
Pete Birley
010955fbef Kubernetes: move to Kubernetes v1.7.5 gate
This PS moves to use Kubernetes v1.7.5 as the reference deployment
version.

Change-Id: Ie2060dc5271decf1b9298fc8fc8f23ead6501fbd
2017-09-14 20:34:45 +00:00
Huamin Chen
d2b4a35e75 Ceph: add more debugging to osd
Log the filesystem type of directory OSD to help diagnose root cause of OSD failures

Change-Id: I8c8de033afeeb7e6e33f88db33dc962d03ed3ba9
Signed-off-by: Huamin Chen <hchen@redhat.com>
2017-09-13 08:00:58 -04:00
Jenkins
4e3bd88808 Merge "Glance: Backend support and auth improvements" 2017-09-11 17:30:37 +00:00
Pete Birley
b3f8b812ca Glance: Backend support and auth improvements
This PS enables the following backends for glance:
 * PVC
 * RBD
 * RadosGW (direct)
 * Swift

It also moves the creation of the RBD pool when required to a storage
init job. This job also creates credentials as required for glance to
use when accessing the required backend, rather than using the admin
keyring.

Change-Id: I90fead961ff73a9263826acc794128fa73ead2e1
2017-09-09 02:13:01 +00:00
Huamin Chen
84901ac56d Ceph: RGW and MDS deployment fixes
fix ceph.conf path in RGW
add variables_entrypoint.sh to MDS and RGW deployment

Change-Id: Ic977e397e3534b71eb17f7de4199ba31c343a0ba
Signed-off-by: Huamin Chen <hchen@redhat.com>
2017-09-08 14:59:44 -04:00
Jenkins
2e2ac8c387 Merge "Ceph: mon should get Pods from namespace other than ceph" 2017-09-08 05:56:57 +00:00
Huamin Chen
c56ebf2ea6 Ceph: mon should get Pods from namespace other than ceph
Currently CLUSTER and deployment namespace both default to ceph, so these
variables can be used exchangeably.But once deployment namespace changes,
MON daemonset will not be able to get its IP from ceph namespace.
This fix swaps CLUSTER with NAMESPACE and solves this problem

Change-Id: I0cf6afafb71f3972e24d13d479192e7a4e155de4
Signed-off-by: Huamin Chen <hchen@redhat.com>
2017-09-07 13:54:20 -04:00
Pete Birley
7c37157fb1 Ceph: RadosGW
This PS implements the ceph radosgw and also provides keystone
intergration, allowing ceph to provide a swift like service if
desired for object storage.

In addtion it updates the endpoint lookups to use valid yaml when
dealing with keystone services with a '-' in their name.

Change-Id: I9162ad657df2f77c1bc1afa93a8b999894b1b470
2017-09-06 23:35:47 -05:00
Pete Birley
c6a288d269 Ceph: Config Overides
This PS provides the same level of configuration tuneability and control to
the ceph chart as other charts within openstack-helm.

Change-Id: I620c3fdb31abe67ee5b4b4766b1523e02bb7f814
2017-09-06 19:36:54 -04:00
Pete Birley
b120667031 Endpoint lookups: fix typo in overrides
This PS fixes a typo in the endpoint lookup function and input.

Change-Id: I6ff6d68bf82e1e1f70438a7017f4e1a6df7f59a7
2017-09-06 11:15:54 -05:00
Pete Birley
f398d73c53 Ceph: Cleanup entrypoint scripts
This PS cleans up the entrypoint scripts to remove unrequired functions.

Change-Id: Ibc445e422c1ebad972de59b47955511d14dd6d3c
2017-09-05 16:34:02 -04:00
Mateusz Blaszkowski
e4f0690eb2 'affinity' constraints added in remaining services
Change-Id: I1ca654fbcc0301591e6b290d41fce1797ea2820a
Signed-off-by: Mateusz Blaszkowski <mateusz.blaszkowski@intel.com>
2017-09-04 05:56:19 -04:00
Jenkins
3ac70eb89d Merge "Set DNS policy for ceph-mon daemonset" 2017-09-01 14:35:50 +00:00
Pete Birley
bede94c835 Endpoint lookup namespace and fqdn support
This PS adds namespace and fqdn support to endpoint lookup functions,
it also permits over-riding of the puplic endpoint for ingress.

Change-Id: Ib61c5c00a214d75fe85fbffe9080c2ae88bd8cb9
2017-08-31 19:06:33 +00:00
Jaesang Lee
26252ae1fd Set DNS policy for ceph-mon daemonset
add dnsPolicy parameter in daemonset-mon.yaml, ceph-mon should have
dnsPolicy ClusterFirstWithHostNet because it use hostNetwork.

Closes-bug: 1713383
Change-Id: I14aba0f5caeb6cb7057aeadb18c60337b130da90
2017-08-28 11:27:54 +09:00
Pete Birley
39509c1eb5 Ceph: update namespace client key script to hard fail sucessfully
This PS updates the ceph namespace client key script to hard fail
if it cannot get the admin storage key from the namespace ceph is
deployed into.

Change-Id: Ieefe6d800a678d721294561b25bbebc874cfa74d
2017-08-22 11:12:04 -05:00
Huamin Chen
da9539bb87 Use RBD external provisioner
Currently RBD storageclass uses in-tree provisioner
kubernetes.io/rbd. Since containerized kubernetes controller image
doesn't include rbd binary, in-tree provisioner errors out.

This fix uses external provisioner ceph.com/rbd.

Closes-Bug: #1707937

Change-Id: Iad443a54c0229c0356beb6d872365298248c40c9
2017-08-09 11:24:59 -05:00