1076 Commits

Author SHA1 Message Date
Jenkins
a09cebd2a5 Merge "Gate: Heat functional test" 2017-08-21 21:46:40 +00:00
Pete Birley
ff6e6d19f9 Gate: Heat functional test
This PS adds a functional test of heat in the OSH gates, it also moves
most params to a seperate file - making config of the gate in non-zuul
environments simpler.

Change-Id: I37a1bc0dcc8000c5da8067a8d376c78f7cd6f7ab
2017-08-21 13:55:53 -05:00
Jawon Choo
9f7e6eda90 pod resources mismatched in ingress chart
in ingress chart,
ingress/error resource configuration is mismatched.

Change-Id: Idd9ea2692981b2ba971a259844f703ec9e7307b1
Closes-Bug: #1711980
2017-08-21 11:41:31 +09:00
Pete Birley
0c715b8b3c Gate: Add heat to single node checks and to Armada checks
This PS adds heat to the single node and Armada based deployment
checks in the gate scripts. Additionally it moves the client calls
in the check scripts to use the heat engine pod.

Change-Id: Iccc996fb2b2140ed19c6708d6033b4a9dd1bfc46
2017-08-20 13:20:48 -05:00
Jenkins
d5436cc978 Merge "Add management port to RabbitMQ service" 2017-08-18 05:23:46 +00:00
Jenkins
b06fab9c07 Merge "KubeADM-AIO: allow customisation of CNI" 2017-08-15 17:49:28 +00:00
Jenkins
b0f53eec2c Merge "Nova: remove hardcoded debug for API service" 2017-08-15 15:56:21 +00:00
Jenkins
658269f888 Merge "Add barbican helm test" 2017-08-15 15:02:19 +00:00
Pete Birley
52c549a2d3 KubeADM-AIO: allow customisation of CNI
This PS adds the ability to customise the CNI used by
the AIO KubeADM container.

Change-Id: If531a896e38baeda32c008d9645c34174603c690
2017-08-15 08:12:21 -05:00
Tin Lam
8e76f32407 Add barbican helm test
This patch set adds basic barbican test using the OpenStack Client.  This
patch set also addressed an issue where the href contains a duplicate
version in the path, e.g. http://URL:xxxx/v1/v1/secrets in secret path.

Change-Id: Ie66d00d5a0b02721ba41e6bf4b5e784fb49adce8
2017-08-15 05:08:20 -05:00
lukepatrick
2b683908c2 Bug: Fixes in nodeport indentation and missing brackets
This PS fixes indentation and some missing {{ }} brackets in barbican, glance, and nova

Change-Id: I3f0c9afed8693662a7bc9e8df3b8f384b76243bb
2017-08-14 10:22:48 -06:00
Pete Birley
794d11ce69 Nova: remove hardcoded debug for API service
This PS removes the hardcoded debug flag on the api service.

Change-Id: I8413cb832be57e32af29d02b2aae322a250ecb34
2017-08-14 08:30:56 -05:00
Jenkins
a95845062f Merge "Add a default mode to all charts missing it" 2017-08-11 20:05:52 +00:00
Darla Ahlert
afeb03879b Add a default mode to all charts missing it
This ps adds missing defaultMode to any chart missing it
on the configmap for volumes

Change-Id: If996d137fe1f4f5547dcbf43d9883924f192db57
2017-08-11 13:18:55 -05:00
Jenkins
8a8c813727 Merge "Update DNS policy for pods in host network namespace" 2017-08-11 15:16:17 +00:00
Pete Birley
53966ecbe1 Bug: Fixs nodeport indentation in keystone and barbican
This PS fixes the nodeport indentation in keystone and barbican.

Change-Id: I3903fcf3b1a3309b6b5e6324053682e7418cb0bc
2017-08-11 09:19:49 -05:00
Pete Birley
0c75f1ab9c Update DNS policy for pods in host network namespace
This PS updates the DNS policy for pods that run in the hosts network
namespace.

Change-Id: I5ff11985459c967e5248d1ce9f62ebfc578e3afb
2017-08-10 16:43:20 -05:00
Pete Birley
920cb9aae5 Gate: Set tests to run only if a deployment of OSH is performed
This PS updates the gate script to only run tests of OSH if it is
actually deployed.

Change-Id: Iaf89bbfffb01ca3c7ba7bfc5b5867794c6bfd5e8
2017-08-10 09:47:49 -05:00
Jenkins
c4050ba375 Merge "Armada OpenStack deployment yaml" 2017-08-09 20:29:16 +00:00
Huamin Chen
da9539bb87 Use RBD external provisioner
Currently RBD storageclass uses in-tree provisioner
kubernetes.io/rbd. Since containerized kubernetes controller image
doesn't include rbd binary, in-tree provisioner errors out.

This fix uses external provisioner ceph.com/rbd.

Closes-Bug: #1707937

Change-Id: Iad443a54c0229c0356beb6d872365298248c40c9
2017-08-09 11:24:59 -05:00
Tim Heyer
47bb6d2a85 Armada OpenStack deployment yaml
Armada is a tool for managing multiple helm charts with dependencies by
centralizing all configurations in a single Armada yaml. This yaml is
used for a full OpenStack deployment.

Co-Authored-By: Alexis Rivera <gardlt@tetrasol.org>
Co-Authored-By: Pete Birley <pete@port.direct>

Change-Id: I70b41f038c2819aeaa4b2c7bb617b7b2c38441d1
2017-08-09 09:40:46 -05:00
Huamin Chen
e30c1cf414 set DNS policy for osd daemonset
Use ClusterFirstWithHostNet DNS policy so osd pods can resolve mon address
through host network

Change-Id: I7aaeee1fc26cc1812c210bfe2c0f5b131c4cbd81
Closes-Bug: #1709439
2017-08-08 15:25:28 -04:00
Jenkins
9b58bee639 Merge "Licence: Remove licence header from rendered files" 2017-08-08 14:25:59 +00:00
Grzegorz Grasza
a3dcbe91b5 Add management port to RabbitMQ service
Management port exposes a HTTP REST API which can be used to
add virtual hosts and users, gather statistics and other data
about the running cluster. This also turns on the web interface
available on the management port.

Change-Id: I5e4c902d780d99e96fdd160c58227676d4676e87
Partial-Implements: blueprint service-rabbitmq-registration
2017-08-08 12:52:35 +00:00
Jenkins
66fa487563 Merge "Fix -- Ceph in multinode gate" 2017-08-07 23:09:02 +00:00
Jenkins
a0893b0d85 Merge "Charts: make manifests optional for all OpenStack elements" 2017-08-07 22:28:06 +00:00
Pete Birley
ff8744a9b9 Licence: Remove licence header from rendered files
This PS removes the licence header from rendered output from tiller,
significantly reducing the configmap size of charts deployed to the
cluster.

Change-Id: I5d1b246f2068f3b83bf59ba79fe8b88bbc9a6161
2017-08-07 17:16:13 -05:00
Steve Wilkerson
9fa445ab44 Fix -- Ceph in multinode gate
This fix aims to address the multinode gate issues for IPs on the
same subnet.

Change-Id: If158f78acf4d5e32eb495354307a0e3e5343ef6e
2017-08-07 17:11:11 -05:00
Pete Birley
35601e2bd3 Charts: make manifests optional for all OpenStack elements
This PS allows the rendering of manifests to be controlled. It enables
both increased control over deployment when required but also makes
development of a feature easier to target.

Change-Id: I1716e8ee23fe5c53f935bd739ea283bc4a2a9963
2017-08-07 14:59:48 -05:00
Jenkins
dbfbbda826 Merge "Ceph: Fix Multinode Gates" 2017-08-07 16:28:17 +00:00
Jenkins
350f1b91b9 Merge "fix to avoid crash loop on ceph clean job" 2017-08-07 14:57:28 +00:00
Jenkins
075d9957af Merge "fix to avoid crash loop on glance clean job" 2017-08-07 14:47:26 +00:00
Pete Birley
59dfea0e58 Ceph: Fix Multinode Gates
This PS should make the multinode gate more reliable for ceph.

It's not perfect in that is uses the default route IPs in zuul, which
has a performance hit. The bash is also ugly as sin - but it gets us
moving again until somone has time to implement a more eligant solution
that works both in infra supplied nodes and other CI systems.

Change-Id: Ie1326f048c43d04a945ca155bde8824d17ddcbec
2017-08-07 03:39:37 +00:00
Stacey Fletcher
b3de787cf0 Gates: Add configurable timeouts
This PS allows for timeouts to be passed as arguments if a longer or
shorter timeout is needed.

Change-Id: Ie5d987084d0c1197bd491297021a9e5e2c36195c
2017-08-06 20:05:44 -05:00
Jenkins
4fcc7f78c8 Merge "Jobs: Add labels to all jobs" 2017-08-05 22:00:33 +00:00
Pete Birley
8f8a80019a Jobs: Add labels to all jobs
This PS adds labels to all jobs in OpenStack-Helm, allowing them to be
found by label searches. This makes management of large clusters using
tools like Armada easier.

Change-Id: I49b2cb7a94fab96958f187ca11e2c2a0c80ff843
2017-08-05 20:17:12 +00:00
Pete Birley
45ffd6290b Keystone user job: create domains if required
This PS creates the user and project domain during the keystone-user
jobs if reqired.

Change-Id: Ib885a3629ab32a9c60725495b50dc712948848fd
2017-08-05 09:41:06 -05:00
Tin Lam
c8f225ef91 Fix oslo _i18n issue
While trying to regenerate the .conf files, the gen-oslo-openstack-helm
tool spits back an error because of the removal of log translations in
OpenStack [0].  This patch set replaces the removed _LW() with the default
_() so the tool does not error out unexpectedly.

[0] d5e3652d12

Change-Id: I665775ae075b6ce0d1aa74ca5732e9e6566ff174
2017-08-04 08:22:15 -05:00
Dae Seong Kim
677c7d834b fix to avoid crash loop on ceph clean job
ceph clean job tries to delete a secret. but if there's no the secret,
the job falls in CrashLoopBackOff status when helm delete.

Change-Id: I863e43f576408fdcd24997bde9b658c50b0057c1
Closes-bug: 1708597
2017-08-04 16:36:47 +09:00
Dae Seong Kim
f45da069e4 fix to avoid crash loop on glance clean job
glance clean job tries to delete a image. but if there's no the image,
the job falls in CrashLoopBackOff status when helm delete.

Change-Id: I3b9c3057b9da8780ca27f1cb18dcd5541f3bcabc
Closes-bug: 1708581
2017-08-04 16:21:32 +09:00
Pete Birley
054ac68e92 KubeADM-AIO: update to K8s 1.6.8
This PS udpates the Kubernetes version to v1.6.8

Change-Id: I2170fbaf901e761cb732469dab5ad7bc946ddea5
2017-08-03 23:37:00 -05:00
Jenkins
268d8ef471 Merge "Fix joinListWithComma rendering when invoked with CLI values" 2017-08-02 20:26:55 +00:00
Jenkins
830875627d Merge "Add setup and rotate job for credential keys" 2017-08-02 14:52:39 +00:00
Jenkins
da48e214d1 Merge "Add support for Keystone's fernet tokens" 2017-08-02 13:47:52 +00:00
Pete Birley
04e05fcea4 Fix joinListWithComma rendering when invoked with CLI values
This PS fises a rendering erros in the joinListWithComma function
when used with values from the helm --set cli command.

From Kolla-Kubernetes: https://review.openstack.org/#/c/488513/
All Credit to: Serguei Bezverkhi

Change-Id: I013a37f5e6dec43232c6ee300be8f918f9ef554a
2017-08-02 08:38:14 -05:00
Michał Dulko
cfab320f26 Add setup and rotate job for credential keys
Keystone is using keys to encrypt credentials saved into the database.
The mechanism is very similar to fernet tokens. This commit implements a
job setting key repository up and rotate job for those keys. All is
based on implementation of fernet tokens.

Change-Id: I88faf1d02d2b317563e8603cebba542f8b133c6a
Closes-Bug: 1693807
2017-08-02 13:22:05 +02:00
Michał Dulko
03543a3d53 Add support for Keystone's fernet tokens
Keystone supports (and that's a default setting since Ocata) using
non-persistent fernet tokens instead of UUID tokens written into the DB.
This setting is in some cases better in terms of performance and
manageability (no more tokens DB table cleanups). OpenStack-Helm should
be able to support it.

General issue with fernet tokens is that keys used to encrypt them need
to be persistent and shared accross the cluster. Moreover "rotate"
operation generates a new key, so key repository will change over time.

This commit implements fernet tokens support by:
* A 'keystone-fernet-keys' secret is created to serve as keys repository.
* New fernet-setup Job will populate secret with initial keys.
* New fernet-rotate CronJob will be run periodically (weekly by default)
  and perform key rotation operation and update the secret.
* Secret is attached to keystone-api pods in /etc/keystone/fernet-tokens
  directory.

Turns out k8s is updating secrets attached to pods automatically, so
because of Keystone's fernet tokens implementation, we don't need to
worry about synchronization of the key repository. Everything should be
fine unless fernet-rotate job will run before all of the pods will
notice the change in the secret. As in real-world scenario you would
rotate your keys no more often than once an hour, this should be totally
fine.

Implements: blueprint keystone-fernet-tokens
Change-Id: Ifc84b8c97e1a85d30eb46260582d9c58220fbf0a
2017-08-02 13:22:05 +02:00
Robert Choi
f84716f43e Glance: Add paste_deploy values
Glance bootstrap job fails due to missing 'paste_deploy' values.
This PS solves the issue by adding the values to glance chart.

Change-Id: I850863fe29c25aab9cf57eee62098e2b5d23a7f8
Closes-Bug: 1705421
2017-08-02 14:23:01 +09:00
Jenkins
542105729b Merge "Randomize ceph namespace cleaner job name" 2017-08-01 19:59:41 +00:00
Jenkins
e8a17df247 Merge "Gate: Loopback device support" 2017-08-01 16:36:08 +00:00