4500 Commits

Author SHA1 Message Date
Lingxian Kong
cae7fa21b6 [k8s] Cluster creation speedup
- Start workers as soon as the master VM is created, rather than
  waiting all the services ready.
- Move all the SoftwareDeployment outside of kubemaster stack.
- Tweak the scripts in SoftwareDeployment so that they can be combined
  into a single script.

Story: 2004573
Task: 28347
Change-Id: Ie48861253615c8f60b34a2c1e9ad6b91d3ae685e
Co-Authored-By: Lingxian Kong <anlin.kong@gmail.com>
2018-12-15 11:59:57 +00:00
Mohammed Naser
844e4db2a9 functional: stop using concurrency of 1 for api tests
There is no need for API tests to be running with concurrency of
one, we can drop that and speed up the API test suite by using
all of our cores.

Change-Id: Ideb379ba7032e83bde852198fc66ccd623ae1424
2018-12-12 09:45:57 +00:00
Zuul
c8ab4efcbc Merge "functional: use vexxhost-specific nodes with nested virt" 2018-12-12 00:06:10 +00:00
Zuul
c857276648 Merge "functional: use default admission_control_list values" 2018-12-12 00:06:09 +00:00
Zuul
e52cfa7a3f Merge "functional: bump atomic version to latest" 2018-12-12 00:06:08 +00:00
Zuul
2784cbcd93 Merge "functional: add body for delete_namespaced_service in k8s" 2018-12-12 00:06:06 +00:00
Zuul
d62d58ac1a Merge "functional: retrieve cluster to get stack_id" 2018-12-11 23:51:36 +00:00
Zuul
1ed47b023b Merge "Add iptables -P FORWARD ACCEPT unit" 2018-12-11 14:42:13 +00:00
Mohammed Naser
2e2ebaf679 functional: use vexxhost-specific nodes with nested virt
This patch changes the intergration jobs to use nodes which are
at VEXXHOST that come with supported nested virtualization in
order to allow for the functional jobs to finish on-time.

Change-Id: Ie275caac1a40fb3f10a0653b66611d2ba9d1c470
Story: #2002589
Task: #28341
2018-12-08 22:16:42 -05:00
Mohammed Naser
3646a59eac functional: use default admission_control_list values
The functional jobs are currently deploying with an empty list of
admission control list which means that the service token controller
does not go up resulting in the cluster failing to go up.

This patch drops that so it uses the default values of the admission
controllers in order to get the cluster to go up cleanly.

Change-Id: I0fdd65a9859f34e202016c37620f553623ef8a3e
2018-12-08 22:16:42 -05:00
Mohammed Naser
d16479709a functional: bump atomic version to latest
This patch brings the Fedora Atomic version used in gating to
the latest one which includes some improvements alongside a newer
version of Docker (which seems to run things better overall).

Change-Id: Iad0a1f57b29aec9a0cdb2a104fdaa5970133cfb4
2018-12-08 22:16:42 -05:00
Mohammed Naser
e0fd3f9ef1 functional: add body for delete_namespaced_service in k8s
The API for delete_namespaced_service requires a body which when
missing will fail the functional tests.

This patch addresses that issue by adding an empty body in order
for the delete to work properly.

Change-Id: I3b4a4bb08f60d9d18368dd3faa84ab1348acb543
Story: #2002589
Task: #28341
2018-12-08 22:16:42 -05:00
Mohammed Naser
d6cc77b16f functional: retrieve cluster to get stack_id
At the moment, if a cluster fails to be created, we fall back to
getting the node information from Heat directly.  However, this
behaviour doesn't work at the moment because `self.cluster` is
a copy of the API record on-create which does not have the stack
ID yet.

This patch makes an extra HTTP request to get the `stack_id` in
order to get the server IPs and be able to pull down the correct
information.

Story: #2002589
Task: #28341
Change-Id: I3fb3542f8ab63f38a23094d579d3df1fcb99a497
2018-12-08 22:16:42 -05:00
Erik Olof Gunnar Andersson
f27bde7171 Add support for www_authenticate_uri in ContextHook
* Added support for www_authenticate_uri in ContextHook.
* Made code path consistent with keystone.py impl.

Story: 2004271
Task: 28073

Change-Id: I7e3f23964a55be3255e87a4c4af7bae0a1415676
2018-12-06 20:07:23 +00:00
Zuul
b095d012e2 Merge "Add Octavia python client for Magnum" 2018-12-04 01:34:06 +00:00
Zuul
ee44e6e9e1 Merge "Make providing a keypair optional" 2018-11-23 15:00:53 +00:00
Mohammed Naser
cf5f78e5be Add iptables -P FORWARD ACCEPT unit
On node reboot, kubelet and kube-proxy set
iptables -P FORWARD DROP which doesn't work with
flannel in the way we use it.
Add a systemd unit to set the rule to ACCEPT after
flannel,docker,kubelet,kube-proxy.

Change-Id: I7f6200a4966fda1cc701749bf1f37ddc492390c5
Co-Authored-By: Spyros Trigazis <spyridon.trigazis@cern.ch>
2018-11-22 16:50:21 -05:00
Jim Bach
8f4643d85c Make providing a keypair optional
A user may not rely on nova-keypairs to access their cluster
such as a preconfigured SSSD.

story: 2004402
task: 28035

Change-Id: I77fbdc174d3dddfd312fb8dac20516314d4c182e
2018-11-21 16:17:46 +00:00
Zuul
b0e114d9d5 Merge "Add support for www_authentication_uri" 2018-11-08 11:52:33 +00:00
Zuul
101af231ea Merge "Cleaned up devstack logging" 2018-11-08 10:44:51 +00:00
Erik Olof Gunnar Andersson
daa7d04951 Cleaned up devstack logging
Switch to systemd logging to take advantage of some of the newer
logging features.

Story: 2004272
Task: 27820

Change-Id: I475bf26e24b3a725f68c7da355807374bf1e189b
2018-11-06 17:16:28 +00:00
Erik Olof Gunnar Andersson
718cb9c9b4 Add support for www_authentication_uri
We do currently not support www_authentication_uri at all, which
is the new standard, as auth_uri has long been deprecated.

* Make sure we support both auth_uri and www_authenticate_uri.
* Switched to www_authenticate_uri for devstack.
* Fixed a bug where a bad exception would be thrown if auth_uri
  was not set.
  
Story: 2004271
Task: 27819

Change-Id: Ibc932d35f3d6ba2ac7ffb6193aa37bd4a3d4422e
2018-11-06 17:13:10 +00:00
Jim Bach
9a6698fb45 Add Octavia python client for Magnum
Adding the client enables the manipulation of Octavia
resources with Magnum such as during cluster deletion,
being able to clean up non-heat created resouces.

Change-Id: I976ab136e24b98d447d61028ce07d0f5dd9d255a
story: 2004259
task: 27795
2018-11-05 11:45:41 -08:00
Lingxian Kong
5d1eab9d9f [K8S] Pass cluster name to controller-manager
The cluster name is useful to identify resources created in different
k8s clusters, especially in the cloud environment, the cluster name is
always injected into the name of the cloud resources(e.g. the load
balancer, volume, etc.), which is helpful for the cluster resource
clean up.

The magnum cluster UUID is used as the value of '--cluster-name' option.

Story: 2004242
Task: 27766
Change-Id: I245a8869948a0b8bfa8d5cc32e7fb9277477026a
2018-11-03 12:34:51 +00:00
Zuul
83fa9d1b4e Merge "Trivial code cleanups" 2018-10-29 14:45:47 +00:00
Zuul
c8019ea77f Merge "Add heat_container_agent_tag label" 2018-10-29 10:59:22 +00:00
Spyros Trigazis
c98e9525c7 Add heat_container_agent_tag label
Add heat_container_agent_tag label to allow users select the
heat-agent tag. Stein default: stein-dev

story: 2003992
task: 26936

Change-Id: I6a8d8dbb2ec7bd4b7d01fa7cd790a8966ea88f73
Signed-off-by: Spyros Trigazis <spyridon.trigazis@cern.ch>
2018-10-24 10:40:55 +02:00
Zuul
ff0dd4aeed Merge "Minor fixes to re-align with Ironic" 2018-10-23 22:04:40 +00:00
Zuul
62a143c1c1 Merge "Add prometheus-monitoring namespace" 2018-10-23 20:37:31 +00:00
Zuul
1abf21da05 Merge "Make master node schedulable with taints" 2018-10-23 17:02:25 +00:00
Julia Kreger
547f9309a1 Minor fixes to re-align with Ironic
Ironic has evolved and a few items were no longer correct
in the contributed scripts for use with ironic.

Additionally a database workaround was fixed, and as such
commented out.

Change-Id: I105791985973e8348d43d41982ac7ba3e0cf970c
2018-10-23 09:34:51 -07:00
Zuul
63fffda026 Merge "[swarm-mode] Remove --live-restore from Docker daemon options" 2018-10-19 10:30:06 +00:00
Tobias Urdin
095b49e6f5 [swarm-mode] Remove --live-restore from Docker daemon options
Ensure the --live-restore is not in the Docker daemon OPTIONS.

Some images has this option by default which will cause the node
not being able to perform it swarm init process.

Change-Id: I287a5274143903fad5d4476e9d1640b26bdb46d4
Story: 2004095
Task: 27497
2018-10-16 17:22:41 +00:00
Feilong Wang
48e2e77406 Update heat-container-agent version tag
Update heat-container-agent version tag to include the multi region
fix.

Task: 27051
Story: 2003992

Change-Id: Ided337dafa52cce771126e96ef41a62a3358fda1
2018-10-16 04:50:04 +00:00
Erik Olof Gunnar Andersson
423d186312 Fixing gate failing due to bad AMQP virtual_host
We are currently hitting this error with the gate.
> NOT_ALLOWED - access to vhost 'None' refused for user 'stackrabbit'

This patch fixes this by using the inbuilt devstack construct
to create an appropriate transport_url.

Change-Id: I9aae96094b7bd8bc148ae3e42c118ba160eff8ae
2018-10-16 01:35:40 +00:00
chestack
05f0cddc46 Make master node schedulable with taints
--register-with-taints take no effect when --register-schedulable=false
configured. It's better to drop --register-schedulable and
leave --register-with-taints to make master schedulable

add --pod-infra-container-image=CONTAINER_INFRA_PREFIX
for kubelet on master nodes.

Change-Id: Ia2ce59841d823ba02a65224088e5af1a8c9610b1
2018-10-08 17:28:35 +08:00
Erik Olof Gunnar Andersson
f2fd732ce2 Trivial code cleanups
Cleaning up comments and logging to make sure they properly adhere
to Openstack standards.

* Consistently use """ instead of ''' for comments.
* Always lazy-load logging parameters.
* Fixed bad log line in cert_manager.

Change-Id: I547f5dfa61609a899aef9b1470be8d8a6d8e4b81
2018-10-02 19:41:34 +00:00
Zuul
348ebc90f5 Merge "Make cover jobs non-voting" 2018-09-24 16:17:47 +00:00
Zuul
53a1840d68 Merge "Use existing templates for cluster-update command" 2018-09-24 14:01:20 +00:00
Spyros Trigazis
3f773f1fd0 Use existing templates for cluster-update command
Cluster update was used for scaling operations only,
but if the heat-temaplates where changed for any reason
(eg upgrade of the magnum server), the stack update command
was destructive.

This patch uses the existing parameter in the stack update call.

story: 1722573
task: 21583

Change-Id: Id84e5d878b21c908021e631514c2c58b3fe8b8b0
2018-09-24 11:17:02 +02:00
Andreas Jaeger
36c99a5129 Make cover jobs non-voting
This job is not ready to be voting yet.

Change-Id: I2f1a2ba5d1fa501ead403f94243f45f8da100097
2018-09-19 10:24:22 +02:00
Jangwon Lee
bc36ef8fb6 Add prometheus-monitoring namespace
When using 'prometheus_monitoring=true' in the label option,
'kube-enable-monitoring.service' in the master node has stuck in
'Wait for Grafana pod and then inject data source'.
It caused the 'prometheus-monitoring' namespace doesn't exist,
so scripts don't create pods about Prometheus and Grafana.

To fix the error, I added codes in 'magnum/drivers/common/templates/
kubernetes/fragments/enable-prometheus-monitoring.sh' to make
'prometheus-monitoring' namespace.

We could put codes in a new file like 'magnum/magnum/drivers/
k8s_coreos_v1/templates/fragments/create-kube-namespace.yaml',
but I think it's ok.

Change-Id: I23395b41919c6f39cfcc2b4480bcd4b040cae031
Task: 26347
Story: 2003697
2018-09-18 09:52:39 +09:00
Zuul
897894189d Merge "add python 3.6 unit test job" 2018-09-14 10:45:18 +00:00
Zuul
a5094adf07 Merge "switch documentation job to new PTI" 2018-09-14 10:39:48 +00:00
Zuul
eebffc8ef1 Merge "Fix unit test failure with python3.6" 2018-09-12 22:29:19 +00:00
qingszhao
bdeed363b2 add python 3.6 unit test job
This is a mechanically generated patch to add a unit test job running
under Python 3.6 as part of the python3-first goal.

See the python3-first goal document for details:
https://governance.openstack.org/tc/goals/stein/python3-first.html

Depends-On: https://review.openstack.org/596861
Change-Id: I5a361dc3b651399042174f183c5c2f46bc26aea1
Story: #2002586
Task: #24308
2018-09-12 20:37:54 +02:00
qingszhao
37231f18b2 switch documentation job to new PTI
This is a mechanically generated patch to switch the documentation
jobs to use the new PTI versions of the jobs as part of the
python3-first goal.

See the python3-first goal document for details:
https://governance.openstack.org/tc/goals/stein/python3-first.html

Change-Id: I3672dad9be3d60d243af9f7bb422f86d9ce87ad4
Story: #2002586
Task: #24308
2018-09-12 20:29:12 +02:00
Zuul
d13957dc5e Merge "Remove fedora-atomic diskimage-builder element" 2018-09-11 15:03:56 +00:00
Zuul
813d149ebd Merge "Docs: Replace non-existing command" 2018-09-10 08:42:01 +00:00
Zuul
dc5ccba016 Merge "Add prometheus & grafana container image tags" 2018-09-10 07:43:43 +00:00