Commit Graph

113 Commits (c98e9525c7db34734afb29d1b9fb409a08d16ef7)

Author SHA1 Message Date
Spyros Trigazis d95ba4d1ff Run etcd and flanneld in a system container
In Fedora Atomic 27 etcd and flanneld are removed from the base image.
Install them as a system containers.

* update docker-storage configuration
* add etcd and flannel tags as labels

Change-Id: I2103c7c3d50f4b68ddc11abff72bc9e3f22839f3
Closes-Bug: #1735381
2018-02-22 12:30:27 +00:00
yatin 553316e40f Fix: functional CI Jobs
After [1] jobs are return false(SUCCESS) status due
to wrong EXIT_CODE.
After [2] kubernetes client is updated to v4.0.0 and
no longer contains ConfiugrationObject so we need create
instance of Configuration class.

Also don't use local to create variable as local
 can only be used in a function.

[1] https://review.openstack.org/#/c/526618/
[2] https://review.openstack.org/#/c/528406

Change-Id: Ida5aac40b234a358b2a13b2e51a41d0242031ebb
2018-01-11 12:50:25 +00:00
Zuul 3a5997eef2 Merge "Remove intree magnum tempest plugin" 2017-12-27 05:20:52 +00:00
Spyros Trigazis 273405cb5a Leverage heat-container-agent for monitoring
Use the heat-container-agent from a system container.
It means that the docker daemon can be started later.

Pass as a software deployment with the heat-agent the following
software-configurations:
* prometheus-monitoring
** pin prometheus to v1.8.2 since its config is not 2.0.0
   compatible

Add heat-container-agent container image.

Implements: blueprint heat-agent
Related-Bug: #1680900
Change-Id: I084b7fe51eddb7b36c74f9fe76cda37e8b48f646
2017-12-17 16:35:50 +00:00
Chandan Kumar 53fa3accea Remove intree magnum tempest plugin
* It removes magnum tempest plugin reference in favour of using
  newly magnum-tempest-plugin.
* We removed tempest tests resides under functional.api.v1.test-*
  files as they are tempest tests and keeping the rest as they are
  used by functional tests.

Depends-On: Ibdddd26da9cfb0d08c2977660320b2c052d7261b
Change-Id: Ida2fa1ef5880ebead787e3b27ac7ebf5aa498f62
2017-12-14 15:48:47 +05:30
yatin 0b49f38069 Migrate to Zuul v3
Change-Id: I0d5d6a9038c9a150a74df955bccb3f9ed263b736
2017-10-10 14:29:04 +00:00
Mathieu Velten d003e80a3a Launch k8s scheduler & controller-manager as system containers
Following up of https://review.openstack.org/#/c/487357

Depends-On: I22918c0b06ca34d96ee68ac43fabcd5c0b281950
Implements: blueprint run-kube-as-container

Change-Id: I9a7d00cddb456b885b6de28cfb3d33d2e16cc348
2017-08-22 14:01:43 +02:00
Spyros Trigazis 4fb91cc109 tests: Use swarm-mode for api tests
* Swarm-mode is the fastest cluster to deploy since it doesn't
  require to pull anything from outside.
* Add the output nodes for swarm-mode too.
* Disable copy logs (I think a better practice is to copy logs
  on demand).
* Don't run test_create_list_sign_delete_clusters, because it is
  very unstable on the CI.

Partially-Implements: blueprint swarm-mode-support

2nd commit message:

Update to Fedora Atomic 26

This patch moves the current master to test against Fedora Atomic 26,
in addition, it switches to downloading from Fedora mirrors.

2nd-Change-Id: I9a97c0eb78b2c9d10e8be1501babb19e73ee70c1

3rd commit message:

Set default iptables FORWARD policy to ACCEPT

With the release of Docker 1.13 which is available in Fedora
Atomic 26, it no longer sets the policy of the FORWARD chain
to ACCEPT[1].  Therefore, CNI networking such as Flannel will
cease to work.

This patch sets the policy to ACCEPT so that traffic can work
once again for deployments which are based on Docker versions
which are newer than 1.13

[1]: https://github.com/moby/moby/pull/28257

3rd-Change-Id: I1457602748619f38f87542fc01a2996ee80e58b7
Closes-Bug: #1708454

Co-Authored-By: Mohammed Naser <mnaser@vexxhost.com>
Change-Id: I86d4dcc94fff622be4ee2acc8dd60ed81bc5d433
2017-08-21 05:30:09 +00:00
yatin 8623776813 Copy service configurations also
This will help in verification of configuration and
troubleshooting ci failures

Change-Id: I81484c507781a8c96f95bc19f7afc591bc01827b
2017-08-16 09:50:07 +00:00
Jenkins a64e8ec4f8 Merge "[Fix ironic gate] Use IP_VERSION=4 in devstack local.conf" 2017-07-19 12:10:26 +00:00
Spyros Trigazis b4386f83ad Add swarm-mode driver
* add swarm-mode config
* remove etcd, flannel, discovery_url, swift_registry
* add swarm-mode COE obj
* add functional test, create cluster, create/remove
  service and delete cluster.

Co-Authored-By: ArchiFleKs <kevin.lefevre@osones.io>
Implements: blueprint swarm-mode-support
Change-Id: Iba177be167cb3a3866441d5f42670171f26c5a86
2017-07-18 10:47:23 +02:00
yatin 4b9e8db8a5 [Fix ironic gate] Use IP_VERSION=4 in devstack local.conf
Ironic to work with magnum, requires devstack to be
configured with IP_VERSION=4.

Change-Id: I263373db15bff77405d7509e0d1f94316c4f0cfd
2017-07-17 06:58:37 +00:00
Jenkins e1c9e15e3d Merge "ci: Remove *_ssh ironic drivers" 2017-07-14 15:50:19 +00:00
Yasemin Demiral bd46372093 Use 'sudo' to access /etc/sysconfig/heat-params
The patch https://review.openstack.org/#/c/437048/ changed the
permission of /etc/sysconfig/heat-params to 600, so non-file owners
would require use of 'sudo' in order to access the file. This patch
fixes it

Closes-Bug: #1704076
Change-Id: I8bb4a12deb92fa5035bbbb8fc6ce4736ed99ea78
2017-07-13 13:27:20 +03:00
Spyros Trigazis 4fdee1f6c4 ci: Remove *_ssh ironic drivers
Mitaka branch is EOLed. The Ironic team is going to proceed with
removal of SSH-based power and management drivers for virtualized
HW which were deprecated back in newton release.

http://lists.openstack.org/pipermail/openstack-dev/2017-July/119284.html

Change-Id: I7351573a20f3835f481ab1973b6439d8ca2b8f60
2017-07-06 11:04:16 +02:00
Jenkins 8ac9ce828a Merge "Ignore: Try pxe_ipmitool since vbmc is used" 2017-05-20 19:20:35 +00:00
yatin ecded75c32 Ignore: Try pxe_ipmitool since vbmc is used
k8s-ironic jobs are failing since long, pxe_ssh is deprecated,
so try pxe_ipmitool.

Change-Id: I48ba8ba4d10a616eb7b482e48ed4a83c3d0acf09
2017-05-19 17:15:17 +05:30
yatin 34efcdfcaf Use 'virt_type=kvm' in devstack vm if supported
If the devstack vm supports nested virtualization we should
use it.
This can done using by setting: DEVSTACK_GATE_LIBVIRT_TYPE=kvm.
This will increase the performance in gate jobs.

Change-Id: I2439de036dfec2ada3c92c2d4b71c73b5f41a518
2017-05-17 21:37:20 +05:30
Spyros Trigazis 1aa638903c CI: multinode job with larger flavors
Set cluster node flavors to:
* ram: 3750
* disk: 20
* vcpus: 2

Change-Id: I1eb2487e16866fa1ae26943dbeca0380eb10e947
2017-05-09 15:41:50 +00:00
yatin 530d225fcd Fix keystone auth_uri and auth_url
Post [1] we cannot use auth_uri/auth_url containing :5000, :35357.

Update keystone auth_uri and auth_url in magnum.conf to connect
with keystone using /identity/v3 and /identity_admin/v3.

[1] https://review.openstack.org/#/c/456344/

Change-Id: I5d69e7454cf8a5e8c92ff23b6c932184d82e8a98

devstack: Allow access to ports 80 and 443

So far, we were allowing access to port 5000 for keystone.
When devstack siwtched to uwsgi we couldn't access keystone
anymore.

Co-Authored-By: Spyros Trigazis <strigazi@gmail.com>
Change-Id: I4d3d482889fd9f6119ceec81757abac9d1251a97
2017-04-27 04:22:55 +00:00
Jenkins de8567d054 Merge "Update Fedora images" 2017-04-12 11:00:39 +00:00
Spyros Trigazis 2b83962cad Fix gate: Revert mesos image to ocata
Revert the ubuntu-mesos to ocata to unblock the mesos job.

Change-Id: I145e0e15dc93923b93144682839e8fa9d24772db
2017-04-06 18:24:21 +02:00
Spyros Trigazis c5a4a18104 Update Fedora images
New release of Fedora Atomic [1].
The new release of Fedora Ironic includes the same
packages.

Main changes:
Kubernetes 1.5.3
etcd 3.1.3
Plus several fixes and version bumps.

Add :Z when mounting certs in the swarm containers to set
selinux labels properly.

[1] http://www.projectatomic.io/blog/2017/03/fedora_atomic_mar28/

Closes-Bug: #1677664

Change-Id: I2539ae83401db5b34716ebd4bbdfbe288f5c768b
2017-04-03 08:52:12 +02:00
Spyros Trigazis 2910809fab ci: Rename ssh key
For multinode jobs a key with the default name id_rsa already
exists. Add a key for magnum named id_rsa_magnum.

Co-Authored-By: yatinkarel <yatin.karel@nectechnologies.in>
Change-Id: I343e27a6e7311d7d0033bc089293f945c3af2ef8
2017-03-27 17:40:49 +02:00
trilliams 3a9e8cfb40 Glance v1 is deprecated and removed in devstack [1]
With this patch we will use glance v2 api's for interacting
with glance.

[1] I7f962a07317cdad917ee896d79e49ee18938d074

Closes-Bug: 1672535

Change-Id: Iedc25b55ad2751e14d3794b1cb80f724f1a735c4
2017-03-14 16:51:08 +05:30
yatinkarel bfa10bf202 Fix: mesos gate tests
Recent change in Infra [1] makes use of local.conf instead of
localrc. Use DEVSTACK_LOCAL_CONFIG to pass the MAGNUM_IMAGE_URL.

[1] https://review.openstack.org/#/c/326585/

Change-Id: I0426cd0aba64a3f4cc595a0919320adbbc86d5f0
2017-02-24 09:55:30 -05:00
Jenkins f7386549dc Merge "[k8s] Get logs of controller-manager and scheduler" 2017-02-10 09:35:49 +00:00
Spyros Trigazis 0d58cf4dbe [mesos] Use latest build for mesos image
After changes in the heat-agents [1] the auth calls of the nodes
to heat were failing. The mesos image that was used was missing
chnage [1].

Update to ubuntu-mesos daily builds.

[1] https://review.openstack.org/#/c/397232/1

Closes-Bug: #1662280
Change-Id: I06ab3f7a92f06a7eddf297c5ecd2bf2e35f3728b
2017-02-06 19:00:21 +01:00
Spyros Trigazis d4effea503 [k8s] Get logs of controller-manager and scheduler
Get the pod logs for controller-manager and scheduler.

The current copy logs from journalctl because controller-manager
and scheduler used to be managed by systemd.

Change-Id: I1e4e5a810f838cc59d4a4aaa4fc4478541872b0b
2017-01-30 15:06:58 +01:00
Spyros Trigazis d2532a3af2 Upgrade to Fedora 25
Atomic image contains:
kubernetes-1.5.2-2.fc25.x86_64
docker-1.12.6-5.git037a2f5.fc25.x86_64
flannel-0.5.5-8.fc25.x86_64
etcd-3.0.15-1.fc25.x86_64

The ironic image contains exactly the same packages.

* For this upgrade the upstream image is used, which is
  uploaded here [1].
* Minor changes for flannel and docker-storage-setup
  were needed.
* The image will be built in the CI and uploaded to
  tarballs.openstack.org as soon as possible.
* Ironic image [2].

Notes:
* docker-storage-setup config changes were needed because in
  the previous images it was disabled and it was started by us.
* We can have selinux enables in containers since the images
  have kernel 4.9.x.

[1] https://fedorapeople.org/groups/magnum/fedora-atomic-25-latest.qcow2
[2] https://fedorapeople.org/groups/magnum/fedora-25-kubernetes-ironic.tar.gz

Change-Id: Iac6e30c530821a49a5c3978e335e0b1d56a576e0
2017-01-26 15:40:34 +01:00
Mathieu Velten 287f794013 CI: Increase master-flavor size
One limitation that we might be facing when try to run large
containers like hyperkube is is the size of the master node
flavor. Increase the master flavor memory to 1024 mb.

Change-Id: Ie095d8de290343dc995fbcd88445509cc36579bc
2017-01-11 16:38:26 +01:00
prameswar 5cd4ade6ef used openstack cli in magnum devstack plugin
Currently magnum CI tests(magnum/tests/contrib/post_test_hook.sh) uses
python clients(nova,neutron, glance) for openstack operations.
We should start using openstack client instead.

Closes-Bug: #1653875

Change-Id: I00aab79ccf3e267be77115a8847d72c8f6e32075
2017-01-07 04:58:49 +00:00
Mathieu Velten dfac6e88b9 Change gate Fedora Atomic image to the automated f24 build
The new image includes:
kubernetes-1.2.0-0.26.git4a3f9c5.fc24.x86_64
docker-1.10.3-26.git1ecb834.fc24.x86_64
etcd-2.2.5-5.fc24.x86_64
flannel-0.5.5-6.fc24.x86_64

Change-Id: I5bf6c5ce775d937cc656d4da678ce2a2a33c9dab
2016-12-12 17:55:35 +01:00
Monty Taylor ff6514f5bc
Disable horizon, ceilomter and swift in gate hook
If the services are disabled in the devstack/settings file, it disables
them for everyone who uses the magnum devstack plugin. Some people (like
shade) use both magnum and swift to test things. Putting this in the
gate hook means it's used in all of magnum's jobs, but not in other
people's jobs.

Change-Id: Icd82a4ab68533f39f967575c2125b0f61c70e0a6
2016-12-09 13:44:27 -06:00
Jenkins 5ede934aaf Merge "Disable horizon, swift and ceilometer" 2016-12-09 14:10:15 +00:00
Jenkins 6db2ab0568 Merge "functional: don't create flavors if ironic testing" 2016-12-07 18:51:51 +00:00
Spyros Trigazis 67d71104bb Disable horizon, swift and ceilometer
Swift Ceilometer and horizon are not used. Disabling them
it will give us space.

Cleanup disabling of octavia and neutron/lbaas.

Closes-Bug: #1646870
Closes-Bug: #1648148
Change-Id: I4b177421f0eb0a058b8927b9d2dd12865d3c920e
2016-12-07 17:36:12 +01:00
Eli Qiao 2aebf8a66e functional: don't create flavors if ironic testing
For ironic driver functional testing on gate only a flavor named
"baremetal" is required which is already created by ironic devstack. So,
creation of flavors "m1.small" and "s1.small" should be skipped for
ironic driver functional testing.

Change-Id: Ia8643f9c041f91dcb08ab8b6011be7be1fdf0311
2016-12-06 07:16:22 +00:00
Spyros Trigazis 1f81a4e5df Use keystone v3 for functional tests
* Update functional_creds.conf.sample
* and functional_creds.conf in post_gate_hook
* Update python_client_base to use keystone v3 credentials
* Get magnum_url from magnum.conf

Closes-Bug: #1474152
Change-Id: If1ce6e77396857fef68c5c288f0b1c7fecb0b4d4
2016-12-05 15:21:09 +01:00
Spyros Trigazis 04cb27c580 Disable lbaas from ci tests
Disable lbaas and octavia since we run only non lbaas tests.

Change-Id: Ib7ba661987e609e87b9239cf2c23c29485dc24a5
Partial-Bug: #1646870
2016-12-02 17:19:08 +01:00
maliki 07f9e027d5 Add insecure option in functional tests for SSL endpoints
This patch fixes the issue when functional tests are run
against a deployment that has https based endpoints.
The insecure option is not being passed when initiating
magnumclient or keystoneclient as a result we get SSL
error.

Change-Id: I35525917b96b64e57c984924c72b3c696949f67f
Closes-Bug: #1640341
2016-11-09 21:49:11 -08:00
Hongbin Lu 31d04e312d Update name of ubuntu-mesos image
Update the gate and docs to use "ubuntu-mesos-latest" instead of
"ubuntu-14.04.3-mesos-0.25.0.qcow2". The intent is to make the
image upgrade easier (by using a static image name). In fedorapeople,
a soft link was created from "ubuntu-mesos-latest.qcow2" to
"ubuntu-14.04.3-mesos-0.25.0.qcow2"

Change-Id: I544773d184e5436843595dbfd9ab118b99870281
2016-09-21 14:14:31 -05:00
OTSUKA, Yuanying 38059d53f9 Fix the order of enabling devstack plugin
The order of enabling devstack plugin is important if project
has dependency of other projects.
Magnum has some dependency of projects, so this patch fixes
the order of enabling plugin.

Change-Id: I733e061fab4ed40fd00bfb017d9c2835c49f6a8f
2016-09-15 17:16:59 +09:00
rabi 719018e9cb Use heat devstack plugin
Now that heat is available as a devstack plugin, we should
use it. In-tree devstack code for heat is planned to be
removed soon[1].

And also, this patch remove `update_heat_policy` function
in devstack plugin. Because fetching global stack list is
already option to use in Magnum.

[1] https://review.openstack.org/#/c/317618/

Change-Id: Iab675da5ea8d02b3f7e71f6169c81724a0066858
Co-Authored-By: OTSUKA, Yuanying <yuanying@fraction.​jp>
2016-09-15 10:43:09 +09:00
Spyros Trigazis 8b354e3e10 Disable lbaas on k8s-ironic job
Proper functionality with lbaas and ironic couldn't
be verified and the infra job was failing.

Disable lbaas on the ironic driver for now.

Change-Id: I2518bb57e44eb71bd26faad4a3af19fa0e9e75f4
Partially-Implements: blueprint magnum-lbaasv2-support
2016-09-09 06:57:01 +00:00
Hua Wang 77e6c3160f Add Support of LBaaS v2 API
LBaaS v1 api is completely removed by neutron, so it
cannot be used now. Added Support of LBaaS v2 API.
Now all COE's uses LBaaS v2.

Co-Authored-By: yatin karel <yatin.karel@nectechnologies.in>
Change-Id: Idbccbe1065857449fc8e158115b7833b68c2da9f
Partially-Implements: blueprint magnum-lbaasv2-support
2016-09-09 10:01:30 +05:30
Jenkins 4548b310e5 Merge "Rename Bay DB, Object, and internal usage to Cluster" 2016-09-09 00:23:25 +00:00
Jaycen Grant 729c2d0ab4 Rename Bay DB, Object, and internal usage to Cluster
This is patch 3 of 3 to change the internal usage of the terms
Bay and BayModel.  This patch updates Bay to Cluster in DB and
Object as well as all the usages.  No functionality should be
changed by this patch, just naming and db updates.

Change-Id: Ife04b0f944ded03ca932d70e09e6766d09cf5d9f
Implements: blueprint rename-bay-to-cluster
2016-09-08 13:01:12 -07:00
Spyros Trigazis 1ddcafc536 Update fedora image for ironic driver
Only fedora 24 is the default release used in the
fedora-minimal elements. [1]

[1] I0ac0d0767d4de9d28ae86d1344fd7c9d8876e5a1

Change-Id: I089baf0105b68bcd13aa86fb683c6d240e560107
2016-09-06 15:10:08 +02:00
Thomas Bechtold 52224c5c09 Simplify test_create_list_sign_delete_clusters() tempest test
The test needs a valid CSR which was created in the devstack post_test_hook
in a static way (always the same CSR).
This commit simplifies the process and just adds the CSR to the test itself
so that the CSR string can be used to check the CSR. That way there is no need
to provide a file with the CSR content and point the tempest configuration
via the "csr_location" parameter to that file.
So the "csr_location" parameter is now deprecated for removal.
Also remove the unused "invalid.csr" which was also created in the
post_test_hook.

Change-Id: I907130576cfb59267643b4639681331acfcfa07f
2016-08-22 10:56:43 +02:00