80 Commits

Author SHA1 Message Date
Jeffrey Zhang
c31688be36 Make build.py importable lib
First step to break it down is to make it
importable lib rather than self-contained script.

Change-Id: Ibbc924c2849cc79006046f62f31a1909ce959066
Partially-implements: bp build-refactor
2016-06-07 16:40:16 +00:00
Jenkins
d860c7d4ba Merge "Fix kolla-build return codes" 2016-05-31 11:08:39 +00:00
Jenkins
4db24f4900 Merge "Add support for murano binary containers for rpm based distros" 2016-05-27 21:21:16 +00:00
Will Miller
18ae114e75 Fix kolla-build return codes
Add a main wrapper function to return 1 if any images failed to build;
otherwise, return 0. Rename the old main() to run_build(), which still
returns image statuses, to avoid interfering with unit tests.

Change-Id: I5817cc9cebb4f42dc13e0535223e5dc8931a3aab
Co-Authored-By: Mark Goddard <mgoddard@cray.com>
Closes-Bug: #1578404
2016-05-27 06:39:52 -05:00
Swapnil Kulkarni (coolsvap)
9774ca92f8 Add support for murano binary containers for rpm based distros
Change-Id: I0b916d238f28fe1b536abfb01228b24dbabe8b91
Depends-On: If4be00b937e14ec93443dcb7249cf17099d57cbe
Closes-Bug:#1582537
2016-05-25 12:26:39 +00:00
Swapnil Kulkarni (coolsvap)
b60d8bc629 Add support for magnum ubuntu binary containers
Change-Id: I5ad90f96aa58a99765feb2a3bc96157a4a61310f
Depends-On: If4be00b937e14ec93443dcb7249cf17099d57cbe
Closes-Bug:#1582518
2016-05-25 12:25:09 +00:00
Steven Dake
025d57f820 Remove dependencies on kazoo and friends
Since kolla-mesos has been retired, there is no need in the code
base to keep the zookeeper implementation.  As a result, just remove
it.  If we were to keep it we need virtualenvs for that part of the
code base which installs the python dependencies related to it
for from-binary installs.

This just simplifies the implementation tremendously and culls dead
code.

Change-Id: Ieda226e652d67f5b5667112f4f2556f3171366d3
Closes-Bug: #1577194
2016-05-02 06:12:50 -07:00
Swapnil Kulkarni (coolsvap)
240ba96af2 Add Mistral Binary Containers
Added mistral binary containers for rpm based distros.

Change-Id: Ic2de5ee191a4ed3e2ef3083fb4bb480096e9463f
Partially-implements: bp add-mistral-binary
2016-04-13 17:51:12 +00:00
Jeffrey Zhang
7ab705cd4d Add Ubuntu binary build and deploy gate
The Ubuntu Mitaka repo is release, and we have add it.
So it is time to add the Ubuntu binary gate.

Closes-Bug: #1560386
Change-Id: I29d01147595c4ebebfa00798d01d5fd7398123a6
2016-04-02 16:02:58 +00:00
Jeff Peeler
77c657b5a7 Remove ironic images from excluded list
It looks like as far as building goes, the ironic containers are
fine. So if this passes the gate then this should be fine to merge.

TrivialFix

Change-Id: I646ec301304602b5cdca6de75712b7cffde75a9e
2016-03-22 14:03:43 -04:00
Swapnil Kulkarni (coolsvap)
0cca862991 Update gnocchi for centos binary
Gnocchi packages are now available in centos repos[1]
for liberty and the images build.

backport: liberty

Closes-Bug:#1478145
[1] http://mirror.centos.org/centos/7/cloud/x86_64/openstack-liberty/

Change-Id: I957754d4a4e35b026d3e27ee23f33ce2e78592ec
2016-03-10 17:28:06 +05:30
Paul Bourke
80f0890c81 Add new gates for oraclelinux
Change-Id: Ic5c0e266639c8ed76d0af473d076d9ae6749102a
Implements: bp oraclelinux-gate
2016-03-01 15:34:34 +00:00
Allen Gao
235e95885b Move ironic-discoverd to ironic-inspector
Closes-Bug: #1551052
Change-Id: Ic226287bbf1f1e8d5cc2e1d80ce2975448b1f95c
2016-02-29 11:47:52 +08:00
Jeffrey Zhang
72ac7a5541 Reconfigure keystone service
Partially-implements: bp kolla-reconfig

Change-Id: Ied293e59bf4531e88a0e5e5bf9a5f5f495d2a0e7
2016-02-27 02:15:48 +00:00
Jenkins
75343870e3 Merge "Separate exclusion list for source and binary types" 2016-01-26 05:52:06 +00:00
Jenkins
06b16d577d Merge "Convert gate to file backend rather than partition" 2016-01-26 03:04:43 +00:00
Michal Rostecki
dcbfbcd2c8 Separate exclusion list for source and binary types
Separate list of excluded images for source and binary unit
tests.

Change-Id: I4b6032db25c898272491c44c7a06f7cddf7a2298
Closes-Bug: #1487252
2016-01-26 00:48:44 +00:00
Jenkins
daec36e477 Merge "Add binary support for Manila container" 2016-01-22 15:33:36 +00:00
Marc Koderer
b4ebaa50e2 Add binary support for Manila container
Change-Id: Iea77fa26c17e120b5c0487eca8a76972281ee99a
Partially-Implements: blueprint enable-manila-containers
2016-01-22 09:05:06 +01:00
SamYaple
6adb5c0aa5 Convert gate to file backend rather than partition
The existing gate partitioned a disk for use with docker, depending
on the gate it would use the swap disk (RAX) or a spare disk (HP).
However, with the new gates (Bluebox + OVH) there is neither a spare
disk nor a swap disk. This leaves us with one choice: File based loop
device.

This patch creates a file at /swapfile to ensure we have swap. It
creates a file at /docker to ensure we have a loop device for Docker.

Right now the /docker file is 10GB and the /swapfile is 4GB due to
size limitations in the gate across all servers and types. This has
proven to be enough space for all our current tests.

Additionally, reduce the number of threads the gate uses to 4 to
prevent the lockup and hour timeout we have been seeing as more
recently in the gate.

The scripts that setup the gate are moved to the tools directory
rather than the tests directory to match the structure of the other
projects.

Partially-Implements: blueprint functional-testing-gate

Change-Id: I3e370f2382b6df36103d8b2ceda9b21d9b4229d5
2016-01-21 22:59:13 +00:00
Allen Gao
cf47e7708c Update docker-py reqs in gate setup
TrivialFix

Change-Id: Idb0447a94a730fbcd822a855c865074817dd11b3
2016-01-20 16:39:58 +08:00
Jenkins
5bce0212b2 Merge "add unittest code base" 2016-01-19 09:50:56 +00:00
Marc Koderer
f7085c1f6f Add manila container (source only)
Support manila as container. First step only supports
building from source.

Change-Id: I60bb67536c9afdb9f0532b3cdc2c400a68608003
Partially-Implements: blueprint enable-manila-containers
2016-01-18 20:33:32 +00:00
Jeffrey Zhang
d4490ea2bc add unittest code base
* add a base TestCase class
* load the tests from the project root rather than only tests dir
* add a test case for WorkerThread builder function

Change-Id: Icf878f9249b475a311123c8235c42b1212d02ca6
Partially-implements: bp add-ut-codebase
2016-01-18 11:42:00 +00:00
Jenkins
4ada6219d3 Merge "Add some additional debug to gate" 2016-01-13 20:20:34 +00:00
Jeffrey Zhang
67e4607d43 Add py27 py34 pypy unittest
Change-Id: Iaf58463bd156924839062b8284a2d7151a153db5
2016-01-13 13:47:49 +08:00
SamYaple
8c5cd011a7 Add some additional debug to gate
This info won't affect gate output as all info is logged to a file.

TrivialFix

Change-Id: Id92c1ebc60937fb376c69541d2f308a9d711c85e
2016-01-12 20:52:58 +00:00
Jeffrey Zhang
781eefeccf Remove the kolla-build.conf
use tox -e genconfig to generate this file

DocImpact

Closes-Bug: #1531202
Change-Id: I3a6e57c3cc48aeb3a45a055b173207ea6e214960
2016-01-07 21:06:22 +08:00
yangyapeng
ff721bb764 Fix grammatical mistake, Changed character from "an" to "a"
Change-Id: I407793db93ce002cb88bb04193b46869e26d63bc
2016-01-04 13:00:25 -05:00
SamYaple
6ca65aba6c Unblock Docker pinning in gate
Docker and docker-py can now be unpinned since Kolla has been
converted to using the kolla_docker module and we no longer rely on
upstream to unblock us.

Change-Id: I6ee2b78c31ef0447da6154b75db381d5cdd55ab6
Partially-Implements: blueprint kolla-docker-module
2016-01-03 16:44:44 +00:00
Jenkins
91a655105f Merge "Python 3 deprecated the logger.warn method in favor of warning" 2015-12-31 07:45:06 +00:00
Jenkins
1a3e284c2b Merge "Make the logging more safe" 2015-12-31 02:16:27 +00:00
Jeffrey Zhang
991be99c89 Make the logging more safe
TrivialFix

Change-Id: I72c541c1846e503486b402e88d5b29364920fc83
2015-12-30 15:11:43 +08:00
Wanlong Gao
2fde87a0e9 Python 3 deprecated the logger.warn method in favor of warning
Python 3 deprecated the logger.warn method, see:
https://docs.python.org/3/library/logging.html#logging.warning, so we
prefer to use warning to avoid DeprecationWarning.

Change-Id: Ic4e07276def17ef39764601c8a7e0991f9a4efbc
Closes-Bug: 1508442
2015-12-29 14:40:01 +08:00
hparekh
f36b5aef71 Added dockerfiles for mistral.
Change-Id: Ie74a91dccf654da9305722d14af2f0a893dbaaff
Partially-implements: blueprint enable-mistral-container
2015-12-28 02:03:22 +00:00
Jenkins
987ae1af77 Merge "Skip gate FS optimization if no secondary disk" 2015-12-14 09:42:33 +00:00
Martin André
6190411d19 Improve ansible deployment failure reporting
Change-Id: I73395afa2a2d8f3dc835e010e3b1959ec725da2a
Closes-Bug: #1525102
Co-Authored-By: Paul Bourke <paul.bourke@oracle.com>
2015-12-11 16:48:14 +09:00
Martin André
40b8a0243e Skip gate FS optimization if no secondary disk
This commit removes the assumption that all gate nodes have a secondary
disk, and skip tuning the filesystem if the node doesn't have one.

This fixes gate failures on OVH nodes.

Closes-Bug: #1525047

Change-Id: Ief22f34b32caf7a8b446df888fc5cc1964ad272e
2015-12-11 15:31:35 +09:00
Jenkins
939b464d12 Merge "Add support for copying files from a "zk://" source" 2015-12-04 17:04:59 +00:00
Artur Zarzycki
dc2ad7d134 Set docker api version to auto
Change-Id: I25d957a2368fa4e52b5fa9253d7ea5ec4046d830
Closes-Bug: #1521949
2015-12-03 11:28:21 +01:00
Angus Salkeld
27c0ae0624 Add support for copying files from a "zk://" source
Co-Authored-By: Michal Rostecki <mrostecki@mirantis.com>
Implements: blueprint zookeeper

Change-Id: I176f063d3802716846b921e210c1569d28bd90d8
2015-12-02 10:25:43 +01:00
Sam Yaple
f9ee96f216 Convert gate to Ansible setup
To support multinode we must now distribute our setup to multiple
hosts. Instead of making special rules for this, we are going to
convert our existing setup to Ansible. This way both setup proceedures
take place in the exact same fashion.

Partially-Implements: blueprint multinode-gate
Change-Id: I43ece298bba994e9b5083403ef3cf6d4245cda6d
2015-11-22 18:34:35 +00:00
David Moreau Simard
a13a25b402 Dynamically find the extra partitioned block device
This provides support for using loopback devices for the extra
disk.

Change-Id: Ia61b32e27ba619d15860daa6a9ed75291dad1d06
Closes-bug: #1518641
2015-11-21 20:06:53 -05:00
Angus Salkeld
2f1c00a467 Add support for loading kolla config from ENV
Implements: blueprint zookeeper

Change-Id: Ibabcb5d6d304be9290633338c513f16651d4479a
2015-11-17 07:51:32 +00:00
Michal Rostecki
eb0d0cdc9e Add Python 3.x support
Implements: blueprint python3

Change-Id: I1e02568907aa38dd0efcb428235004ce47d73af8
2015-11-16 20:36:47 +01:00
Jenkins
3768a54ed7 Merge "We now have a logs publisher" 2015-11-10 16:12:43 +00:00
Angus Salkeld
1af722eb49 Add a test case for load_config
This is just a basic test to make sure loading from file works.

Change-Id: I074f36023ac4198c436fcee1668d32f9d1f0e61b
2015-11-10 13:37:51 +10:00
Sam Yaple
4a7cd7063f We now have a logs publisher
We need to create a directory to allow publishing of logs.

Change-Id: Ieeac5d236b698bedaccb8b5f0bb16f0de9df9386
Backport: Liberty
Partially-Implements: blueprint multinode-gate
2015-11-09 10:59:15 +00:00
Sam Yaple
3d7a0c6f55 Restrucutre gate scripts
So we can respect DRY and share as much code as possible I have broken
out the common code between the aio and multinode gate scripts.

Additionally, this lays the ground work for removing our policy on
root-everywhere by using sudo. Once we get the non-root stuff worked
out we can gate as non-root user.

Change-Id: I781c597ab10f2296b95f51ae27e0fa617ffe0a66
Partially-Implements: blueprint multinode-gate
2015-11-05 10:58:29 +00:00
Sam Yaple
e65392aefb Adjust gate btrfs setup
This is in preperation for the DinD gate.

Change-Id: I2d2489df00808824f957ed0e3aa3a44496ff7e3e
Partially-Implements: blueprint multinode-gate
2015-11-05 02:27:19 +00:00