765 Commits

Author SHA1 Message Date
Paul Belanger
a943aa47ac Set DIB_DEBIAN_COMPONENTS: 'main,universe' for ubuntu-minimal
By default the ubuntu-minimal element also include restricted. Because
we don't use restricted in our AFS mirrors we can drop this at
diskimage build time.

Change-Id: I64248182bab7ec46bbdfcb01b097133a6aa28a5b
Signed-off-by: Paul Belanger <pabelanger@redhat.com>
2016-12-29 13:10:01 -05:00
Ian Wienand
e5aa03b98a Use DIB_GRUB_TIMEOUT to set boot timeout
We currently re-run all the grub setup in 99-fix-grub-timeout which
shouldn't really be necessary (actually a little problematic; although
this is dib's fault, see Ibaaa81124098f3c6febe48e455d3e1cd0a5f1761)

Use the new timeout flag to set this in the bootloader element
directly.

I think it is also an advantage that if you build a testing image with
./tools/build_image.sh this is configurable now ... having to fiddle
the bootloader for debugging is something that happens more than you'd
like.

This is supported since dib 1.26.0

Change-Id: Iafc660a9a8c072af6bf1fd5e51c419abccef4d54
2016-12-22 14:15:04 +11:00
Jenkins
7683b46209 Merge "Add Fedora 25 dib image" 2016-12-21 07:40:35 +00:00
Ian Wienand
5199a15518 Add Fedora 25 dib image
Add Fedora 25 dib image.  Local testing has shown good build & boot.

Change-Id: I3565c99f5bd6455172a977b9cf399e967bbdba1f
Depends-On: I9541a1c8f11566198b6fa622e36c4be59d6670d2
2016-12-19 16:46:56 +11:00
Ian Wienand
fea5f33946 Revert "Revert "Revert "Pause diskimage builds for centos-7"""
This reverts commit a86849cede41b101ab1fec4b5ef59eccd9568699.

Yes this is getting silly :) But the latest dib release (1.25.2)
includes the dracut fix I5d203f2abe743cb23a44d449850e692a948e7871
which has been tested and gets this booting again.

Change-Id: Ic83d44d5bf14657cf204cf51297d7db06b28a5f8
2016-12-19 15:17:35 +11:00
Ian Wienand
8401f2bf18 Remove Fedora 23 from nodepool
Remove Fedora 23 from nodepool config

Change-Id: I607f0085aeec2cb6f9c57c7152a58d3c9ce091d9
2016-12-16 08:53:28 +00:00
Ian Wienand
d6e9141c75 Pause & unready Fedora 23 in preparation for removal
Pause and unready Fedora 23 in preparation for removal

Change-Id: I3583a5f0c153b19176c9678ab8635b9aaba06188
2016-12-16 08:53:22 +00:00
Paul Belanger
a86849cede Revert "Revert "Pause diskimage builds for centos-7""
This reverts commit 965ae5acb4199e620df2000d39cec85fcdd37151.

Change-Id: Ia666040fa8df3663eb2320ee3cf581ea7a062e25
2016-12-16 03:55:03 +00:00
Paul Belanger
965ae5acb4 Revert "Pause diskimage builds for centos-7"
We have a new release of diskimage-builder to fix this. Turned out to
be an issue with dracut.

This reverts commit 8fa2c4ddb6209d0cf6f80d3dfd3dde1e8baddc17.

Change-Id: Ib98c9b04d19a29c95be47d45b3ed1a99ca7754a1
Depends-On: Iaf2a1e8470f642bfaaaad3f9b7f26cfc8cc445c9
Signed-off-by: Paul Belanger <pabelanger@redhat.com>
2016-12-15 14:59:29 -05:00
Paul Belanger
8fa2c4ddb6 Pause diskimage builds for centos-7
Our current build of centos-7 is broken, currently still trying to
understand the failure.  Pause diskimage builds so we can roll back to
a working version.

Change-Id: I5369c39b40a4700663587039b9f06d126d1c0977
Signed-off-by: Paul Belanger <pabelanger@redhat.com>
2016-12-14 17:49:47 -05:00
Jenkins
58831b77d2 Merge "Stop caching devstack packages" 2016-12-14 19:32:33 +00:00
Monty Taylor
91d82fed90
Be explicit about not using ipv6 on rackspace
We can't use it until glean supports static ipv6 allocation on centos.

Change-Id: Ia9e3fb8dae68927c684096df558a410a2c41a967
2016-12-14 11:33:49 -06:00
Paul Belanger
239df85cb2 Stop caching devstack packages
After talking with clarkb, we decided it might be time to also stop
caching packages for devstack. Like the cache-bindep patch before, we
have a robust mirror infra in place right now, and believe we are
ready to start using it more.

Change-Id: I249f21a98fea3b963b7ffb8e3d0fce02cc540d46
Signed-off-by: Paul Belanger <pabelanger@redhat.com>
2016-12-14 09:44:13 -05:00
Paul Belanger
097c256f73 Reduce min-ready for ubuntu-trusty to 1
Now that our migration to ubuntu-xenial for jobs is finished, we can
now reduce ubuntu-trusty to 1.  I know this is a little agressive, but
since our time to ready for nodes is 30seconds on most clouds, its
something I wouldn't mind test driving to see how nodepool reacts to
the demand.

Change-Id: I3d0cdbba06a265729670ada6c541b46838f448a5
Signed-off-by: Paul Belanger <pabelanger@redhat.com>
2016-12-10 12:44:59 -05:00
James E. Blair
c2bf94ed3d Switch nodepool validation to zuulv3 branch
We are about to start using this in production.

Change-Id: I97209c8f603725c22ac2c98a750ca1d8f5657a71
2016-12-09 09:54:10 -08:00
Jenkins
931c03bc80 Merge "nodepool: elements: infra-package-needs: Use the openssh-server element" 2016-12-02 08:12:19 +00:00
Jenkins
7fcaf320c7 Merge "safe override of /etc/resolv.conf" 2016-12-01 19:38:49 +00:00
Jenkins
5533a4e24b Merge "Add missing ubuntu-precise lable to OSIC providers" 2016-12-01 09:16:23 +00:00
Jenkins
3f9b312bb1 Merge "Remove 50-cache-pkgs from cache-bindep" 2016-11-30 20:06:20 +00:00
Paul Belanger
eaa0766d11 Add missing ubuntu-precise lable to OSIC providers
Looks like this was skipped in:
  Iaaa83a8b3352ea25384f5e8926d152069b7e6bc7

Change-Id: Ifb9743178e65f33f0c215dbb6244398a9aebba5b
Signed-off-by: Paul Belanger <pabelanger@redhat.com>
2016-11-30 13:13:57 -05:00
Paul Belanger
36463af175 Add ubuntu-xenial-3-node to ovh-bhs1
Change-Id: I41fd78a1933484f9a83718c33eeee0c22c555ab3
Signed-off-by: Paul Belanger <pabelanger@redhat.com>
2016-11-30 13:03:31 -05:00
Paul Belanger
58c39b1714 Bring ovh-bhs1 back online
We've been uploading images to ovh-bhs1 for a while now, and things
looks to be working correctly.  Bring the region back online so we can
use it.

Change-Id: I9c52cc56536031289b79ebf17181f082ead10a1a
Signed-off-by: Paul Belanger <pabelanger@redhat.com>
2016-11-30 12:59:41 -05:00
Jenkins
c8b7d86ed4 Merge "cleanup: remove node-devstack element" 2016-11-30 09:06:02 +00:00
Paul Belanger
8739d7b291 Switch ovh-bhs1 back to qcow2 images
It looks like the upload issue we are having with OVH are not related
to image type. So, switch back to qcow2 to save some bandwidth.

Change-Id: I58df7622b2f3dfd98786db111d68df9df2bf22f7
Signed-off-by: Paul Belanger <pabelanger@redhat.com>
2016-11-29 19:24:06 -05:00
Paul Belanger
4cd0618c05 Remove 50-cache-pkgs from cache-bindep
Today each mirror region has an AFS mirror cache of packaging, as a
result lets try having jobs use it over caching bindep.txt
dependencies on our images.

This should save us about 27mins in diskimage build times for
ubuntu-trusty and ubuntu-xenial.

Change-Id: I74ad0fdbd939948d9285dcd7ef839bdbe299319f
Signed-off-by: Paul Belanger <pabelanger@redhat.com>
2016-11-29 15:41:37 -05:00
venkata anil
d6556852ae Create experimental Neutron DVR+HA multinode job
Adding a three node label to nodepool as we need a three node
setup to test DVR+HA with tempest.
Existing Devstack gate will set agent_mode to 'dvr' in both compute
nodes. So it is still a DVR only multinode setup with 3 nodes.
Change[1] in devstack gate submitted to change one compute node's
agent_mode to dvr_snat, to make it DVR+HA.

[1] https://review.openstack.org/#/c/383827/

Change-Id: I370643277a3b23e7f47e413cf880daa9af1eb831
2016-11-29 16:20:26 +00:00
Paul Belanger
d3886468eb Add zookeeper-servers to nodepool.yaml
This is needed as part of our zuulv3 effort. Specifically, nb01.o.o
will use them.  This will be a noop for zuulv2.

Change-Id: Iabd54fedc8c12bcd3a0fd76b9fc48a93c941bad5
Signed-off-by: Paul Belanger <pabelanger@redhat.com>
2016-11-28 21:53:53 -05:00
Isaac Beckman
7479d1f820 cleanup: remove node-devstack element
node-devstack element is not referenced anymore.
It was planned to remove this element when prepare-node was moved
out of node-devstack
See: https://review.openstack.org/#/c/319030/

Change-Id: Ife1c6849d0d1430215e7dc5e1f8a774b3af8d113
2016-11-27 16:59:43 +02:00
Jenkins
ca8a0c111e Merge "selective caching of git repos" 2016-11-25 20:10:35 +00:00
Isaac Beckman
918a386596 selective caching of git repos
Adding the ability to selectively cache only some git repos in
nodepool slave.
This is useful in some environments where it is needless to cache
all the git repos that appear in gerrit.
For example, in a 3rd party CI environment, each nodepool slave
needs only few openstack projects in order to check commits to
a specific project. So it is needless to cache > 1500 projects
currently in gerrit

Change-Id: Ie7302594b24d2bdcc157d3cf64b1f219e7ef0205
2016-11-23 13:35:29 +02:00
Isaac Beckman
46f0ec6d8a cleanup: remove empty nodepool's element slave-db
slave-db is an empty element.

Change-Id: I05f2aaa982c193e0dca4d911c8c150ab3af33ca6
2016-11-17 16:44:17 +02:00
Markos Chandras
764a5f1447 nodepool: elements: infra-package-needs: Use the openssh-server element
Use the openssh-server element to install the SSH server.

Depends-On: Ide15ee04f5de123dbc8ce4bb56d638d8a167c341
Change-Id: Ie8d81f488f8421d4b2ed227c6f7c6779cca96a9d
2016-11-16 11:56:54 +00:00
Jenkins
1b4bc250cc Merge "cleanup: remove unused scripts used for snapshots" 2016-11-15 15:25:59 +00:00
Monty Taylor
994dcc1b20
Remove meta cantrip from image upload params
os-client-config and shade have contained this as default values for
rackspace for quite some time. There is no need for us to set them
directly on every image in nodepool.yaml.

Change-Id: I134831daa7880778a1f4b9a2acbaed14a0a1d06a
2016-11-14 12:11:44 -06:00
Ian Wienand
854cc3dd7f Remove osic-cloud8
According to Kevin (cloudnull) in IRC, osic-cloud8 has been
decommisioned.  Currently uploads to it fail with 500 errors, so it is
not getting new images.  Remove from nodepool.

Change-Id: Idf87ca142ae549204fa281da1c94727f1b2e4a6d
2016-11-10 15:41:00 +11:00
Jenkins
5ac30c8223 Merge "Stop uploading images to demo european clouds" 2016-11-09 23:44:56 +00:00
Clark Boylan
3859afaccc Stop uploading images to demo european clouds
Image uploads are a thing we struggle with getting done reliably. Reduce
the overhead by removing the BCN keynote demo clouds as we are not using
them in production currently. Hopefully we can readd these clouds in the
future but for now simplify nodepool and remove them.

Change-Id: I0e099bdf9b4e95efd9837b3acb99292239c1a281
2016-11-09 15:27:59 -08:00
Jenkins
76a359875e Merge "Remove 99-install-zuul from nodepool-base element" 2016-11-09 20:45:07 +00:00
Jenkins
e37b895b2f Merge "Fix typos in initialize-urandom.py & gerrit-git-prep.sh" 2016-11-09 08:29:26 +00:00
Ian Wienand
236821a4fd Remove 99-install-zuul from nodepool-base element
This seems to have been here since the beginning of time (with time
being the project-config split).

However, since then, Openstack_project::Slave_common as acquired the
ability to install this same environment
(I290a695c697fb456bee6f8212ba50b6c1b4533fc).

The difference was that this file installed zuul from git, while
puppet was installing from pip.  However, that changed in
If07b31f3a735cf7bcf6bfb8591ed37577f5ae201 and puppet is now installing
zuul from git.  Thus since this now duplicates what's happening in
puppet, I do not believe want or need this.

This element is now breaking the Fedora 24 build when it tries to
overwrite the existing virtualenv already created by puppet.
python::virtualenv creates the virtualenv with a "-p python" argument,
while the second call doesn't, which creates issues with the symlink
layout (see [1] for details).

[1] https://github.com/pypa/virtualenv/issues/976

Change-Id: I7963630c699eaa4984adc6a155bea8f74280cd80
2016-11-09 10:48:14 +11:00
Paul Belanger
e2cec702be Support all 3 repos for UCA mirrors
We incorrectly setup our mirrors for UCA. Now we support 3 openstack
releases.

Change-Id: Ie3a05398d9fdc7a7f7c0c74366a7c4dd70200a2b
Signed-off-by: Paul Belanger <pabelanger@redhat.com>
2016-11-08 12:22:13 -05:00
zhangyanxian
6c28b0b4db Fix typos in initialize-urandom.py & gerrit-git-prep.sh
TrivialFix

Change-Id: I77e9a4202ea7feb9b4ae682237345487ba57a241
2016-11-08 03:57:55 +00:00
Isaac Beckman
56ad977654 safe override of /etc/resolv.conf
No need to override /etc/resolv.conf if "NODEPOOL_STATIC_NAMESERVER_V4"
enviroment variable is not set.

Change-Id: Idf74d394f5a025b885b830d3afdcbad12655101a
2016-11-07 17:00:03 +02:00
Isaac Beckman
3f04bd8071 cleanup: remove unused scripts used for snapshots
This review cleanup scripts that were exclusively used by
snapshot scripts for nodepool which were removed in:
https://review.openstack.org/#/c/331494/

Change-Id: I37900a5d698a43bc0d510100289a5a7ec527021d
2016-11-06 11:43:16 +02:00
Emilien Macchi
066524b6f3 Implement first TripleO 3 nodes job
For complex deployments (eg: High Availability, Network Isolation, etc),
2 nodes are not enough for TripleO as we deploy overcloud on a single
node.  We would like to extend our testing to test more realistic
deployments with one more node for the overcloud.

This patch does 2 things:
- Create centos-7-3-node in nodepool, that will run 2 subnodes.
- Implement experimental (non-voting) TripleO centos-7-3nodes-multinode

Change-Id: Ie204431d9a50dd8247d6393e916c5033ba0499d3
2016-11-03 17:29:42 -04:00
Jenkins
5d5fa20a57 Merge "Remove snapshot scripts for nodepool" 2016-11-03 14:45:01 +00:00
Melvin Hillsman
3e38304262 Disble osic-cloud8
Change-Id: Ic5231961c9d21a076549665bd0947ab077c9f69f
2016-10-31 18:52:30 -05:00
Jeremy Stanley
1447a4d3da Revert "Adding more European clouds"
These quota changes were only for demo purposes, so put
configuration back to our pre-demo state for now. A subsequent
change will add proper quotas for some of these providers again in
the near future.

This reverts commit ed35b7f0b00ea46c5086977d0981eeda3352634e.

Change-Id: I4db1dbab5e1a65cff3108413e259a1bfce4beff0
2016-10-26 07:56:49 +00:00
Jonathan Bryce
ed35b7f0b0 Adding more European clouds
Lowering OSIC quotas and adding more clouds in Europe

Change-Id: Ib5d8f86ba3a163afc777eb6004668eef04500d16
2016-10-25 23:25:03 -07:00
Jeremy Stanley
b03b5c0803 Revert "Adjusting nodepool settings for demo"
This reverts commit 06b69fad78a1a2e69a4857ded9b96479d072bd2d.

Change-Id: I3a21da968b4a4ca895000d1f8826bfbb6cdddf72
2016-10-25 16:54:48 +00:00