83 Commits

Author SHA1 Message Date
Clark Boylan
60f352bfce Use infra-root-keys-2020-05-13 in nodepool
This should only be landed once we've landed the dependency and
confirmed all clouds have the new key value.

This does our semi regular key rotation.

Depends-On: https://review.opendev.org/727865
Change-Id: Ic55c96ad5dd867b70fa52c396e792d5a2e2e0470
2020-05-18 08:52:19 -07:00
Ian Wienand
9e38d47f8e Stop building opensuse-15-plain images
Depends-On: https://review.opendev.org/725750
Change-Id: I36efdede5c3feccb90e470590da146c0be406814
2020-05-07 21:18:47 +02:00
Ian Wienand
59e06614c1 Activate more plain nodes
These are for testing nodes without pip-and-virtualenv.  They have
built correctly and can be used.

Change-Id: I1d7a78dc6bf2b225098195b22974ebe2a0d9af6d
2020-04-28 12:58:12 +10:00
Dr. Jens Harbott
d14b65cf46 Launch focal nodes
Focal images were built with [0] and the result looks successful, so
let's start launching them.

[0] https://review.opendev.org/720719

Change-Id: I2b825178df230d13d75e782c60dd247e6d65ac8b
2020-04-26 11:56:28 +00:00
Ian Wienand
378161469b Add Fedora 31 to launchers
Images are built and seem ready to go

Change-Id: I9677af7e15d8b6c561f9f2dc5ed968a6708dd93e
2020-04-03 08:34:52 +11:00
Ian Wienand
7602343b6a nodepool-elements: Use venv for utilities
Since all platforms have Python 3, use the new ensure-venv element
from the dependent change to install bindep and os-testr.

Since we are no longer using pip to install anything during the
builder, this drops the dependency on pip-and-virtualenv from
nodepool-base.  Avoiding this element is our long-term goal, as it's
modification to system state are problematic in a number of ways.  To
maintain the status-quo, the pip-and-virtualenv element is added
explicitly to each build's element list, with a note on it's future.

The current plan for backwards compatability is to replicate the
environment pip-and-virtualenv provides in a base role/job that can be
optionally included.  To test this, provide a new node type
"ubuntu-bionic-plain" that will not include the pip-and-virtualenv
element.  This is put on just one provider (rax) to minimise impact.

The dependent-change (and a dib release) is required before merge so
the ensure-venv element is available.

Depends-On: https://review.opendev.org/707513
Change-Id: I85438baf5bb31790a56fe5b38327361f0a2398e9
2020-03-11 10:12:00 +11:00
Andreas Jaeger
dc09dffbe2 Remove Fedora 29 from nodepool
All jobs using Fedora 29 have been removed, we can remove it from
nodepool and thus OpenDev now.

Depends-On: https://review.opendev.org/711969
Change-Id: I75c0713d164c29a47db9a0cdfc43fadb370e81f8
2020-03-10 10:50:37 +01:00
Andreas Jaeger
398adb791f Bye, Bye, Trusty
This removes trusty from the repo and thus from OpenDev.

Afterwards the AFS volume mirror.wheel.trustyx64 can be deleted.

Depends-On: https://review.opendev.org/702771
Depends-On: https://review.opendev.org/702818
Change-Id: I3fa4c26b0c8aeacf1af76f9046ea98edb2fcdbd0
2020-01-19 16:00:55 +01:00
Clark Boylan
88dcfdb488 Remove opensuse-150
The opensuse-150 image is being removed as the 15.0 release is EOL.
Similar to centos the expectation is that users keep up to date with
minor releases. For this we have the opensuse-15 image which should be
used instead.

Depends-On: https://review.opendev.org/#/c/682844/
Change-Id: I8db99f8f2fd4b1b7b9a5e06148ca2dc185ed682b
2019-11-12 12:06:49 -08:00
Sorin Sbarnea
a7cda9f926 Bump min-ready for ubuntu-bionic
Flip the min ready values for Xenial and Bionic. This should've been
done when we did the initial transition from Xenial to Bionic but was
missed. We want to have ready nodes for the common up to date ubuntu
platform (Bionic) and don't as many on the previous release (Xenial).

Thank you to zbr for catching this after noticing that linter jobs took
a while to start.

Change-Id: I5e2c4b6a056b50077ab343535a4bbe3bc49a0acf
2019-10-25 22:21:49 +00:00
Ian Wienand
b4daf4e47b Remove fedora-28 nodes
The time has come to retire fedora-28; remove from configuration.

Change-Id: Ic0b4b065a217dcfaa8c230cda53114793e93b803
2019-10-23 09:38:40 +11:00
Ian Wienand
00d8bb0587 Stop building Fedora 28, turn down min-ready
In preparation for removal

Change-Id: I4d9fbc9c8f946cb20efca2b742476db2c1b4b5ff
2019-10-23 09:35:09 +11:00
James E. Blair
19380c9b59 Remove opensuse-423 from nodepool
This label/image is no longer supported.

Change-Id: Ic48d7db4c6b7b1dd2589118c630f45deee19730f
2019-10-16 07:50:22 +02:00
Ian Wienand
0a13b1dd92 CentOS 8 initial deployment
This is for an initial build and debug purposes

Change-Id: I5bbb83bf313f13c216ca3e031d7a8e3dc8ba7cc7
2019-10-09 17:02:01 +11:00
Ian Wienand
e38efe3a84 Add Fedora 30 nodes
Fedora 30 is supported with diskimage-builder's 2.27.0 release
recently tagged

Change-Id: Ic0316a0e755b67181ae74c06f712e351ea485de7
2019-09-09 16:56:02 +10:00
Dirk Mueller
eb81a56ac1 Add openSUSE 15.1 to the nodepool building as opensuse-15
The main reason why we can do this cleanup now is because there has been a policy
change with openSUSE Leap 15: the minor releases like 15.1 and 15.2 are similarly
backwards compatible like e.g. minor releases in centos 7.x are, as such
we can build an opensuse 15 image in the ci and update all jobs to that
one to have less continuous effort in maintaining the opensuse builds.

Depends-On: https://review.opendev.org/#/c/660137/

Change-Id: I2b1f21fb6e01558c8cee27de116dfc857a1a1c91
2019-06-14 17:08:40 +02:00
Thomas Goirand
7bd7b5f044 Add a Debian Buster image.
Change-Id: Ia55d240fa8ce1d19ef69608e68c47e02776f15ca
2019-05-21 13:47:04 +02:00
Ian Wienand
1fdd6945d6 Revert "Add CentOS NetworkManager testing node"
This reverts commit 32e63aa0c8d1ac60558b09233d2d791bd4ce1c3a (and
small follow-on fix 0eeb4395d1ccac19dea0d6688d4b5712a370b89c)

The base CentOS node is switched to NetworkManager support

Change-Id: Ic254273afdf0637194b608b781ea9e3ff4bd73a3
2019-01-14 09:42:59 +11:00
Ian Wienand
32e63aa0c8 Add CentOS NetworkManager testing node
This enables NetworkManager control of interfaces on a new centos7-nm
node type.  This is intended only for short-term initial testing.

Change-Id: I43318f33d206c28e1f06ac7a8f07c3fb8c8f0626
2019-01-10 10:03:31 +11:00
Ian Wienand
1c650ef2c7 Add Fedora 29 nodes
Add Fedora 29 nodes

Depends-On: https://review.openstack.org/618671
Change-Id: Icea5721c295d31a7efc953bd71fa914727c56d08
2019-01-09 15:53:57 +11:00
Clark Boylan
57eaa73695 Switch nodepool launchers to use new zk cluster
This should happen at the same time as we switch the zuul scheduler over
to the new zk cluster and after the nodepool builders have populated
image data on the new zk cluster.

This gets us off the old nodepool.o.o server and onto newer HA cluster.

Change-Id: I9cea03f726d4acb21ad5584f8db7a4d15bc556db
2018-10-22 09:23:12 -07:00
Ian Wienand
156ffcd032
Add gentoo to providers
We've added gentoo images for building, but no providers currently
have a gentoo image defined.  Add them.

Change-Id: I89ee589df468d0eb32952fd3a899b834f823ad39
2018-09-14 12:00:02 -05:00
Matthew Thode
8bd4bbc909
set Gentoo's min-ready to 1
Also correct the name of the gentoo image

Change-Id: I30d6c7e8401e03e8b6efdff4d703e36064caf406
2018-09-13 14:47:25 -05:00
Paul Belanger
578d1dcc58
Remove fedora-27 from nodepool
We have no jobs using these images, we can safely remove them
from nodepool.

Change-Id: I6634317838bce4f5bbffe756d96e7dc4588b46fa
Signed-off-by: Paul Belanger <pabelanger@redhat.com>
2018-08-13 12:01:50 -04:00
Paul Belanger
d3b3fb1910
Set fedora-27 min-ready to 0
We are in the process of remove this image from nodepool, and jobs are
now using fedora-28.

Change-Id: I58db5231681ccb033f23c7110050e814266abf2a
Signed-off-by: Paul Belanger <pabelanger@redhat.com>
2018-08-13 10:37:48 -04:00
Monty Taylor
27bf8d6d6f Use infra-root-keys-2018-06-15 in nodepool
The new keypair object has the updated set of ssh keys. Once the new
object is in the clouds we can consume it for nodes.

Change-Id: I5d71fee91504d88129cc307d4855f83b85c6a2b4
2018-06-15 19:55:29 +00:00
Markos Chandras
814513410f nodepool: Set min-ready to '1' for opensuse-150
We can now build openSUSE Leap 15 images, so allow the various
clouds to use it.

Change-Id: Iab5cb1679b999d40ad4034f6cac8b24711a78f0f
2018-06-04 08:18:20 +01:00
Paul Belanger
c1118e51bb
Set min-ready 1 for fedora-28
Now that we have properly built a fedora-28 image, allow our cloud
providers to use it.

Change-Id: I3b6a333c0a19d091a2935ca422afc311fe15bc6c
Signed-off-by: Paul Belanger <pabelanger@redhat.com>
2018-04-30 16:46:33 -04:00
Paul Belanger
e53995db51
Remove debian-jessie from nodepool
We no longer have any jobs using debian-jessie, so it is now safe to
remove debian-jessie.

Change-Id: I26d14287f8ef236ba80f24a6a45b0754043968db
Depends-On: https://review.openstack.org/562870
Signed-off-by: Paul Belanger <pabelanger@redhat.com>
2018-04-20 12:25:15 -04:00
Paul Belanger
b1899f692d
Set min-ready for debian-jessie to 0
We are in the process of remove debian-jessie from nodepool, this is
the first step to doing so.

Change-Id: I81a978772efa69424a2c3afdc7ced3e6ed47c847
Signed-off-by: Paul Belanger <pabelanger@redhat.com>
2018-04-20 10:20:41 -04:00
Paul Belanger
a2f6d62208
Clean up diskimages for debian-(jessie|stretch)
Ensure both amd64/arm64 DIBs for nodepool are using the same settings.

Also adds missing label for debien-stretch on nl01.o.o.

Change-Id: Ifc6759637c287754a298576cc5c0409f19ded142
Signed-off-by: Paul Belanger <pabelanger@redhat.com>
2018-04-09 15:30:46 -04:00
Xinliang Liu
7af4e3a2e9 Add debian stretch nodes to arm64/amd64 clouds
Stretch is the latest stable debian release.  So add debian stretch
nodes to arm64 and amd64 clouds.

Note we're updating to use our internal debian mirrors, which now have
arm64 too.

Depends-On: https://review.openstack.org/557942
Change-Id: Idb88d863b5b13286d791970be396c92eff470a81
2018-04-05 09:21:53 +10:00
Paul Belanger
0b8d14fefd
Remove fedora-26 nodes from nodepool
We've had fedora-27 nodes online for a while now, plus we've recommend
jobs be moved to fedora-27:

  http://lists.openstack.org/pipermail/openstack-dev/2018-March/127945.html

We really only want to keep a single fedora node online, due to how
long the support lifecyle is.

Change-Id: Ie13e68eb3e7a266aa51d883b6d410832565e8f16
Signed-off-by: Paul Belanger <pabelanger@redhat.com>
2018-04-04 11:07:34 -04:00
Paul Belanger
c529ef831a
Set min-ready for fedora-26 to 0
Start the process of removing fedora-26 nodes from nodepool.  This
will happen over a series of commits.

Change-Id: I5fac84e9d21817438ba1561e8c609bd856d07985
Signed-off-by: Paul Belanger <pabelanger@redhat.com>
2018-04-04 11:03:28 -04:00
Paul Belanger
8d86f7184f
Add ubuntu-bionic to nodepool
As ubuntu-bionic is the new LTS for ubuntu, start providing images in
nodepool.  Something to note, bionic isn't actually released yet.
However our tooling does work and is able to create workable images.

We should hold off to migrating jobs from ubuntu-xenial to
ubuntu-bionic until it is officially released, and we have a migration
plan in place.

Change-Id: If12435969ca37400bfd04abe8470048146be7aa3
Signed-off-by: Paul Belanger <pabelanger@redhat.com>
2018-02-27 06:56:41 -05:00
Paul Belanger
9f5b8baa96 Remove max-ready-age from nodepool
We've landed a fix in nodepool to help reduce the chance of a provider
wedge. Remove max-ready-age, to allow our nodepool fix to handle the
issue.

Change-Id: I02b7112d4fdfb0315ad964924692b0968bdf76b4
Depends-On: https://review.openstack.org/539316
Signed-off-by: Paul Belanger <pabelanger@redhat.com>
2018-02-27 09:19:45 +00:00
Ian Wienand
653c54d96e Add arm64 min-ready to nl03
The launcher calls self.labelImageIsAvailable when calculating the
min-ready values.  This doesn't work if the launcher doesn't have
entries for that label.

Move the arm64 min-ready into nl03 (and out of nl01) and add a note on
this behaviour.

[1] https://git.openstack.org/cgit/openstack-infra/nodepool/tree/nodepool/launcher.py#n946

Change-Id: I060af7501a8e1106cea673a99fce332fcda73290
2018-02-23 16:14:22 +11:00
Ian Wienand
2b78cddaad Add arm64 nodes to launcher
Add configuration for arm64 nodes to nl03

Change-Id: Id97a09a459a2336cf528aa551d022217b85b5f01
Depends-On: https://review.openstack.org/546834
2018-02-23 10:43:11 +11:00
Paul Belanger
a9b3c04b47
Bring online opensuse-tumbleweed images
Now that we've been able to build / upload an images, add
configuration and have nodepool boot it.

Change-Id: Ieaaaa8d5f3c65e41964a0eda18072d298cfb15a8
Signed-off-by: Paul Belanger <pabelanger@redhat.com>
2018-02-21 19:30:07 -05:00
Paul Belanger
2d8f0f5a9a
Reduce duplicate data in nodepool configuration
We can use yaml anchors to help reduce duplicate data in nodepool.yaml
files.

Change-Id: I59b43d87340fc0adf37d251c01a0c3092deb3be7
Signed-off-by: Paul Belanger <pabelanger@redhat.com>
2018-02-21 19:24:08 -05:00
Paul Belanger
50754ca31d
Have nl01.o.o manage min-ready of labels
Due to how multiple nodepool-launchers work today, it is possible to
have greater then min-ready of a label. To avoid this, nl01.o.o will
now be the only launcher to send min-ready requests to zookeeper.

Ideally, nodepool will be updated to support shared configuration in
the future.

Change-Id: I1cf0253343a80146f538ca5e4c83bde5c0173be3
Signed-off-by: Paul Belanger <pabelanger@redhat.com>
2018-02-13 15:04:31 -05:00
Zuul
1e9c383e65 Merge "Remove tripelo-test-cloud-rh1" 2018-01-31 19:20:19 +00:00
Zuul
03f5097d8a Merge "Disable tripleo-test-cloud-rh1 for nodepool" 2018-01-31 16:59:56 +00:00
Zuul
0e64fc1774 Merge "Revert "Temporarily reduce max-servers in rax-dfw"" 2018-01-31 15:26:27 +00:00
Paul Belanger
949d157a15
Remove tripelo-test-cloud-rh1
The provider is no disabled, remove remaining configuration from
nodepool and grafana.

Change-Id: I61fc4871a407449317efb0d20f44fd62faff1c7a
Signed-off-by: Paul Belanger <pabelanger@redhat.com>
2018-01-31 10:18:00 -05:00
Paul Belanger
ee2253b300
Disable tripleo-test-cloud-rh1 for nodepool
Now that we remove pipelines from zuul, there is no reason to keep
trpielo-test-cloud-rh1 configured in nodepool.

Change-Id: I658fda4fd979065f6783331341f0ad8b03664268
Depends-On: https://review.openstack.org/538023/
Signed-off-by: Paul Belanger <pabelanger@redhat.com>
2018-01-31 10:17:33 -05:00
Zuul
8ca8bec277 Merge "Use max-ready-age on nodepool nodes" 2018-01-31 13:46:48 +00:00
Jeremy Stanley
e1930cf088 Revert "Temporarily reduce max-servers in rax-dfw"
Do not approve until ticket 180130-ord-0000697 for
mirror01.dfw.rax.openstack.org is brought to a favorable conclusion.

This reverts commit 21463ce4ffcbccecd11b0f6360355cc694a6a7f1.

Change-Id: I35b8430af4b64d36a00a3d7ab7fa89567602eccb
2018-01-30 16:41:11 +00:00
Jeremy Stanley
21463ce4ff Temporarily reduce max-servers in rax-dfw
We're seeing an odd rate limiting behavior on our mirror server in
rax-dfw. Ticket 180130-ord-0000697 has been filed with the provider
to investigate, but while that is underway we'll reduce our
max-servers in that region from 140 to 100 to reduce network
bandwidth consumption on it and relieve the resulting packet loss
and package retrieval slowness/timeouts/errors.

Change-Id: I1ab72262bd2f9f725188a2546f92c7f515c762cc
2018-01-30 16:38:09 +00:00
David Shrewsbury
5f1914d360 Use max-ready-age on nodepool nodes
There is an edge case in nodepool when we can have a full quota
for a provider pool of all READY and UNLOCKED nodes (meaning they
are unused and available), but if the pool thread gets a request
for a node label that it does not have ready, it will pause
request handling, waiting for one of its pre-existing nodes to
free up so it can create a new node with the requested label.
It will never unpause because none of it's available nodes will
ever get used and go away.

Ideally, nodepool would identify this situation and just decline
the request. Unfortunately, it does not yet do that, but we can
alleviate this problem by using max-ready-age to delete any unused
ready nodes after a time period. We start with 1 hour of inactive
time.

Change-Id: Ib751f4e8dddd681807b5de5cc982b3feeeb00f19
2018-01-30 11:28:28 -05:00