83 Commits

Author SHA1 Message Date
Jeremy Stanley
059f2785e5 Add Ubuntu 24.04 LTS (ubuntu-noble) nodes
Build images and boot ubuntu-noble everywhere we do for
ubuntu-jammy. Drop the kernel boot parameter override we use on
Jammy since it's default in the kernel versions included in Noble
now.

Change-Id: I3b9d01a111e66290cae16f7f4f58ba0c6f2cacd8
2024-05-21 19:37:55 +00:00
Zuul
371ec90145 Merge "Add warning to nodepool configs about changing cloud name" 2024-04-17 12:29:38 +00:00
Clark Boylan
aabaf95b49 Remove centos-7 nodepool image builds
This is the last step in cleaning centos-7 out of nodepool. The previous
change will have cleaned up uploads and now we can stop building the
images entirely.

Change-Id: Ie81d6d516cd6cd42ae9797025a39521ceede7b71
2024-03-13 08:30:16 -07:00
Clark Boylan
b8c53b9c03 Remove centos-7 image uploads from Nodepool
This removal of centos-7 image uploads should cause Nodepool to clean up
the existing images in the clouds. Once that is done we can completely
remove the image builds in a followup change.

We are performing this cleanup because CentOS 7 is near its EOL and
cleaning it up will create room on nodepool builders and our mirrors for
other more modern test platforms.

Depends-On: https://review.opendev.org/c/opendev/base-jobs/+/912786
Change-Id: I48f6845bc7c97e0a8feb75fc0d540bdbe067e769
2024-03-13 08:21:46 -07:00
Clark Boylan
774ad69f33 Add warning to nodepool configs about changing cloud name
The cloud name is used to lookup cloud credentials in clouds.yaml, but
it is also used to determine names for things like mirrors within jobs.
As a result changing this value can impact running jobs as you need to
update DNS for mirrors (and possibly launch new mirrors) first. Add a
warning to help avoid problems like this in the future.

Change-Id: I9854ad47553370e6cc9ede843be3303dfa1f9f34
2024-03-07 11:28:17 -08:00
Clark Boylan
c41bc6e5c2 Remove debian-buster image builds from nodepool
This should be landed after the parent chagne has landed and nodepool
has successfully deleted all debian-buster image uploads from our cloud
providers. At this point it should be safe to remove the image builds
entirely.

Change-Id: I7fae65204ca825665c2e168f85d3630686d0cc75
2024-02-23 13:23:22 -08:00
Clark Boylan
feff36e424 Drop debian-buster image uploads from nodepool
Debian buster has been replaced by bullseye and bookworm, both of which
are releases we have images for. It is time to remove the unused debian
buster images as a result.

This change follows the process in nodepool docs for removing a provider
[0] (which isn't quite what we are doing) to properly remove images so
that they can be deleted by nodepool before we remove nodepool's
knowledge of them. The followup change will remove the image builds from
nodepool.

[0] https://zuul-ci.org/docs/nodepool/latest/operation.html#removing-a-provider

Depends-On: https://review.opendev.org/c/opendev/base-jobs/+/910015
Change-Id: I37cb3779944ff9eb1b774ecaf6df3c6929596155
2024-02-23 13:19:49 -08:00
Clark Boylan
211fe14946 Remove opensuse-15 image builds from nodepool
This should be landed after the parent chagne has landed and nodepool
has successfully deleted all opensuse-15 image uploads from our cloud
providers. At this point it should be safe to remove the image builds
entirely.

Change-Id: Icc870ce04b0f0b26df673f85dd6380234979906f
2024-02-22 10:27:37 -08:00
Clark Boylan
5635e67866 Drop opensuse image uploads from nodepool
These images are old opensuse 15.2 and there doesn't seem to be interest
in keeping these images running (very few jobs ever ran on them and
rarely successfully and no one is trying to update to 15.5 or 15.6).

This change follows the process in nodepool docs for removing a provider
[0] (which isn't quite what we are doing) to properly remove images so
that they can be deleted by nodepool before we remove nodepool's
knowledge of them. The followup change will remove the image builds from
nodepool.

[0] https://zuul-ci.org/docs/nodepool/latest/operation.html#removing-a-provider

Depends-On: https://review.opendev.org/c/opendev/base-jobs/+/909773
Change-Id: Id9373762ed5de5c7c5131811cec989c2e6e51910
2024-02-22 10:25:15 -08:00
Jeremy Stanley
cedfb950de Temporarily lower max-servers for linaro
The launcher is seeing "Error in creating the server. Compute
service reports fault: No valid host was found." from Linaro's
cloud, leading to NODE_FAILURE results for many jobs when our other
ARM-based node provider is running at quota. According to graphs,
we've been able to sustain 16 nodes in-use in this cloud, so
temporarily cap max-servers at that in order to avoid further
failures until someone has a chance to look into what has broken
there.

Change-Id: I3f79e9cc70e848b9ebc6728205f806693209dfd5
2023-12-14 16:33:20 +00:00
Michal Nasiadka
4ba928c675 Add nested-virt-debian-bookworm
Change-Id: I17a202cc82ff19a788fde7b34415542c1b354fae
2023-10-04 14:47:23 +02:00
Clark Boylan
3b9c5d2f07 Remove fedora image builds
This removes the fedora image builds from nodepool. At this point
Nodepool should no longer have any knowledge of fedora.

There is potential for other cleanups for things like dib elements, but
leaving those in place doesn't hurt much.

Change-Id: I3e6984bc060e9d21f7ad851f3a64db8bb555b38a
2023-09-06 09:16:34 -07:00
Clark Boylan
d83736575e Remove fedora-35 and fedora-36 from nodepool providers
This will stop providing the node label entirely and should result in
nodepool cleaning up the existing images for these images in our cloud
providers. It does not remove the diskimages for fedora which will
happen next.

Change-Id: Ic1361ff4e159509103a6436c88c9f3b5ca447777
2023-09-06 09:12:33 -07:00
Vladimir Kozhukalov
50c4046096 Add 32GB nodes Ubuntu Focal and Jammy nodes
Some deployment projects (e.g. Openstack-Helm)
test their code as "all-in-one" deployment.
I.e. a test job deploys all Openstack components
on a single node on top of a minimalistic
K8s cluster running on the same node.

This requires more memory than 8GB to make
jobs reliable. We add these new *-32GB labels
only in the Vexxhost ca-ymq-1 region because
v3-standard-8 flavor in this region has 32GB
nodes.

At the same time we should not stick to this
kind of nodes since the number of such nodes
is very limited. It is highly recommended to
redesign the test jobs so they use multinode
nodesets.

Change-Id: Icfd58a88a12d13f093c08f41ab4be85c26051149
2023-07-19 15:42:11 +03:00
Dr. Jens Harbott
5aa792f1ae Start booting bookworm nodes
Image builds have been successful

Change-Id: If286eb3e1a75c643f67f3d6d3d7e2d31c205ac1b
2023-07-03 18:47:46 +02:00
Rodolfo Alonso
2a0657cf70 Revert "Temporary disable nested-virt labels in vexxhost-ca-ymq-1"
This reverts commit 4df959c449c4d01f84a4a8b409b99c7d61e2bd6d.

Reason for revert: VEXXHOST provider has informed that they have
performed some optimizations and now we can enable again this pool.

Change-Id: Ifbd26a676c8c64c974e061e12d6d1a9d1ae47676
2023-05-11 15:44:42 +00:00
4df959c449 Temporary disable nested-virt labels in vexxhost-ca-ymq-1
The jobs running with nested-virt labels on this
provider are impacted by mirror issues from last
couple of weeks.

Atleast jobs running on compute nodes[1]
are impacted.

Until the issue is clear let's disable the
provider.

[1] https://paste.opendev.org/show/bCbxIrXR1P01q4JYUh3i/

Change-Id: Id8b7d214789568565a07770cc3c8b095a4c0122d
2023-04-28 17:40:33 +05:30
Dr. Jens Harbott
ac5c9ccc5b Add nested-virt-debian-bullseye label to nodepool
kolla wants to have testing parity between Ubuntu and Debian, so add a
nested-virt-debian-bullseye label to nodepool matching the existing
nested-virt-ubuntu-bionic label.

Change-Id: I27766140120fb55a2eab35552f0321b1da9c67ff
2023-03-31 18:15:25 +02:00
Ian Wienand
56f91201b2
nodepool: size linaro max-servers to subnet
As noted inline, this has a /27 subnet allocation, so that is the real
upper limit on hosts we can simultaneously talk to.

That makes 29 usable floating ip's, minus one for the mirror node.  We
would max out the 160 CPU's with our standard 8x instances (we can fit
20 * 8) before we got to this anyway, but I think it's good to just
have a note on it.

Change-Id: I63afab1a74aa76d1eb8629b3aa4df540daffa470
2023-01-25 14:05:02 +11:00
Ian Wienand
212ad67630
nodepool: drop linaro-us
Drop the linaro-us cloud from nb04 uploads and launcher; it is
replaced by the new linaro cloud.  Region is not running any nodes
since I6ef17bb517078de363286ecad9749cb321b4c92c.

nb03 is still in the inventory, but shutdown and in emergency.  We can
remove the config here and cleanup will follow.

Change-Id: Ia049a2e44d2c4add0346e8262b60cdfb2c976539
2023-01-23 15:45:19 +11:00
Ian Wienand
0cf9319b06
nodepool: empty linaro-us cloud
This should remove nodepool's tracking of the diskimages in this
cloud, in preparation for it's removal.

Change-Id: Icf7b00f88a9de8a91510ee231c47eef207da4ea8
2023-01-23 15:45:00 +11:00
Ian Wienand
2f5f5db0b0
linaro-us : set max-servers to 0
This is to clear out the cloud provider before removing.  This is
replaced by the other linaro cloud.

Change-Id: I6ef17bb517078de363286ecad9749cb321b4c92c
2023-01-18 10:40:42 +11:00
Ian Wienand
83f9c7ec49
arm64: remove min-ram constraints
All of the flavor names in use here should be matched exactly.

min-ram (as described at [1]) when used in combination with
flavor-name actually has the wrong semantics for us, as this chooses a
flavor that "meets providers.labels.min-ram and also contain
flavor-name".  This can cause the wrong flavor to be picked up if they
use the same prefix.

[1] https://zuul-ci.org/docs/nodepool/3.10.0/configuration.html#attr-providers.[openstack].pools.labels.flavor-name

Change-Id: Iecd0e9cfe7d7f1f28dd8d0c5ce9beb6bbdf357e8
2023-01-17 09:32:20 +11:00
Ian Wienand
1a855f3e9c
nl03 : reorganise labels
Reorganise these labels into x86_64, arm64 and vexxhost specific.  I
think grouping by arch is a more logical grouping of what is going on
for the usual operations on this file.

Change-Id: I4225a5d58e2988a3e2da4799c95df9f9e39fe1e2
2023-01-16 11:50:50 +11:00
Ian Wienand
ccde55cb46
Add new linaro cloud
Add nodes for the new linaro cloud

Depends-On: https://review.opendev.org/c/opendev/system-config/+/868433
Change-Id: I8c8439ca2ae8dd868bce9d2b015f6b8428b16a84
2022-12-23 08:56:43 +11:00
Ian Wienand
5a586b3751
ARM64 nodes : rename larger types to be more descriptive
AFAIK (and AFAICS from codesearch) nothing has ever been committed
that uses these larger node types.  IIRC they have been added for
testing various ways of getting devstack up, but that work isn't live
yet.

Now we are starting another Linaro ARM64 cloud, the names don't make
much sense with the flavors.

Move these to more descriptive names, that reflect the resources being
provided.

Change-Id: Ib7fa85437195c53c3cafc88b04385ef65333cfd5
2022-12-23 08:56:37 +11:00
Ian Wienand
fcad94f4e1
nodepool: remove ubuntu-bionic-arm64-large label
This was only used for gate testing and nothing committed uses this
node type.  None of the other more recent distros have a
correseponding -large type.  Remove this to cleanup the node types and
reduce required flavors.

Change-Id: I5c7d9bfc7fc3ed47196d00dfc68350b74200f6b4
2022-12-23 08:43:45 +11:00
Clark Boylan
7b0629e2cb Remove iweb nodepool configs
This removes iweb configs from the project-config repo. We'll still have
a few system-config items to clean up in a separate change.

Change-Id: I7bd2f0f6fcd7449e724815ed0c0fe743702ae8f3
2022-12-12 08:43:43 -08:00
Clark Boylan
bf34c3ea5a Set iweb to empty labels and diskimages
This should allow nodepool to clean up what it can as part of the
removal of this provider.

Change-Id: Ia084f7f6b4a8988010b71e6242f580ec70f788c8
2022-12-12 08:35:48 -08:00
Clark Boylan
eb03e00cd0 Set iweb max-servers to 0
This should wind down all server boots in the cloud. The next step will
have nodepool delete images and labels.

Change-Id: I69f31944d3d812000c7af93cb384e2706da4adcc
2022-12-12 08:23:38 -08:00
Clark Boylan
629be2e127 Scale iweb back to 25% of possible quota
We have to be off of this provider by the end of the month. Start by
scaling back our usage. This will be a multi step process with a number
of changes to allow nodepool to clean up as much as possible after
itself.

Change-Id: I897ebcb554624a2003b9d68c93cfcb5a57deff33
2022-12-12 08:22:02 -08:00
Michal Nasiadka
d61182e6c5 Add rockylinux-9-arm64
Change-Id: I522bf00c737dd96cac337c37068545d168ecce32
2022-09-27 07:24:26 +00:00
Jeremy Stanley
fcd02797ee Add missing rockylinux and openeuler entries
Our various nodepool launcher configs have gotten out of sync with
recent additions. Try to match them up better by adding rockylinux
and openeuler to places where they were missing. In particular, this
addresses an inconsistency on nl04 which caused the service to crash
at last restart due to rockylinux missing from the main diskimages
list.

Change-Id: Ie157ab7f667dbdc313b7fdbfc1df71874e8bd0fc
2022-09-20 12:35:16 +00:00
Michal Nasiadka
13552d20e5 Add nested-virt-rockylinux-9
Change-Id: I5c8c8350173d0aee0683c7fe40fafce7b5602a51
2022-08-24 17:47:11 +02:00
Ian Wienand
36b9c302e5 nodepool: Add Fedora 36
Add Fedora 36 builds

Change-Id: I64fac34945ea5c6ec91ddd442281fcaba2c53271
2022-08-22 11:25:09 +10:00
Neil Hanlon
705e8420a2
Add rockylinux 9 to nodepool
Change-Id: Iedf1c8eb2898cfc5771a5a695a53a39f9396edc9
2022-08-05 08:58:27 -04:00
Dr. Jens Harbott
0d47c4f241 Add nested-virt-ubuntu-jammy nodes
kolla-ansible has switched to Jammy in master, create nodes that allow
their kvm tests to continue to run.

Signed-off-by: Dr. Jens Harbott <harbott@osism.tech>
Change-Id: I97b59a1dad032665db986ffaf9f7d6fdb45caf26
2022-08-04 12:09:58 +02:00
wangxiyuan
30fca1376d Bump openEuler to 22.03 LTS
openEuler 20.03-LTS-SP2 was out of date in May 2022. 22.03 LTS
is the newest LTS version. It was release in March 2022 and
will be maintained for 2 years. This patch upgrades the LTS
version. It'll be used in Devstack, Kolla-ansible and so on
in CI jobs.

Change-Id: I23f2b397bc7f1d8c2a959e0e90f5058cf3bf104d
2022-08-03 14:40:34 +08:00
Jeremy Stanley
147ecf5b23 Revert "Temporarily turn on console logs for rocky in iweb"
Merge once investigation into rockylinux-8 boot problems has
concluded.

This reverts commit 1a58f0f325958c9525d4e6759118b7021b5b99b2.

Change-Id: Ifbfdeb4d31d198ce0f551529dd2fb0a1b828f8ce
2022-07-29 13:59:13 +00:00
Jeremy Stanley
1a58f0f325 Temporarily turn on console logs for rocky in iweb
Our rockylinux-8 images have stopped being reachable on boot over
the past few days. The images are building fine, but we need more
insight into what's happening at boot time. The only provider with
standard flavors, console log capability and sufficient quota to
boot these with any regularity is iweb-mtl01, so turn on the
console-log toggle there for now. We can revert this once the root
cause is identified.

Change-Id: I42adc68695cd1fdf48779674935de69b81ffb9a2
2022-07-29 13:56:02 +00:00
Dr. Jens Harbott
cae4d4dcc9 Fix config error for nl03
Change-Id: Id1637d47123c0add54718b09ab66c59ae43df515
2022-05-06 11:16:56 +02:00
Ian Wienand
53d6223cba Revert "Temporarly disable linaro-us"
This reverts commit 590bdfb230fa71a03b76fae6274da558a3820976.

Upstream has fixed the issues with the cloud.

Change-Id: I53828a3d71e3ab9cfb1326a96cb69dfec4f3bef5
2022-05-06 17:03:39 +10:00
Clark Boylan
93c6d357eb Add Jammy arm64 test nodes
Once we are happy with the results of the parent change we can land this
change to boot test nodes on the new arm64 jammy images.

Change-Id: I24a72279b053422677c3d35ce68fb76e89cc98d4
2022-05-03 16:31:42 -07:00
Ian Wienand
590bdfb230 Temporarly disable linaro-us
Nothing seems to be building/booting in linaro-us at the moment.  Due
to holidays it make take a little time to get this working on the
remote side.  Set this to 0 for now to stop trying to use nodes here.

Change-Id: Ie4be6ad9fa261a4ca7c6a0966ddbd66e413002fd
2022-05-02 14:05:18 +10:00
Dr. Jens Harbott
1bdccd42e5 Start launching Jammy images
The first image was built successfully, so we can start launching them.

Change-Id: Ie84d1700b6f4f7696e14dfe01bc887e422163d7e
2022-04-26 13:53:29 +02:00
Marcin Juszkiewicz
a0d5a6b010 Add centos-stream-9-arm64 nodes
Zed is coming, CentOS Stream 9 will be in use on more and more projects.
Make AArch64 CI ready for it.

Change-Id: I161691e777815102cf28692ade522df073f662ae
2022-04-06 16:16:35 +00:00
Neil Hanlon
2ccc5241c8
Add rockylinux-8 to nodepool configuration
Signed-off-by: Neil Hanlon <neil@rockylinux.org>
Change-Id: Ic3344bc47ca56c27f7ec3427a0865bd6ce3349d3
Depends-On: https://review.opendev.org/c/openstack/project-config/+/829405
Depends-On: https://review.opendev.org/c/openstack/project-config/+/829712
2022-02-17 09:12:00 -05:00
Ian Wienand
dd58c496f8 Remove Fedora 34
The dependent changes should be the last references to Fedora 34 nodes

Depends-On: https://review.opendev.org/c/openstack/devstack/+/827576
Depends-On: https://review.opendev.org/c/openstack/devstack/+/827578
Depends-On: https://review.opendev.org/c/zuul/nodepool/+/827577

Change-Id: Ie14ea374808e5518588925de3a476f0bc6ff2ccf
2022-02-11 07:55:21 +11:00
Clark Boylan
dce378a6b4 Remove centos-8
This distro release reached its EOL December 31, 2021. We are removing
it from our CI system as people should really stop testing on it. They
can use CentOS 8 Stream or other alternatives instead.

Depends-On: https://review.opendev.org/c/opendev/base-jobs/+/827181
Change-Id: I13e8185b7839371a9f9043b715dc39c6baf907d5
2022-02-02 09:48:36 +11:00
Gregory Thiemonge
9b4d8e38fe Adding nested-virt pools for centos-9-stream
Change-Id: I938c163d8735eb9fd20142f4e2ff366728a5eec7
2022-01-20 09:05:45 +01:00