We've manually and successfully tested a virtual machine with the
nodepool image and the ipv6 network.
The virtual machine could reach the regional mirror and a devstack-gate
reproduce.sh ran to completion.
Let's do an initial bump to 10 nodes to monitor for failures we could
not catch -- we'll bump to 50 afterwards if we're confident things are
working well for both us and Limestone.
Change-Id: I3a3b68dd9fbd0243f3544ceceb4859aa6d435fc8
When OVH is working as execpted, it usually takes 45 seconds to bring
a node online. When things are not working, it takes much longer.
Rather then waiting the default 3600 seconds to fail, drop to 600 to
help speed up nodes being rescheduled.
Change-Id: I122e1782b95f580517c34019ff16b39a053a8115
Signed-off-by: Paul Belanger <pabelanger@redhat.com>
This makes limestone available for uploading images to and for testing.
max-server will be bumped once tests have been conclusive.
Change-Id: If630dca09b57f8ef842f2c01459e00bbf2d5c5dc
Depends-On: https://review.openstack.org/#/c/555470/
This is a partial revert of 8962dfb8d8e463a1b4d42dfd8f6b2daa116c5b46
to just unpause CentOS 7 and validate the fix.
Change-Id: I234d428d9eddbeb95b8db681c49e75caa34bb128
We created a new mirror in vexxhost with no bandwidth limits, the
thought here is this should results in better job run times as our
mirror will not be the bottleneck.
We've also changed flavors to use v2-highcpu-8 which are 8C/8Gb
memory, but require us to now boot-from-volume with 80GB volume-size.
Change-Id: Ibb26597cfd3c3b10891d7a60e70c6143d1c12407
Signed-off-by: Paul Belanger <pabelanger@redhat.com>
There is no jenkins, only zuul! With zuulv3 running in production,
there is no more need to add jenkins user or scripts to our images.
Move chmod of /opt/cache/files from
nodepool/elements/jenkins-slave/install.d/20-jenkins-slave to
nodepool/elements/zuul-worker/install.d/60-zuul-worker
We also leave the jenkins-slave elements for now, in case 3rd party CI
use them.
Change-Id: Ia9750877fbc1a17ec467ca4ac685afdb9c1627f8
Signed-off-by: Paul Belanger <pabelanger@redhat.com>
We now only have afs-slug.sh in jenkins/scripts/ and it is only
used by nodepool/scripts/configure_mirror.sh. Move the file into the
nodepool/scripts directory and adjust paths.
Remove copying of jenkins/scripts from nodepool, the directory does not
exist anymore.
Remove 89-jenkins-scripts, we don't need it anymore.
Depends-On: https://review.openstack.org/548393
Change-Id: I13cac791d70a2e5bcb0de1ba0adcd79e1b0aee9f
The need for the distribution was removed in I249f21a98fea3b963b7ffb8e3d0fce02cc540d46
so we can remove the code around that was determining it but not
actually making use of it anywhere anymore.
Change-Id: I572943bbc0c2665a885b7a80cdb2d1817c61bc3c
There is an issue with newer kernels (it seems to happen with 4.15.x)
that when conntrack is reloaded while a connection has packets in
flight, this connection going forward is neither considered INVALID
nor RELATED nor ESTABLISHED by the stateful tracking. While this is
certainly a bug somewhere in the kernel, we can be easily avoiding
this by just not using stateful filtering for ssh connections, as
we accept any connection from anywhere anyway.
Change-Id: I1b20644ce888930cd28d6eaf2c23787315e8199c
We no longer have the ability to run ready-scripts in nodepool, so
let's delete / clean them up.
Change-Id: I2551037dcfba2362d23401536295eb8f8f5d3e0d
Signed-off-by: Paul Belanger <pabelanger@redhat.com>
As ubuntu-bionic is the new LTS for ubuntu, start providing images in
nodepool. Something to note, bionic isn't actually released yet.
However our tooling does work and is able to create workable images.
We should hold off to migrating jobs from ubuntu-xenial to
ubuntu-bionic until it is officially released, and we have a migration
plan in place.
Change-Id: If12435969ca37400bfd04abe8470048146be7aa3
Signed-off-by: Paul Belanger <pabelanger@redhat.com>
We've landed a fix in nodepool to help reduce the chance of a provider
wedge. Remove max-ready-age, to allow our nodepool fix to handle the
issue.
Change-Id: I02b7112d4fdfb0315ad964924692b0968bdf76b4
Depends-On: https://review.openstack.org/539316
Signed-off-by: Paul Belanger <pabelanger@redhat.com>
The launcher calls self.labelImageIsAvailable when calculating the
min-ready values. This doesn't work if the launcher doesn't have
entries for that label.
Move the arm64 min-ready into nl03 (and out of nl01) and add a note on
this behaviour.
[1] https://git.openstack.org/cgit/openstack-infra/nodepool/tree/nodepool/launcher.py#n946
Change-Id: I060af7501a8e1106cea673a99fce332fcda73290
Now that we've been able to build / upload an images, add
configuration and have nodepool boot it.
Change-Id: Ieaaaa8d5f3c65e41964a0eda18072d298cfb15a8
Signed-off-by: Paul Belanger <pabelanger@redhat.com>
We can use yaml anchors to help reduce duplicate data in nodepool.yaml
files.
Change-Id: I59b43d87340fc0adf37d251c01a0c3092deb3be7
Signed-off-by: Paul Belanger <pabelanger@redhat.com>
This is useful for experimental devstack runs that allow testing
e.g. Nova or Neutron against the newest technology as it gets
into the rolling release of openSUSE Tumbleweed (like for
example testing latest OVS, kernel and other OS dependencies).
Depends-On: https://review.openstack.org/545314/
Change-Id: Ied661ad453e6345956d466f15f728ce019affe3e
Because citycloud is currently disable, remove images over pausing
them. This means we can clean up old DIB images left on disk for our
nodepool-builders.
Change-Id: Ide55ae65c1e152bd72dd6259bd8e7e1d308046f5
Signed-off-by: Paul Belanger <pabelanger@redhat.com>
Remove using old location, we can switch now to the new location
everywhere.
Note: We can only merge this after new images are build with the new
location build in.
This needs a recheck once change 1 is in since project-config is
not self-testing. So, we can remove jenkins/data/bindep-fallback.txt in
this change.
Change-Id: I08f23e96defb152946ade1490628f37f0215300d
Depends-On: https://review.openstack.org/543141
Depends-On: https://review.openstack.org/543142
Let's get rid of jenkins in the name and use a new place to place
bindep-fallback.txt in.
Create new nodepool element to copy the file over.
This is a first of two changes for this repo, we also need to update
the few users in bindep and openstack-zuul-jobs before we can remove the
old location.
We can remove jenkins/data/bindep-fallback.txt only in the followup
change since project-config is not self-testing.
Change-Id: I5c94dcbbca25db7dd998bfbccfbb25c1c4342a2b
This is a specific config for a builder to run in the linaro cloud
building ARM64 based images. It only has the configuration for that
cloud.
Launchers will be updated once we can build an image...
Change-Id: If2d111be6b9fb2fdebde70edbb4645ce401d77c3
Depends-On: https://review.openstack.org/546025
Due to how multiple nodepool-launchers work today, it is possible to
have greater then min-ready of a label. To avoid this, nl01.o.o will
now be the only launcher to send min-ready requests to zookeeper.
Ideally, nodepool will be updated to support shared configuration in
the future.
Change-Id: I1cf0253343a80146f538ca5e4c83bde5c0173be3
Signed-off-by: Paul Belanger <pabelanger@redhat.com>
At the request of Daniel Öhberg, CityNetwork VP of Operations, we
are ceasing booting CI nodes in any remaining regions and pausing
all image uploads for now. We should get back in touch with them
around the beginning of July to find out whether they're ready for
us to reenable use of this account.
Change-Id: I39f12d5a8441b197f5a310c7b33ba42c04c73378
We do not use the jenkins user anymore, so can remove the sudo settings
that allows jenkins to become root.
Change-Id: I69d58c2d10a2f48406cf2991fe83ce0e64851c8c
During the migration of I4bda502f31087bc125bd452a9075e3caaa031c7d we
incorrectly added initialize-urandom to ubuntu-trusty. This is a
problem because, it only support systemd and only xenial is affected.
Remove to start building DIBs again.
Change-Id: Icd5f7a9ac99abd7c979060e9bea455ea5032f13b
Signed-off-by: Paul Belanger <pabelanger@redhat.com>
The provider is no disabled, remove remaining configuration from
nodepool and grafana.
Change-Id: I61fc4871a407449317efb0d20f44fd62faff1c7a
Signed-off-by: Paul Belanger <pabelanger@redhat.com>
Now that we remove pipelines from zuul, there is no reason to keep
trpielo-test-cloud-rh1 configured in nodepool.
Change-Id: I658fda4fd979065f6783331341f0ad8b03664268
Depends-On: https://review.openstack.org/538023/
Signed-off-by: Paul Belanger <pabelanger@redhat.com>