In an attempt to gracefully move the providers from this repo to
zuul-providers, remove the resources from them so that zuul-launcher
can delete the images.
Change-Id: I1b24cde353bd5359da474252b3672228127b0826
This reverts commit e068fa393e0acc19d4ddabe5d6a8a123db2cfcfd.
Zuul-launcher doesn't deal well with deleting providers while
images are present. Let's do this in multiple steps.
Change-Id: I7457a366eb87a6ca89d8b7fe885cc9efa7c15721
This uses zstd to compress raw and vhd images before uploading to
temporary storage. The executor will detect the .zst extension and
decompress them before uploading to the cloud.
Depends-On: https://review.opendev.org/935956
Change-Id: I76303cbb3f1bbaf99ba7852bf1853dcc28b6d9b3
In some clouds we don't have enough space on / to store a raw image,
so tell dib to write the image output to /opt.
Change-Id: Ia3d13ed811f705a450030a2046b2cd1ffd5a22b3
To test building and uploading a raw image, add a vexxhost provider
and also tell the image build job to build a raw image.
Vexxhost does not have a "normal" flavor, so no flavors or labels
are added to it. We will only upload images to it.
Change-Id: I38005072637dc5b60ef7f58caa980bb7595c3907
We previously used swiftclient to upload image objects, and it uses
10 threads to upload SLO segments in parallel. Openstacksdk uses 5
by default. Increase it to 10 to match swiftclient. This should
improve our initial upload performance.
Change-Id: Idfee3cbbc9d49d9e14ad7d9db3ceafbd8ca526f6
This switches back to openstacksdk so that we have a little more
control over image uploads into rax flex. In particluar, this lets
us:
* Ensure that X-Delete-After is supplied for the segments and the
manifest of SLO uploads (sdk does this).
* Put the segments in the same container as the manifest which
avoids issues with deleting objects.
* Add a prune routine to compensate for auto-expiration issues.
This also switches to a newly created container so we can try to
delete the old container with stuck objects.
Change-Id: I564e692881693abd4794df3c444e245705d24b54
This is required in order to launch nodes in rax-flex, and is the
current value in our nodepool configuration.
Change-Id: I01cb08d9c569156cec69c2a3c48ed6a0df2339e4
There is a bug that causes Zuul to get stuck if a noop job runs
on a queue item with a repo state; until that is fixed, use a
"real" noop job instead of the built-in one.
Change-Id: I64dafd7daf57d8cceea6b074b62e7cffaa5afc0c
This will allow us to make changes to provider configuration
without rebuilding images every time.
Add the noop job for the cases where no other job would run.
Change-Id: Id9de7758ddeb675fb298fbb0edf4fa398e8bec71
This adds the initial nodepool-in-zuul config to:
* Tell zuul that it's responsible for an image named "debian-bullseye"
* Attach the job to a pipeline that builds missing images
* Connect to raxflex and upload that image
* Use that image when launching nodes with a label of
"niz-debian-bullseye-normal"
Change-Id: I8a838253a4683f34f538c90949369ba2d192e8d7
This fixes some minor issues with the upload job and removes the
temporary testing settings.
It also configures the job so that if a secret is provided, it will
upload the image, but if the secret is omitted, it will only build it.
We omit the secret in check, and provide it in gate. In the future,
we will provide it on the dedicated image build pipelines.
Change-Id: I17e519a6282e700fd09ce16c95bf58ef092b9dc6
This is intended to upload image build artifacts to rax-flex.
This may require some iteration post-merge to get right, so for
the moment, the actual build is skipped and we upload a test file.
Once it's working, the normal job can be restored.
Change-Id: I3e024e092b5b4f6c4842c2947c9a2b160a948755
As part of the move to zuul jobs building images we've discovered we
have a couple of scripts that are invoked by python2. Python2 isn't
available be default in the test images and python2 is old enough now
that we should just use python3. This change updates things to make it
so.
Co-Authored-By: Clark Boylan <clark.boylan@gmail.com>
Change-Id: Ib8692ef1389f80b4af59784d5b89d6dadc349a7c
This commit is a verbatim copy of the nodepool/elements directory
in the openstack/project-config repo.
Change-Id: I86768fcda43f2997700ce748ba7118a2ab2d43f0
