Commit Graph

32 Commits (master)

Author SHA1 Message Date
Zuul ebc1589537 Merge "Adding dead-link-linter gate" 2021-11-18 19:35:10 +00:00
Danny Massa f9ae26105b Adding dead-link-linter gate
Change-Id: I3b97e42abf5084a6dbd46616327e7bfe7b1a9791
2021-11-17 13:16:38 -06:00
Sreejith Punnapuzha 5afbb354d5 Align docker install role with airshipctl
airshipctl is using upstream ensure-docker role instead of
docker-install. correcting this in treasuremap

Signed-off-by: Sreejith Punnapuzha <Sreejith.Punnapuzha@outlook.com>
Change-Id: Ideea1d9f641d6abad1d9f7c37698f7c09f778fce
2021-11-04 15:56:40 +00:00
Siraj Yasin a06003c004 update secrets to align with airshipctl
* Align treasuremap virtual-airship-core site to recent changes of
airshipctl
* This PS takes care of only the "airship-core" type and all other
  sites will fail validate docs untill the secrets are aligned.
* So the validate_docs is invoked with parameter "virtual-airship-core"
  to run document validation just for virtual-airship-core

  reference airshipctl commit: e2c56108eef38dd83df52fcfd1fa6844e5376a56

Change-Id: I2e6149951beca570a3cadeecbc05366325c80286
2021-09-29 15:48:56 +00:00
Sirajudeen 7e4710e9b3 update syntax for kustomize with recent uplift
* updated the syntax for enable plugins with recent uplift
  of kustomize version
* Had to uplift the airshipctl version as well

Change-Id: I0c637603013adc2594c39cbea7cc07f3937cf3ee
2021-08-02 21:23:45 +00:00
Sirajudeen 0150d774d3 Rename Virtual Sites in Treasuremap
* Renamed test-site to virtual-airship-core

Relates-To: #154
Change-Id: I15905a5be8628b35f1cebcba95e3257f541d4e74
2021-07-12 19:01:49 +00:00
Sirajudeen 6cdb73997f Fix the resource issue with test-site deployment
* After dex is added, it is observed that almost all gate runner
  builds are failing.
* So trying to adjust the disk size to check if it resolves the
  issue.

Change-Id: Ie33bc32e49e00d225599c9de5ff7917fb527b8ef
2021-06-21 15:44:59 +00:00
Vladislav Kuzmin b6ce028dcc Add phase plan for airship-core gating
Uplift airshipctl to version with new phases.
Add phases from zuul job in deploy-airship-core-gating.

Relates-To: #166
Change-Id: I98b605d16940fab2a728e4646e52c7d1ad992c2d
2021-06-11 18:50:34 +04:00
Ian Howell 12fc147cea Add type-specific deployment scripts
This change restructures the deployment script directory to support
type-specific deployment scripts. As sub-clusters are added, those
scripts will only be relevant to the multi-tenant type. The distinction
between which scripts should be used for each type will prevent
unexpected deployment errors.

Co-authored-by: Drew Walters <andrew.walters@att.com>
Change-Id: Ic14d4536bc9e593ab81c94b5c1dcec063a93ed18
2021-06-03 18:23:33 +00:00
Sirajudeen 49f02e6be4 Align Treasuremap to recent changes of Airshipctl
* Changes from following PS are used to align treasuremap with airshipctl
   https://review.opendev.org/c/airship/airshipctl/+/790791
   https://review.opendev.org/c/airship/airshipctl/+/787290

Closes: #159

Change-Id: I43b633b06addaf65b6b5f945782df032cabf114c
2021-06-03 13:10:13 +00:00
siraj.yasin 995ae36600 Remove verify hwcc from default scripts
* This playbook is used in thrid party gates and
  it is failing at verify hwcc stage which is removed recently.

Change-Id: I7266a81d87886f7ca4d04fe1f9e360f948dd54a9
2021-05-17 13:07:31 +00:00
siraj.yasin 25ad182f32 Disable update github issue job.
* BOT will be configured to listen for treasuremap repo changes and
  add/update comments and issues status ( close ) as applicable.

Change-Id: I2e2070461e60fc75dd2066432c4f5cd48023c5e3
2021-04-29 17:26:19 +00:00
Sreejith Punnapuzha 40f7f38f7e Fix deployment scripts
* fixes labeling issue with deployment scripts
 * allign scripts with airshipctl and treasuremap
 * update playbook and zuul job with script changes

Signed-off-by: Sreejith Punnapuzha <Sreejith.Punnapuzha@outlook.com>
Change-Id: I43221565ab29fc78a60fbd4978c058eec5c88640
2021-04-16 15:48:37 -05:00
Matt McEuen 51e713f6f5 Update Airshipctl pin, kustomize install condition
Updates the airshipctl pin to include a fix which enables deployment
of sites other than test-site:
https://review.opendev.org/c/airship/airshipctl/+/784436

Change-Id: Ia4f8d9048dc0fd0e3b7eb1e3734f37350a3d7110
(cherry picked from commit a13eb1f12b)
2021-04-05 15:38:30 +00:00
siraj.yasin 1b68187163 Fix airshipctl ref used for deployment.
* Corrected the varaible name used to set airshipctl reference.

Change-Id: Ibc887c5390b707bd131af0106078bff97e2eb14c
2021-03-11 17:27:43 +00:00
Steven Fitzpatrick 52e072ef8a Add gate utility scripts to Treasuremap
These scripts allow one to stand up a treasuremap test-site

note: Removing the phase  lma-infra-target from script 31, since
it causes a wait to fail later on in the pipeline

Change-Id: I43374a874c110ab32d6158975c50fd4b89693479
2021-03-08 20:27:20 +00:00
siraj.yasin ea57ab4ff9 Added HWCC verification script.
* Added HWCC verification script.
* include install pip script
* include install yq script

Change-Id: I835d5c080fd7a02d14a63109c271c397355ee3eb
2021-03-05 16:20:04 +00:00
siraj.yasin 1144e50bae Aligning with NetworkCatalogue & VersionsCatalogue
* Aligning with recent changes of airshipctl

  airshipctl PS:
    https://review.opendev.org/c/airship/airshipctl/+/777023
    https://review.opendev.org/c/airship/airshipctl/+/775464

* uplifting airshipctl version in treasuremap

Change-Id: I92aad33a848b2fadf63eeedf322461dbc03c68ba
2021-03-03 03:21:14 +00:00
siraj.yasin 27d31a22f7 Pinning airshipctl version in treasuremap
* Treasuremap is dependant on airshipctl repo. So pinning the last
  good tested version of airshipctl in treasuremap

Change-Id: I6923da9871b946134fbdc285c38bcb8f967aa804
Relates-To: #100
2021-03-01 18:11:36 +00:00
Sirajudeen 43f8dab09a Fix treasuremap deployment issues.
* Fixes validate_docs for treasuremap
* Align the secret encryption/decryption changes of airshipctl
* Aligning the manifest changes of airshipctl.
* Added HWCC.
* Replaced helm-operator with flux-helm
* Updated node parameters.

Relates-To: #77
Closes: #95

Change-Id: I30408de468ac2794703b95a2afc6191908567816
2021-02-26 15:15:13 +00:00
Drew Walters dc5efc7130 Update target and worker node specifications
The Ironic Deployment init container was recently updated in airshipctl
[0], and the update requires more disk space on nodes deployed by the
baremetal operator. This change updates the target and worker node
specifications to match the new values in airshipctl.

[0] https://review.opendev.org/c/airship/airshipctl/+/765376

Change-Id: Ifa75fd49d97502bb1b638f9ee58cd30af7d27482
2020-12-16 00:13:02 +00:00
Matt McEuen 39a6036ca8 Patch hostgenerators to delete catalogues
To facilitate catalogue-driven generation of BareMetalHost resources,
airship splits the work into two pieces:

1. <phasename>/hostgenerator/ is responsible for substituting
   catalogue variables into a host generation template
2. <phasename>/ invokes its hostgenerator/ as a Kustomize generator:,
   leveraging the results of 1. to generate BMH.

However, a weird side-effect of this setup is that the catalogues used
in step 1. above are still hanging around in step 2., and Kustomize
tries to interpret them as generator: plugin configs,
resulting in a rendering error.

Previously, we'd worked around this by having a pass-through plugin
implementation, which performs a no-op generation for the spent catalogues.

However, with the change below, airshipctl migrated to container-based KRM
functions for its kustomize plugins, and also adopted a
strategic-patch-delete mechanism to clean up the spent catalogues,
so that they aren't still hanging around by the time the generation occurs.

https://review.opendev.org/#/c/759279/

Change-Id: I50a9bd2fcc37b70f50b8ded88f152775aff928bc
Closes: #48
2020-11-18 13:53:57 -06:00
Zuul ff65f459b2 Merge "Add document pull functionality to deploy job" into v2 2020-11-06 16:20:00 +00:00
Drew Walters 8547656a68 Add document pull functionality to deploy job
This change introduces airshipctl's document pull functionality to the
Treasuremap gate runner job. This enables Treasuremap maintainers to pin
to a version of airshipctl deployment scripts and manifests that are
known to be compatible with Treasuremap's v2 branch.

In order to ensure that the deployment scripts and manifests come from
the same version of airshipctl, this change introduces a playbook that
checks out the referenced version of airhsipctl after it is cloned by
Zuul. It also checks out the known version a second time in the
deployment scripts for operators invoking the scripts in a non-Zuul
environment.

To update the pinned version of Treasuremap using Zuul, change the Zuul
variable airshipctl_ref. To update the pinned version in a non-Zuul
environment, use the environment variable AIRSHIPCTL_REF.

Change-Id: I300f545efcdd024b689a96ee99e502de7fdd1b83
Signed-off-by: Drew Walters <andrew.walters@att.com>
2020-11-04 23:11:01 +00:00
Zuul 6c06958b58 Merge "Use token for github Authentication" into v2 2020-11-04 14:45:09 +00:00
Zuul 4b791767c1 Merge "Update Kustomize config commands" into v2 2020-10-28 19:52:55 +00:00
Sirajudeen 9fb68fb360 Use token for github Authentication
* missed to update the playbook to use token in
  previous commit (https://review.opendev.org/#/c/759453/)

Change-Id: Ibc1a8ad7787e39b0879a1703f0b0518417daeff5
Closes: #44
2020-10-28 17:44:07 +00:00
Sirajudeen fa2b41d724 Moving to token based Auth for github
* Moving from user/password to Token based auth for
  Github Access

* Github password based authentication will be deprecated soon
  https://developer.github.com/changes/2020-02-14-deprecating-password-auth/

Change-Id: Ia9cba4713f3dd1c8fe074c980625fca7fe624e61
2020-10-26 19:17:12 +00:00
Drew Walters e1a9137650 Update Kustomize config commands
A recent refactor of the Kustomize config command [0] changed the config
subcommand to cfg. Since airshipctl has introduced a version of
Kustomize with the new subcommand, cfg, Treasuremap jobs are failing
because they still use Kustomize config.

This change updates kustomize config commands to kustomize cfg.

[0] 701c217791 (diff-73e268a15f17741962365907345f2ea7b20d8e2d19ec57efacb6067281b19b68)

Change-Id: I9eaac604c9eafdb6791e49716ea109906ddfe9f6
2020-10-23 20:40:02 +00:00
Andrii Ostapenko 01f75c9212
Collect description of k8s object to job logs
Depends-On: https://review.opendev.org/759152
Change-Id: Ib504d4a2fa90f8ae97f02128e70f5919cf93f7a5
Signed-off-by: Andrii Ostapenko <andrii.ostapenko@att.com>
2020-10-22 09:57:53 -05:00
Drew Walters cbb5e5869e Update airshipctl VM config playbooks
Jobs in airshipctl have recently started timing out due to drift between
the roles in airshipctl and playbooks in treasuremap. This change
updates playbooks that have recently changed in airshipctl to resolve
the job timeouts [0].

[0] https://review.opendev.org/747027

Change-Id: I4a39471dcd27eb323aa2c6aad7b4df570ef809d6
2020-08-25 18:58:22 +00:00
Matt McEuen 425e7adcda Add deployment gate
This adds airshipctl as a testing, and calls its deployment
scripts to launch a VM-based test.  This will be used to validate
treasuremap deployment manifests.

Change-Id: If4fa60f896211d2f6b63271b58b96541c399694c
2020-08-06 08:16:57 -05:00