Commit Graph

44 Commits (master)

Author SHA1 Message Date
Danny Massa f9ae26105b Adding dead-link-linter gate
Change-Id: I3b97e42abf5084a6dbd46616327e7bfe7b1a9791
2021-11-17 13:16:38 -06:00
Siraj Yasin f819f6c510 update secrets for reference-airship-core
* This PS takes care of secret changes for reference-airship-core

Relates-To: #201
Change-Id: I1fca4323047bd844a1605490e42e3d9172cbac08
2021-10-05 15:27:27 +00:00
Siraj Yasin a06003c004 update secrets to align with airshipctl
* Align treasuremap virtual-airship-core site to recent changes of
airshipctl
* This PS takes care of only the "airship-core" type and all other
  sites will fail validate docs untill the secrets are aligned.
* So the validate_docs is invoked with parameter "virtual-airship-core"
  to run document validation just for virtual-airship-core

  reference airshipctl commit: e2c56108eef38dd83df52fcfd1fa6844e5376a56

Change-Id: I2e6149951beca570a3cadeecbc05366325c80286
2021-09-29 15:48:56 +00:00
Pallav Gupta fa3e113ced Fix validation doc gate
Currently validation doc gate is doing nothing and it skips
all sites present in treasuremap. This PS fixes validation doc
gate.

Closes #198

Change-Id: I48b35248636a22a8971757687a6325a365db96ad
2021-08-30 15:04:35 +00:00
Sreejith Punnapuzha fd54957eab Rename virtual sites
This commit renames virtual-network-cloud to virtual-multi-tenant.

Signed-off-by: Sreejith Punnapuzha <Sreejith.Punnapuzha@outlook.com>
Change-Id: I93008034f4f8bba8b2ab464d45854190b195b818
2021-07-28 11:31:32 -05:00
Sirajudeen 0150d774d3 Rename Virtual Sites in Treasuremap
* Renamed test-site to virtual-airship-core

Relates-To: #154
Change-Id: I15905a5be8628b35f1cebcba95e3257f541d4e74
2021-07-12 19:01:49 +00:00
Vladislav Kuzmin b6ce028dcc Add phase plan for airship-core gating
Uplift airshipctl to version with new phases.
Add phases from zuul job in deploy-airship-core-gating.

Relates-To: #166
Change-Id: I98b605d16940fab2a728e4646e52c7d1ad992c2d
2021-06-11 18:50:34 +04:00
Ian Howell ab02dee4e0 Add workload-config-target phase
Change-Id: I41f1e8e36321d2ac13a7947a635c41f81eded0b0
2021-06-09 08:27:51 -05:00
Ian Howell 12fc147cea Add type-specific deployment scripts
This change restructures the deployment script directory to support
type-specific deployment scripts. As sub-clusters are added, those
scripts will only be relevant to the multi-tenant type. The distinction
between which scripts should be used for each type will prevent
unexpected deployment errors.

Co-authored-by: Drew Walters <andrew.walters@att.com>
Change-Id: Ic14d4536bc9e593ab81c94b5c1dcec063a93ed18
2021-06-03 18:23:33 +00:00
Sirajudeen 49f02e6be4 Align Treasuremap to recent changes of Airshipctl
* Changes from following PS are used to align treasuremap with airshipctl
   https://review.opendev.org/c/airship/airshipctl/+/790791
   https://review.opendev.org/c/airship/airshipctl/+/787290

Closes: #159

Change-Id: I43b633b06addaf65b6b5f945782df032cabf114c
2021-06-03 13:10:13 +00:00
siraj.yasin 0c092bbc6a Fix the regex with job trigger filter
Change-Id: I0489ea1485f95f46c6794578c8c47d41598ac3e7
2021-05-24 12:45:52 +00:00
Zuul db5442ce14 Merge "Update deployment job voting status" 2021-05-21 22:59:49 +00:00
Zuul e0d394588d Merge "Add filter rules to Job trigger" 2021-05-21 14:20:41 +00:00
Drew Walters 8ca990371d Update deployment job voting status
Now that the site deployment jobs are green and reliable, make them
voting so that breaking changes are not introduced.

Signed-off-by: Drew Walters <andrew.walters@att.com>
Change-Id: I69cede69807f3d018f87cd3a52d7ef03291232af
2021-05-21 13:56:39 +00:00
siraj.yasin 17a9ccfae7 Add filter rules to Job trigger
* Trigger deployment job only when relevant files are updated and
  ignore on any document updates

Change-Id: Icac40a35071950639ca04593662e9e6d460519a3
2021-05-20 20:57:28 +00:00
Alexey Odinokov 2946a13806 Adding a place for external secrets to be stored on site level
1. Reflecting changes done in [1] to treasuremap.
2. Changing airshipctl ref to [1]
3. Making static validation work, since it was merged before [1]
4. Adding dex.ldap.bind_password to imported secrets
5. Adding dex.oidc.clientSecret to generated secrets
6. Due to the added new site - increasing the validation timeout
7. Adding replacement for [2]

[1]
https://review.opendev.org/c/airship/airshipctl/+/786286

[2]
https://review.opendev.org/c/airship/treasuremap/+/788991

Relates-To: #128
Change-Id: I473ace3d7aae85ebe76b73253108c6f1b6ca6e95
2021-05-20 05:34:19 +00:00
Drew Walters 1534abf6ad Remove multi-tenant type inheritance
This commit removes the relationship between the multi-tenant and
airship-core types. Since the airship-core type deploys LMA, adding an
LMA sub-cluster to the multi-tenant type would result in deployment of
the LMA stack twice if the inheritance is not removed.

Closes: #116

Signed-off-by: Drew Walters <andrew.walters@att.com>
Change-Id: Ie7dd236af3836d904e41df866e0c2351b7cb0558
2021-05-18 20:54:48 +00:00
Drew Walters e046a3d5f1 Update validate site docs job timeout
Additional sites in Treasuremap mean that the runtime of this job is
longer. This change updates the timeout to accommodate additional sites.

Signed-off-by: Drew Walters <andrew.walters@att.com>
Change-Id: I05a8ca5200cc5e987f0c15884434f5c5d01dfcd8
2021-05-11 20:46:55 +00:00
siraj.yasin 11bf0c983f Disable Verify HWCC gate script
* HWCC was removed in this PS
  https://review.opendev.org/c/airship/treasuremap/+/787003

* Currently Zuul gate is passing all the stages except the last
  verify hwcc step.

* Zuul gate for treasuremap deploy test site should be green with this PS

Change-Id: I753a59d58c5ed605d418a1c695a5cd960e5135fa
2021-05-10 16:40:50 +00:00
siraj.yasin 25ad182f32 Disable update github issue job.
* BOT will be configured to listen for treasuremap repo changes and
  add/update comments and issues status ( close ) as applicable.

Change-Id: I2e2070461e60fc75dd2066432c4f5cd48023c5e3
2021-04-29 17:26:19 +00:00
Sreejith Punnapuzha 40f7f38f7e Fix deployment scripts
* fixes labeling issue with deployment scripts
 * allign scripts with airshipctl and treasuremap
 * update playbook and zuul job with script changes

Signed-off-by: Sreejith Punnapuzha <Sreejith.Punnapuzha@outlook.com>
Change-Id: I43221565ab29fc78a60fbd4978c058eec5c88640
2021-04-16 15:48:37 -05:00
Zuul 4295bc0678 Merge "Update deployment job timeout" into v2 2021-03-26 00:08:07 +00:00
Zuul 35e3df96df Merge "Update deployment job node" into v2 2021-03-26 00:08:04 +00:00
Drew Walters c471c6ca63 Update deployment job timeout
The Treasuremap deployment jobs sometimes timeout prior to the desired,
script-defined timeout of the worker node deployment script. This change
increases the timeout of the deployment jobs to account for the
difference in time that the deployment script specifies.

This will make the jobs more reliable; however, there is still another
deployment error that occurs that will prevent us from making the jobs
voting in the meantime.

Signed-off-by: Drew Walters <andrew.walters@att.com>
Change-Id: I7b1bae7bb4445516ebef11cd7a92730e95512462
2021-03-19 13:32:23 +00:00
Drew Walters d95f11941f Update doc validation job to use airshipctl ref
Currently, the document validation job uses the master branch of
airshipctl rather than the reference used by the deployment jobs. This
change updates the job to use the same reference for consistent
validation results.

Closes #110

Signed-off-by: Drew Walters <andrew.walters@att.com>
Change-Id: I243ce1cf0bea7ed9d8014005da6055725f91810d
2021-03-18 21:13:17 +00:00
Drew Walters 46e6fea0f0 Update deployment job node
The Treasuremap deployment jobs currently run on 16GB nodes and cannot
support the workloads we are deploying in Treasuremap. Often times, this
results in timeouts and frequent rechecks. This change ups the capacity
for our jobs to match airshipctl's gating job, using the 32 GB node
label.

Signed-off-by: Drew Walters <andrew.walters@att.com>
Change-Id: I5126a41acbe670651eed99e8be3fe0e69d3bd8fc
2021-03-18 20:13:17 +00:00
siraj.yasin 1b68187163 Fix airshipctl ref used for deployment.
* Corrected the varaible name used to set airshipctl reference.

Change-Id: Ibc887c5390b707bd131af0106078bff97e2eb14c
2021-03-11 17:27:43 +00:00
siraj.yasin ea57ab4ff9 Added HWCC verification script.
* Added HWCC verification script.
* include install pip script
* include install yq script

Change-Id: I835d5c080fd7a02d14a63109c271c397355ee3eb
2021-03-05 16:20:04 +00:00
siraj.yasin 27d31a22f7 Pinning airshipctl version in treasuremap
* Treasuremap is dependant on airshipctl repo. So pinning the last
  good tested version of airshipctl in treasuremap

Change-Id: I6923da9871b946134fbdc285c38bcb8f967aa804
Relates-To: #100
2021-03-01 18:11:36 +00:00
Sirajudeen 43f8dab09a Fix treasuremap deployment issues.
* Fixes validate_docs for treasuremap
* Align the secret encryption/decryption changes of airshipctl
* Aligning the manifest changes of airshipctl.
* Added HWCC.
* Replaced helm-operator with flux-helm
* Updated node parameters.

Relates-To: #77
Closes: #95

Change-Id: I30408de468ac2794703b95a2afc6191908567816
2021-02-26 15:15:13 +00:00
Sirajudeen 610fb1cd1f Aligned CAPI script with airshipctl
* Aligned the CAPI deployment script with recent changes of
  airshipctl

Change-Id: I2568a7d1a71f3778bb1a8bb02ce8e1b8c758aece
2021-02-02 20:24:47 +00:00
Matt McEuen 876f1ae754 Align treasuremap to image-builder
This trues up treasuremap to the airshipctl change below, which changes
configuration (and naming conventions) to match the new image-builder
that can be used for both iso and qcow generation.

https://review.opendev.org/c/airship/airshipctl/+/758782

Change-Id: I821fda77da899af667a22033281f44dd2dd82a31
Closes: 72
2020-12-23 17:01:21 -06:00
Zuul aacdbc2f41 Merge "Disable worker node deployment" into v2 2020-11-16 19:42:20 +00:00
Drew Walters d05e1462be Add virtual-network-cloud deployment job
This change adds a job to deploy the virtual-network-cloud test site by
extending the test-site job.

Depends-On: https://review.opendev.org/748517

Change-Id: Ia4b8da334979fa1de70d3619b3e6ed85b8e591dc
Signed-off-by: Drew Walters <andrew.walters@att.com>
2020-11-04 23:11:01 +00:00
Drew Walters 8547656a68 Add document pull functionality to deploy job
This change introduces airshipctl's document pull functionality to the
Treasuremap gate runner job. This enables Treasuremap maintainers to pin
to a version of airshipctl deployment scripts and manifests that are
known to be compatible with Treasuremap's v2 branch.

In order to ensure that the deployment scripts and manifests come from
the same version of airshipctl, this change introduces a playbook that
checks out the referenced version of airhsipctl after it is cloned by
Zuul. It also checks out the known version a second time in the
deployment scripts for operators invoking the scripts in a non-Zuul
environment.

To update the pinned version of Treasuremap using Zuul, change the Zuul
variable airshipctl_ref. To update the pinned version in a non-Zuul
environment, use the environment variable AIRSHIPCTL_REF.

Change-Id: I300f545efcdd024b689a96ee99e502de7fdd1b83
Signed-off-by: Drew Walters <andrew.walters@att.com>
2020-11-04 23:11:01 +00:00
Drew Walters 416f93ceca Disable worker node deployment
This change disables worker node deployment in the
continuous-integration job. Worker node deployment is not essential to
Treasuremap CI, and it is blocking workload tests. We can address this
later.

Change-Id: Iaaaabcc0ea113f8104db9370ae820389bf96c284
Signed-off-by: Drew Walters <andrew.walters@att.com>
2020-11-03 16:00:25 +00:00
Zuul aa05b04133 Merge "Cleaning: clusterctl" into v2 2020-10-28 20:01:58 +00:00
Stanislav Egorov 673fca0e0f Cleaning: clusterctl
clusterctl script has been removed in airshipctl
commit 8307148482a1f661f14cd8e4de3e3a8ae300a203

Change-Id: Ibf9589791b406c71a37257b13339e13b6bff04e4
2020-10-28 02:05:06 +00:00
Sirajudeen fa2b41d724 Moving to token based Auth for github
* Moving from user/password to Token based auth for
  Github Access

* Github password based authentication will be deprecated soon
  https://developer.github.com/changes/2020-02-14-deprecating-password-auth/

Change-Id: Ia9cba4713f3dd1c8fe074c980625fca7fe624e61
2020-10-26 19:17:12 +00:00
Drew Walters 6d0e1234d9 Update deployment scripts to match airshipctl
New deployment scripts have been added to airshipctl but are missing
from Treasuremap. This change updates the series of deployment scripts
to include those recently added to airshipctl.

Change-Id: Ieb827d079709a3962b35b43b1d5534ba9de20ad5
2020-10-06 13:06:47 +00:00
Drew Walters 1c9a185d2f Update deployment job timeout value
The timeout value for the deployment job in Treasuremap is half the
value of the timeout in airshipctl, yet, the Treasuremap job should take
longer due to the workload it deploys. This change updates it to match
airshipctl.

Change-Id: Ib1e069bc5324e88679b92bba98f4a96d40831ba4
Signed-off-by: Drew Walters <andrew.walters@att.com>
2020-10-05 15:47:39 +00:00
Drew Walters 4d6293ee6b Add target/workload phase to CI jobs
This change adds a script to the deployment job in order to test
deployment of the workload phase.

Change-Id: I9e17290d53017483ddbe5fdab70af584a2822aed
Signed-off-by: Drew Walters <andrew.walters@att.com>
2020-08-31 10:52:50 +00:00
Matt McEuen 5edbcba972 Add target phase to test-site
This adapts work from airshipctl:
https://review.opendev.org/#/c/738291/

Change-Id: I8213cfbf651156320ef46cbab3b6d325fde185d0
2020-08-21 14:31:53 +00:00
Matt McEuen 425e7adcda Add deployment gate
This adds airshipctl as a testing, and calls its deployment
scripts to launch a VM-based test.  This will be used to validate
treasuremap deployment manifests.

Change-Id: If4fa60f896211d2f6b63271b58b96541c399694c
2020-08-06 08:16:57 -05:00