Commit Graph

228 Commits (master)

Author SHA1 Message Date
Zuul ebc1589537 Merge "Adding dead-link-linter gate" 2021-11-18 19:35:10 +00:00
Zuul 72cfb01540 Merge "Allow validate script to read airship config" 2021-11-18 15:25:12 +00:00
Danny Massa f9ae26105b Adding dead-link-linter gate
Change-Id: I3b97e42abf5084a6dbd46616327e7bfe7b1a9791
2021-11-17 13:16:38 -06:00
Sreejith Punnapuzha 5afbb354d5 Align docker install role with airshipctl
airshipctl is using upstream ensure-docker role instead of
docker-install. correcting this in treasuremap

Signed-off-by: Sreejith Punnapuzha <>
Change-Id: Ideea1d9f641d6abad1d9f7c37698f7c09f778fce
2021-11-04 15:56:40 +00:00
Siraj Yasin a06003c004 update secrets to align with airshipctl
* Align treasuremap virtual-airship-core site to recent changes of
* This PS takes care of only the "airship-core" type and all other
  sites will fail validate docs untill the secrets are aligned.
* So the validate_docs is invoked with parameter "virtual-airship-core"
  to run document validation just for virtual-airship-core

  reference airshipctl commit: e2c56108eef38dd83df52fcfd1fa6844e5376a56

Change-Id: I2e6149951beca570a3cadeecbc05366325c80286
2021-09-29 15:48:56 +00:00
Sirajudeen 64e4fa9eec Set default site name to virtual-airship-core
* For zuul jobs respective site_name is set from jobs.yaml,
  however when running gate scripts for local deployment we are not using
  jobs.yaml and so it defaults to test-site from the config created
  using template from airshipctl repo.

Change-Id: I0f4b975f78db4161048eb0621a9cc25933141f63
2021-07-14 20:42:14 +00:00
Sirajudeen 0150d774d3 Rename Virtual Sites in Treasuremap
* Renamed test-site to virtual-airship-core

Relates-To: #154
Change-Id: I15905a5be8628b35f1cebcba95e3257f541d4e74
2021-07-12 19:01:49 +00:00
Sirajudeen af84cc8c4e [uplift] - Uplift airshipctl to stable version
Airshipctl reference commits:

       Update metadata.yaml to kubernetes style

       Move CAPI resources to target-infra namespace

       Embed validation cfg into phase and plan definition

       Enable static validation for all available plans per site

       Decouple secret from other replacements in workers-capm3

       Added replacements for composite/infra

Change-Id: I2c107b3d2b94acda540b09792640dbafd55b23eb
2021-06-24 18:31:24 +00:00
Zuul 65be6e300b Merge "Treasuremap gate script fixes" 2021-06-23 22:24:38 +00:00
Sirajudeen fa049f7d38 Treasuremap gate script fixes
* With the new directory structure in tools/depoyments there is a
conflict with the airshipctl dependency in treasuremap. So using
the treasuremap specific playbooks for gate runner tasks.

Change-Id: Id64f5b8000cb646d5dd2acc5d1d4179729e2ee4e
2021-06-21 23:08:54 +00:00
Sirajudeen c6df58d760 Patch plan with type/site specific phases
* Use patch to re-define the plan definition with required
  sequence of phases applicable to the specific type/site instead of
  defining a new plan.
* The idea of this change is to have one unique plan for deployment
'deploy-gating' with its own definition per type/site.

RelatesTo: #176
Change-Id: I162883dd2e86b709fbb483b985130e8748d8e557
2021-06-21 19:50:58 +00:00
Vladislav Kuzmin b6ce028dcc Add phase plan for airship-core gating
Uplift airshipctl to version with new phases.
Add phases from zuul job in deploy-airship-core-gating.

Relates-To: #166
Change-Id: I98b605d16940fab2a728e4646e52c7d1ad992c2d
2021-06-11 18:50:34 +04:00
James Gu 663527ceeb Allow validate script to read airship config
Changed the validate script to read the airship config file for manifest
root, site root, and repo url values. This enables the use case where
the user runs the init_site script and creates their own project and
site folder outside of the treasuremap directory strucuture.

Change-Id: I0eefdc385bffa600f5e942cec14f42ebd392782f
2021-06-10 08:14:16 -07:00
Ian Howell ab02dee4e0 Add workload-config-target phase
Change-Id: I41f1e8e36321d2ac13a7947a635c41f81eded0b0
2021-06-09 08:27:51 -05:00
Ian Howell 12fc147cea Add type-specific deployment scripts
This change restructures the deployment script directory to support
type-specific deployment scripts. As sub-clusters are added, those
scripts will only be relevant to the multi-tenant type. The distinction
between which scripts should be used for each type will prevent
unexpected deployment errors.

Co-authored-by: Drew Walters <>
Change-Id: Ic14d4536bc9e593ab81c94b5c1dcec063a93ed18
2021-06-03 18:23:33 +00:00
Sreejith Punnapuzha 761b1b049f Remove labeling from scripts
This commit removes assigning labels from deployment scripts. Labeling
will be managed via KubeadmControlPlane templates.

Signed-off-by: Sreejith Punnapuzha <>
Change-Id: I17ebd6663663b6e456e9e968a9f1468295c6232c
2021-05-17 12:25:00 -05:00
Sreejith Punnapuzha c28947eba4 Fix labeling issue for deployment scripts
This commit fixes labeling issue for deployment scripts in v2.0 branch

Signed-off-by: Sreejith Punnapuzha <>
Change-Id: I80af2027c12608d0ccf2f505b20e49acbddbdb2c
2021-05-06 18:15:28 +00:00
James Gu 404b32ef87 Added overwrite flag in script 31 and 35
This is a needed workaround for host config generator from some recent
changes. Only add the workaround to 2.0 branch for the GA release.
The actual fix should go to v2 branch.

Signed-off-by: James Gu <>
Change-Id: Ied0d8712fd154e8e7c979a551417a6429c148456
2021-05-06 18:15:28 +00:00
James Gu ad5fabe0d6 Add script for controlplane_target phase
controlplane_target phase is required for multi-node target cluster.

Signed-off-by: James Gu <>
Change-Id: I2af1c815588c1ad457b59af8f2f0cb515ba33ce6
2021-05-06 18:15:28 +00:00
Sreejith Punnapuzha 6b81b829df Create secret with ssh-key for hostconfig-operator
This commit adds secret creation to hostconfig-operator.

Signed-off-by: Sreejith Punnapuzha <>
Change-Id: I8a92a07e1aaf653708b6e4d9fa8e300ebb3a9468
(cherry picked from commit 87a82989b6)
2021-05-06 18:14:55 +00:00
Sreejith Punnapuzha b734c5549a Fix metadatapath in airship config for treasuremap
Correct the metadatapath for airshipctl config in treasuremap and assign
it to manifest

Signed-off-by: Sreejith Punnapuzha <>
Change-Id: I0f36f3cf6452ac38f2a9e9f3d9469e3f65c36357
(cherry picked from commit 0b6375e25a)
2021-05-06 15:23:55 +00:00
James Gu 89fc29184a Enhanced deployment scripts to support baremetal multi-node
Additionally aligned between Treasuremap and Airshipctl to use the same
environment variable name "SITE" for a site name.

Change-Id: Id6405b7074d34bc73d730eea76d9dd6ab7901405
Signed-off-by: James Gu <>
2021-05-06 15:23:55 +00:00
Ratnopam Chakrabarti 8a7f428c5b Add Phases for deploying network policy
This PatchSet adds phases and executor definitions for managing calico v3 network policies
using airshipctl phase run command.

Closes: #119
Change-Id: I7942548720c4b8037b7b0c2de348fe45df73b8f7
2021-04-30 18:25:12 +00:00
Alexey Odinokov e3caf14b0d Switching to the approach with cleanup by selector
Changes to reflect [1] in treasuremap
Fixed issue in /tools/deployment/
Aligned the tag of replacement pluging everywhere


Relates-To: #125
Change-Id: I24e3228e73714a14d42f28743b20f89d860f950e
2021-04-21 16:38:23 +00:00
Sreejith Punnapuzha 868a737775 Fix deployment scripts
* add $ for kubectl command in host variable
 * remove controlplane labels as they are added via k8scontrol role

Signed-off-by: Sreejith Punnapuzha <>
Change-Id: Idc30a6704504dc151f7da4c6d551d2f8854bdd79
2021-04-19 17:55:03 -05:00
Sreejith Punnapuzha 40f7f38f7e Fix deployment scripts
* fixes labeling issue with deployment scripts
 * allign scripts with airshipctl and treasuremap
 * update playbook and zuul job with script changes

Signed-off-by: Sreejith Punnapuzha <>
Change-Id: I43221565ab29fc78a60fbd4978c058eec5c88640
2021-04-16 15:48:37 -05:00
Zuul 848ee68f2d Merge "Set repo url in generate secret script" into v2 2021-04-13 00:46:05 +00:00
James Gu 12d4828d18 Set repo url in generate secret script
Set the repo url in the generate secret script in the case that
the user's project and site were created outside of the treasuremap

Signed-off-by: James Gu <>
Change-Id: Ie5a80b5df4f0ab33617d72daf75685b06cb2b407
2021-04-12 14:48:12 -07:00
Sreejith Punnapuzha 87a82989b6 Create secret with ssh-key for hostconfig-operator
This commit adds secret creation to hostconfig-operator.

Signed-off-by: Sreejith Punnapuzha <>
Change-Id: I8a92a07e1aaf653708b6e4d9fa8e300ebb3a9468
2021-04-10 20:33:03 -05:00
Sreejith Punnapuzha b8936307e5 Cleanup metadata and target path setup
Cleanup metadata and target path setup in 22_test_configs script.

Signed-off-by: Sreejith Punnapuzha <>
Change-Id: I9c3332fb125f3d95427ea2c1c00465aba31afd06
2021-04-06 15:09:44 -05:00
Zuul b4e5cb7c24 Merge "Fix metadatapath in airship config for treasuremap" into v2 2021-04-06 17:39:56 +00:00
Sreejith Punnapuzha 0b6375e25a Fix metadatapath in airship config for treasuremap
Correct the metadatapath for airshipctl config in treasuremap and assign
it to manifest

Signed-off-by: Sreejith Punnapuzha <>
Change-Id: I0f36f3cf6452ac38f2a9e9f3d9469e3f65c36357
2021-04-05 11:23:38 -05:00
Matt McEuen 51e713f6f5 Update Airshipctl pin, kustomize install condition
Updates the airshipctl pin to include a fix which enables deployment
of sites other than test-site:

Change-Id: Ia4f8d9048dc0fd0e3b7eb1e3734f37350a3d7110
(cherry picked from commit a13eb1f12b)
2021-04-05 15:38:30 +00:00
James Gu dfe56aa1ba Add kustomize install in
kustomize is a useful debug tool when rendering fails

Relates-To: #120

Change-Id: I2b30c32d43df288a0d44df6d8edf0d0ba3b11191
Signed-off-by: James Gu <>
2021-04-01 13:18:10 +00:00
Manoj Alva(ma257n) f61bfd70a8 Added support for failsafe rules
- Global policies placed under type/airship-code/network-policies
- site level policies/modifications placed under

Change-Id: Ic8245d3263a867babd29773540175f8646e193e0
2021-03-26 15:26:38 +00:00
Sreejith Punnapuzha 3a51c0c487 Align airship manifest config directory
Align airship manifest config directory in generate secrets script with
that in test config

Signed-off-by: Sreejith Punnapuzha <>
Change-Id: Ie33a85cdea60e18599383d1fec8394f3b2255f9d
2021-03-25 14:52:59 -05:00
James Gu ad658328ef Enhanced deployment scripts to support baremetal multi-node
Additionally aligned between Treasuremap and Airshipctl to use the same
environment variable name "SITE" for a site name.

Change-Id: Id6405b7074d34bc73d730eea76d9dd6ab7901405
Signed-off-by: James Gu <>
2021-03-24 15:32:35 -07:00
Sreejith Punnapuzha aaeedd1fac Add target path configuration to airshipctl config
As part of set-manifest, currently the default directory is getting
added to targetPath field in airshipctl config. This commit adds option
for user to set the target path via environment variable.

Signed-off-by: Sreejith Punnapuzha <>
Change-Id: Ie88e12059663fca75572d081630746233dbd365c
2021-03-18 13:10:14 +00:00
Steven Fitzpatrick 7aef5fe7a7 Treasuremap Monitoring composite
This change adds a function for deploying banzaicloud/thanos-operator,
a composite which deploys grafana and a thanos querier,
and a phase documents for running this composite in the target cluster

This change includes a couple of thanos operator CRs, located in
function/lma-configs, which can be applied by running the phase

Change-Id: I406b45373b6029b2503e11883bb6aa91ebbac481
2021-03-15 14:54:43 +00:00
Matthew Fuller 8f5fc38b56 Fix site doc validation failure
Removes the default path of '/tmp/default' from
MANIFEST_ROOT and replaces it with the dirname of the current
(treasuremap) directory.

Closes: #89
Change-Id: Iccf2627cc11567ce1a6065fae8cef53f806a63ea
2021-03-11 18:43:23 +00:00
Steven Fitzpatrick 52e072ef8a Add gate utility scripts to Treasuremap
These scripts allow one to stand up a treasuremap test-site

note: Removing the phase  lma-infra-target from script 31, since
it causes a wait to fail later on in the pipeline

Change-Id: I43374a874c110ab32d6158975c50fd4b89693479
2021-03-08 20:27:20 +00:00
siraj.yasin ea57ab4ff9 Added HWCC verification script.
* Added HWCC verification script.
* include install pip script
* include install yq script

Change-Id: I835d5c080fd7a02d14a63109c271c397355ee3eb
2021-03-05 16:20:04 +00:00
Steven Fitzpatrick 772b18afd9 Create an 'LMA-Infra' Composite
This composite deploys the logging and prometheus operators
such that they are ready to collect logs and metrics from a k8s cluster.
The operators can be extended by introducing custom resources, allowing
any application running in the cluster to use these services

Note: Due to [0], this composite cannot be successfully deployed in the
initinfra-target phase, so a separate 'lma-infra' phase is introduced


Change-Id: Ia20cc7bdaeb2b2f52ba4bcdc8e55a202ef4b0110
2021-03-03 21:32:45 +00:00
siraj.yasin 27d31a22f7 Pinning airshipctl version in treasuremap
* Treasuremap is dependant on airshipctl repo. So pinning the last
  good tested version of airshipctl in treasuremap

Change-Id: I6923da9871b946134fbdc285c38bcb8f967aa804
Relates-To: #100
2021-03-01 18:11:36 +00:00
Sirajudeen 43f8dab09a Fix treasuremap deployment issues.
* Fixes validate_docs for treasuremap
* Align the secret encryption/decryption changes of airshipctl
* Aligning the manifest changes of airshipctl.
* Added HWCC.
* Replaced helm-operator with flux-helm
* Updated node parameters.

Relates-To: #77
Closes: #95

Change-Id: I30408de468ac2794703b95a2afc6191908567816
2021-02-26 15:15:13 +00:00
Sirajudeen 610fb1cd1f Aligned CAPI script with airshipctl
* Aligned the CAPI deployment script with recent changes of

Change-Id: I2568a7d1a71f3778bb1a8bb02ce8e1b8c758aece
2021-02-02 20:24:47 +00:00
Sirajudeen 1ceecb22d5 [Typo-Fix] - Removing the extra line separator
Change-Id: I3469cdbaffee6641559ebd70c1df2a48a55b6484
2021-01-05 16:58:20 +00:00
Matt McEuen 876f1ae754 Align treasuremap to image-builder
This trues up treasuremap to the airshipctl change below, which changes
configuration (and naming conventions) to match the new image-builder
that can be used for both iso and qcow generation.

Change-Id: I821fda77da899af667a22033281f44dd2dd82a31
Closes: 72
2020-12-23 17:01:21 -06:00
Drew Walters 8547656a68 Add document pull functionality to deploy job
This change introduces airshipctl's document pull functionality to the
Treasuremap gate runner job. This enables Treasuremap maintainers to pin
to a version of airshipctl deployment scripts and manifests that are
known to be compatible with Treasuremap's v2 branch.

In order to ensure that the deployment scripts and manifests come from
the same version of airshipctl, this change introduces a playbook that
checks out the referenced version of airhsipctl after it is cloned by
Zuul. It also checks out the known version a second time in the
deployment scripts for operators invoking the scripts in a non-Zuul

To update the pinned version of Treasuremap using Zuul, change the Zuul
variable airshipctl_ref. To update the pinned version in a non-Zuul
environment, use the environment variable AIRSHIPCTL_REF.

Change-Id: I300f545efcdd024b689a96ee99e502de7fdd1b83
Signed-off-by: Drew Walters <>
2020-11-04 23:11:01 +00:00
Stanislav Egorov 673fca0e0f Cleaning: clusterctl
clusterctl script has been removed in airshipctl
commit 8307148482a1f661f14cd8e4de3e3a8ae300a203

Change-Id: Ibf9589791b406c71a37257b13339e13b6bff04e4
2020-10-28 02:05:06 +00:00