208 Commits

Author SHA1 Message Date
James Gu
3232e3d9f9 Add kustomize install script
kustomize is a useful tool for debugging when rendering fails

Relates-To: #504

Signed-off-by: James Gu <james.gu@att.com>
Change-Id: I649c74bb7868a80618617db16dc1f1028c262c11
2021-03-30 10:51:37 -07:00
Zuul
310bc282f5 Merge "[#358] Introduce Phase List command to output phase list(cmd module)" 2021-03-30 01:02:39 +00:00
Zuul
9f0c254733 Merge "Changing personal images with upstream for Sops" 2021-03-27 07:47:41 +00:00
Zuul
b38dfb4929 Merge "Add pause annotation to bmh object" 2021-03-27 05:11:29 +00:00
Zuul
5e06ad2287 Merge "Add permission to home folder in pip installation" 2021-03-27 00:37:06 +00:00
Alexey Odinokov
988cd9f99b Changing personal images with upstream for Sops
During our work we used personal images, because
there was no upstream available. Now when the
upstream is avaialbe - we're changing all urls to it.

Change-Id: I6e8344723e343c4396304d68908fae328d139434
2021-03-26 16:17:27 +00:00
Zuul
e685fb2f1c Merge "Remove "time" leftover from previous patchset" 2021-03-26 02:33:58 +00:00
Zuul
c7516c3f05 Merge "Change default worker count (capd)" 2021-03-25 22:01:44 +00:00
Sreejith Punnapuzha
e4970aa37d Add permission to home folder in pip installation
Pip installation of package with sudo will fail because of permission
issues in home folder. Adding -H option to sudo to fix this.

Signed-off-by: Sreejith Punnapuzha <Sreejith.Punnapuzha@outlook.com>
Change-Id: I60222b300591aecdbd5e27a0bb86c1c62daca289
2021-03-25 15:00:05 -05:00
Zuul
929b11b8bc Merge "Bump timeout for controlplane phases" 2021-03-25 19:11:40 +00:00
Battina, Sai (sb464f)
5edde6b4f6 Add pause annotation to bmh object
Change-Id: I245aa4e57f3e249b4dff740e3eb642f9c73890c0
2021-03-25 13:45:29 -05:00
Kostiantyn Kalynovskyi
34ade93029 Remove "time" leftover from previous patchset
time command infront of airshipctl is a forgotten piece that needs
to be removed.

Change-Id: I6262e5382e59dab5ef51ca541a57d89522f59197
2021-03-25 17:09:35 +00:00
Niharika Bhavaraju
0cc7c9cafd [#358] Introduce Phase List command to output phase list(cmd module)
* Phase list command lists phases of current documentset/plan.
 airshipctl phase list
 airshipctl phase list --plan planName
 airshipctl phase list --plan planName -o table(default output)
 airshipctl phase list --plan planName -o yaml

Co-Authored-By: Niharika Bhavaraju <niha.twinkle@gmail.com>

Relates-To: #358

Change-Id: Iab3a6cdf5a25583ba3d01341da350841c9cc362d
2021-03-25 16:11:10 +00:00
Zuul
76e345b862 Merge "Pin krm function calls" 2021-03-24 21:34:06 +00:00
Sean Eagan
299b2833b2 Pin krm function calls
This pins krm function calls to version `v2` which represents [0] [1] the latest
2.x.x semantic version. If we need to make breaking changes to any krm functions,
that can now be done by incrementing their major version and thus not
breaking these references.

[0]: https://review.opendev.org/c/airship/airshipctl/+/762924
[1]: https://review.opendev.org/c/airship/airshipctl/+/780875

Closes: #419
Change-Id: I6cf6519511c77da6cac7e46a6b56ea338bcf150c
2021-03-24 09:28:54 -05:00
Rishabh Kumar Jain
a4548cb9ea Change default worker count (capd)
* change default worker count to 2
      from 1
    * remove usage comments to scale workers
      in deployment script

Change-Id: Ic880deea7d3ff104cb2af39b1b81c53a331d353f
2021-03-23 14:10:48 -07:00
Zuul
a6b4eef607 Merge "Enhanced deployment script to support baremetal multi-node" 2021-03-23 20:38:00 +00:00
Zuul
bb37ba1382 Merge "SOPS improvements" 2021-03-23 17:41:00 +00:00
James Gu
1342ab708f Enhanced deployment script to support baremetal multi-node
Additionally aligned between Treasuremap and Airchipctl to use the same
environemnt variable "SITE" for a site name.

Change-Id: I50494b50691a40efe68996cd11ccede6517b23d6
Signed-off-by: James Gu <james.gu@att.com>
2021-03-23 06:21:31 -07:00
Alexey Odinokov
a7e332f9ec SOPS improvements
Added 2 phases:
1. secret-reencrypt - This phase can be used to
reecnrypt the existing secrets with new key.
To do so SOPS_IMPORT_PGP must contain
old public key and new private key (but
may also include other data).
SOPS_PGP_FP must contain fingerprint of
new private key.

2. secret-show - This phase may be useful for some users
that need to see what generated by secret-generate phase.

Disabled SOPS debug by default.
To enable it back run commands with
env variable DEBUG_SOPS_GPG=true

Change-Id: Id7fe13d6943d386577df25dba4aaa83e62e58980
2021-03-19 21:31:25 +00:00
Kostiantyn Kalynovskyi
3fbf865048 Fix CAPD deployment
Commit fixes CAPD deployment and removes redundant scripts
that check expiration for CAPD site.

They must be tested separately outside CAPD pipeline

Related-To: #482
Closes: #482
Change-Id: I60ffd76a4f3f08bd7bd198a0c2b15483dfbdd6a6
2021-03-19 11:31:21 +00:00
Ruslan Aliev
026c71ce6e Bump timeout for controlplane phases
Exceeding the timeout (2000s) for controlplane phase is one
of the common reasons of failure gate-script runner job. The new executor
with bumped timeout value was created for controlplane-* phases to help avoid
timeout error. The examples of exceeding timeout error can be found here:

[1] https://zuul.opendev.org/t/openstack/build/b26d02fda3ab4e75938bd397c618a411
[2] https://zuul.opendev.org/t/openstack/build/73ae850e150c4ce18a1153cc352cebfc
[3] https://zuul.opendev.org/t/openstack/build/7683f126b5274eb492d00d80c73c4bbb

Change-Id: I77055e25c58a4103cdbd67b09710e22829e127a0
Signed-off-by: Ruslan Aliev <raliev@mirantis.com>
2021-03-11 14:16:09 -06:00
Kostiantyn Kalynovskyi
6207e2c24d Add multiple kubeconifg sources to ClusterMap
Change ClusterMap API object to support multiple kubeconfig sources
for a cluster. If one kubeconfig source fails, kubeconfig builder
will not fail and move on to the next one. This behaviour will allow
to support cases when ephemeral cluster is not accesible anymore or
when target cluster is not yet accessible.

For more information please read issue #460 in airshipctl github

Relates-To: #460
Related-To: #460

Change-Id: I7cd32f78cd7c4ad8814eac357424c24216f40d76
2021-03-10 18:22:30 +00:00
Zuul
ecb2a042dd Merge "Remove isogen executor and related code" 2021-03-09 19:21:45 +00:00
Zuul
749073228b Merge "Update capm3 to 0.4.0 to fix clusterctl move BMH bug" 2021-03-05 01:46:59 +00:00
Zuul
131bd990d6 Merge "Wait for CR tigerastatus to be available" 2021-03-04 22:49:13 +00:00
Sirajudeen
25ae719d12 Wait for CR tigerastatus to be available
* Wait for CRD's Established state.
* Wait for CR tigerastatus to show up in api to query
* Once CR is created, wait for its condition to be available.

Change-Id: Ibb83e16a15a7e0e351b6ae030e3e82ce22d41c70
Closes: #442
2021-03-03 00:49:36 +00:00
Ratnopam Chakrabarti
670658958b Update common provider script
Updated env variable TEST_SITE to SITE to remove
error with capd deployment
Updated scripts to use phase "initinfra-networking" for deploying
calico cni in target cluster

Change-Id: Ib372e8fe8d1124aa83c5e69a861c523a967c22c9
2021-03-02 16:47:30 +00:00
Sirisha Gopigiri
3bade9c0ed Update capm3 to 0.4.0 to fix clusterctl move BMH bug
This PS updates the capm3 version to 0.4.0, to fix the
clusterctl move BMH bug.

Closes: #466
Change-Id: If9369b6421bde628efee90f1a94681c13f9e749c
2021-03-02 10:06:10 +00:00
Vladimir Kozhukalov
f4001bcffa Remove isogen executor and related code
Isogen executor is not needed any more since there is
 iso build phase plan that runs two phases using generic
 containers.

Relates-To: #440

Change-Id: I3600e82fa1d8a92cdf103d93cd4536bf4a713cca
2021-03-02 08:14:57 +00:00
Zuul
e2af947337 Merge "Correct ephemeral image name in cleanup script" 2021-03-02 05:59:36 +00:00
Sreejith Punnapuzha
798bf4927c Correct ephemeral image name in cleanup script
Signed-off-by: Sreejith Punnapuzha <Sreejith.Punnapuzha@outlook.com>
Change-Id: I557c4dc8dfd25d2eee29b9dff1f7fe28e32229e7
2021-03-01 11:07:10 -06:00
Gage Hugo
8d76b7aeda Remove -x from 34_deploy_worker_node.sh
The deploy_worker_node script waits for the nodes to come up and
spams the logs as it runs. This change removes -x from the script
in order to remove a lot of unnecessary stdout since the script
already contains several echo statements to indicate progress.

Change-Id: I4c7465b6aa3538ea171f61387035e79c7d852088
2021-02-28 20:23:00 -06:00
Zuul
b3e31b78d9 Merge "SED script to update image repos for KRM functions" 2021-02-26 22:00:14 +00:00
Zuul
f4b7c70537 Merge "Airship in a Pod" 2021-02-26 15:50:22 +00:00
Zuul
795a15cb5d Merge "Set proper role for worker node" 2021-02-25 01:46:25 +00:00
Zuul
abc8315828 Merge "Implements custom QCOW delivery" 2021-02-24 05:21:01 +00:00
Andrii Ostapenko
3f559c3c1e
Implements custom QCOW delivery
With this commit QCOW images are pulled as a docker image to new
qcow-bundle container within ironic pod and copy them to shared ironic
volume to be served to hosts.

Also squashed with [0], manifests are adjusted to consume new QCOWs and
old QCOW related funtionality is removed.

[0] https://review.opendev.org/c/airship/airshipctl/+/776270

Co-Authored-By: Alexey Odinokov <aodinokov@mirantis.com>
Co-Authored-By: Craig Anderson <craig.anderson@att.com>

Change-Id: I958184b34ae94206bc5e87993e9287587b6a11d9
Signed-off-by: Andrii Ostapenko <andrii.ostapenko@att.com>
2021-02-23 15:43:45 -06:00
Fletcher, Stacey (sf5715)
a423607000 Airship in a Pod
Introduces Airship in pod. This includes:
* A base image which sets up common requirements
* An image for the libvirt service
* An image for building a specified instance of airshipctl
* An image for initializing the various libvirt infrastructure required
  for a deployment
* An image which runs the deployment scripts

Closes: #313

Change-Id: Ib1114350190b0fe0c0761ff67b38b3eca783161a
2021-02-22 19:55:44 -06:00
Zuul
0166bfc38f Merge "Fix role not found when running locally" 2021-02-23 00:58:56 +00:00
Zuul
0124d16aba Merge "Cleaning up not needed artifacts" 2021-02-22 21:22:41 +00:00
Ian Howell
fff18ea7b4 SED script to update image repos for KRM functions
This provides a script that can be used to swap out all instances of
current KRM function images with configurable replacements.  This will
be useful if an operator needs to use a private repo such as
artifactory.

Closes: #457

Change-Id: I5bb8b05737e7a3771517310ae64746660b6bf617
2021-02-22 11:16:17 -06:00
Sreejith Punnapuzha
879c93bad2 Fix role not found when running locally
This Commit fixes role not found issue when running script
20_run_gate_runner.sh

Signed-off-by: Sreejith Punnapuzha <Sreejith.Punnapuzha@outlook.com>
Change-Id: Ic671cf04f30ae9647b052ce31f2ca76fb80043cf
2021-02-22 10:03:24 -06:00
siraj.yasin
191736e852 Read manifest repository URL from env
* Read manifest repository URL from environment variable,
  so that it can be configured to use for other repos like
  treasuremap

Change-Id: I756e5be6fce72d4a5e7fe2d2f1115e92ea67843f
2021-02-19 21:41:28 +00:00
Alexey Odinokov
96379d25b3 Cleaning up not needed artifacts
Change-Id: I746a46a809907e6cae453a66361d68f3583783ff
2021-02-16 04:14:38 +00:00
Zuul
a252b248bc Merge "Adding encryption of k8s secrets and iso users passwords" 2021-02-12 23:11:52 +00:00
Alexey Odinokov
b51e7559b6 Adding encryption of k8s secrets and iso users passwords
This patchset introduces a generated with template [1] and encrypted
VariableCatalogue generated-secrets that contains steps to
generate: ephemeral and target CA+admin key/cert and passwords for
users in ephemeral bootstrap iso.

It also introduces the way how these secrets are used in manifests:
They're decrypted by kustomize and incorporated into the folders
`catalogues` in the site, so they can be used by replacement plugin.

This patchset contains modifications in replacement plugin
configurations to put the decrypted values from VariableCatalogue
in place.

Since k8s secrets were substituted with generated values
this patchset removes pre-generated k8s secrets.

[1]
manifests/type/gating/target/generator/secret-template.yaml

Change-Id: I0898c74012833f0e171d36bb8145acf358510b69
2021-02-12 04:07:36 +00:00
Alexander Hughes
2d523314d8 Bump linter from 1.29 to 1.36
Updating linter to latest version, which also updates
gosec to latest version to keep on top of updated security
checks in source code. Also disable gosec testing for rand.new.

Co-Authored-By: Alexander Hughes <Alexander.Hughes@pm.me>
Co-Authored-By: Sreejith Punnapuzha <Sreejith.Punnapuzha@outlook.com>
Change-Id: I46e71c41597f70150ace6d9611da5a01f93a933d
Signed-off-by: Alexander Hughes <Alexander.Hughes@pm.me>
2021-02-11 12:08:21 +00:00
Zuul
743f652494 Merge "Preparing zuul tests for secrets generation" 2021-02-11 07:22:22 +00:00
Zuul
40f24de8b0 Merge "Added verbose to gate runner playbook" 2021-02-10 22:27:22 +00:00