60 Commits

Author SHA1 Message Date
Kaspars Skels
3bc31be4b2 Move airship-seaworthy to seaworthy
Change-Id: Ide71456d1484b43ea434a23da858418adf51f23b
2019-06-10 17:41:33 -05:00
Evgeny L
8cf3062dcd [AIAB] Fix glance and heat overrides
Add explicit glance and heat overrides, this fixes problems
when two manifests with identical names are present,
one manifest comes from the type level, another one comes
from the site level, this leads to random manifest being
picked up during service deployment by Armada.

Change-Id: I87f6cce910dcf1f87370ba231077451990b245ee
2019-06-04 21:33:02 +00:00
Evgeny L
c88eb575b8 Add Airship-in-a-Bottle site manifests and scripts
Note: all scripts in tools/deployment/aiab directory have been
moved into this repository as is (except a few changes to make
them work), they require a heavy refactoring that will be done
in separate patch-sets.

* Add a virtual single node manifests that are based on a sloop type.
* Use NFS provisioner instead of Ceph.
* Update tools/openstack to be non-seaworthy specific, use a default
  region name and auth url.
* Make type/sloop/config/common-software-config.yaml to be site specific,
  to allow to configure custom region_name.
* Remove max-pods-per-cpu parameter for kubelet, treasuremap needs
  to support a diverse set of environments, without constraints
  on the number of available cores. Max pods configuration parameter
  is still present and helps to mitigate problems when kubernetes
  unexpectedly starts a large number of pods.

Change-Id: I379a50d810b91b989f039dbb7c691f5ceec0cc67
2019-05-24 16:23:07 +00:00
Zuul
0016279ae7 Merge "promenade_api proxy input correction" 2019-05-24 13:41:43 +00:00
Drew Walters
59a1fd8a1c airskiff: Use Ubuntu images
Since support for additional operating systems has been added to some
components, the image tag "latest" is no longer used by their Makefiles.
This commit changes the tags for the aforementioned components to use
the new default tag and updates the job name to reflect the use of
Ubuntu images.

Change-Id: Ia1adf156c4b3798b2400f9c821ac2ba685557591
2019-05-21 21:27:40 +00:00
Evgeny L
a4890271fd Airskiff: fix bridge name in a neutron config
Change-Id: Ic05bd54e07a2becc4c071cc69e95d86fbf6e04e5
2019-05-14 21:13:27 +00:00
kranthikirang
9bb7bbe36b promenade_api proxy input correction
Change-Id: I80f4df5458b0c2828b303e732a5d10b66e1aca98
Signed-off-by: kranthikirang <kranthi.guttikonda@att.com>
2019-05-03 15:34:46 +00:00
Zuul
2663c4d116 Merge "Created global layer chart for OpenStack Tempest" 2019-05-02 13:10:16 +00:00
matthew-fuller
ec1c7b1a3c Created global layer chart for OpenStack Tempest
Change-Id: I661726e9279cb71839547547481598ce2eddc208
2019-04-30 09:45:30 -07:00
Matt McEuen
376e3882f9 Fix airskiff endpoint catalog
This cleans up the Airskiff endpoints by basing them off of the
sloop version.

Change-Id: I9207315a03469e59b205d74097ac83e56d1a9772
2019-04-28 22:56:21 -05:00
Drew Walters
4e6a60ce1a airskiff: Use global Airship charts
Currently, Airskiff deploys a custom manifest defined in
tools/deployment/airskiff/manifests/airship.yaml to boostrap Airship
components. This exempts Airskiff from the daily version uplift process
and causes a divergence from the global UCP charts. This commit updates
the Airskiff bootstrap process to use the existing UCP charts at the
global layer.

Change-Id: I68dc405fda3cb1dbf5865104b657bdd75812e9bc
2019-04-26 15:33:44 +00:00
Kaspars Skels
b54d64f797 Fixes to MAAS HA and follow-up to comments
Change-Id: I571a0e3bc8355e0ac398175373df40334ebcd1af
2019-04-25 13:41:02 -05:00
Kaspars Skels
b40b833c94 Remove bonding references from Airsloop networks
Change-Id: Ie96a00a061dec925f70bfd6359c708d482c063bb
2019-04-24 15:54:36 -05:00
Evgeny L
ffde6bcbd5 Update links in the docs to refer to opendev
Sync of Airship project to Github has been stopped [0],
refer to opendev.org mirror instead of Github to
make sure the user is always referred to updated
repos.

[0] http://lists.openstack.org/pipermail/openstack-discuss/2019-April/005011.html

Change-Id: I31303af9176e90f13ef63bfea68ad3796710bae5
2019-04-23 13:49:10 +00:00
Zuul
d0dc46ed0f Merge "Add metadata proxy shared secret for Nova and Neutron" 2019-04-23 03:43:50 +00:00
Dimitrios Markou
46100f03c7 Integrate support for MAAS HA and VIPs
Change-Id: I1c7f3892a03536d94064da1722751eb6683da451
Signed-off-by: Dimitrios Markou <dimitrios.markou@att.com>
2019-04-22 17:08:20 +00:00
Evgeny
6514b2f77f Add metadata proxy shared secret for Nova and Neutron
Override default "metadata_proxy_shared_secret" parameter.
This secret is used by Neutron to sign instance-id headers
to prevent spoofing when proxying metadata requests.

Change-Id: I771d7f818a18b82d55bf781d71fc95114ac7e78c
2019-04-22 16:59:36 +00:00
Kaspars Skels
06ffeec6b1 Sloop type and Airsloop site
Sloop type/site is a minimalistic approach to Airship with reduced
requirements towards hardware and external dependencies while keeping
all the functional features.

Major differences compared to reference site airship-seaworthy
 - Two bare-metal server setup with 1 control, and 1 compute.
   Most components are scaled to a single replica and doesn't carry
   any HA as there is only a single control plane host.
 - No requirements for DNS/certificates.
   HTTP and internal cluster DNS is used.
 - Ceph set to use the single (root) disk. This generally
   provides minimalistic no-touch ceph deployment.
   No replication of ceph data (single copy).
 - Simplified networking (no bonding).
   Two network interfaces are used by default (flat PXE, and DATA network
   with VLANs for OAM, Calico, Storage, and OpenStack Overlay)
 - Generic hostnames used (airsloop-control-1, airsloop-compute-1) that
   simplifies generation of k8s certificates
 - Usage of standard Ubuntu 16.04 GA kernel (as oppose to HWE)

Change-Id: I4944fcae7d29ed8799d810c93efb0120b6b3a105
2019-04-12 16:11:37 -05:00
Evgeny
0aac1554cc Update docs to clarify certificates requirements
During the initial configuration it's required to
configure a set of valid certificates for ingress.
Make it more explicit so people don't miss this step.

Change-Id: Ie6477f934688467b7d5dfe1cc8191f6acff29a21
2019-02-28 00:07:39 +00:00
Chinasubbareddy Mallavarapu
56a91502a2 Ceph: journal partitions instead of whole disk
This is to represent specific partitions for journals
instead of  whole disk, ceph charts will create journal partitions
and default size is 10GB

Change-Id: I0f032a0d87396fe44f1179b3104ed446cc448d28
2019-02-10 23:41:09 +00:00
Bryan Strassner
bbfa8eada7 Update Shipyard Pod Configuration
Updates to use new Shipyard pod configurations, removes node port use.
Requires Shipyard commit a11e962eef5a5aa8f8fc15c4a324dfa6b2465061 or
newer.

Change-Id: Iff5af45d6b4f60c34d18aad821cf9afa4ea67dda
2019-02-05 22:10:49 +00:00
Zuul
3f04ed5b86 Merge "Neutron parameter min_l3_agents_per_router was removed in Ocata" 2019-01-24 02:22:49 +00:00
Evgeny L
3fb20e7c43 Neutron parameter min_l3_agents_per_router was removed in Ocata
This parameter has been deprecated in Newton and removed [1] in Ocata.

[1] https://review.openstack.org/#/c/385604/

Change-Id: I4e0130fea0375754cebb4a22d2248346f313fe6d
2019-01-18 22:54:43 +00:00
Drew Walters
03b02165b2 airskiff: Disable rabbitmq tests
Currently, the tests for the OSH rabbitmq charts are disabled; however,
the value that disables the chart is sometimes discarded during document
layering because the `.test` value does not get merged with the parent
document.  This commit adds an action to merge the test key and disable
the rabbitmq tests.

Change-Id: Ia23042bd03871cc085f69c232a85375571282af6
2019-01-18 14:30:16 -06:00
Evgeny L
3d231ecc25 Remove unused Kibana credentials
Kibana chart is configured with elasticsearch and ldap
credentials, so both kibana password and user are not
used for the configuration.

Change-Id: Ic83087b3bc732d539ac2b837f9c925d0e4ee9849
2019-01-17 23:23:01 +00:00
Zuul
a850b8f29a Merge "Fix references to olso by correcting them to oslo" 2019-01-14 22:52:10 +00:00
Chinasubbareddy M
ac41fb5961 Ceph journal partitions automation
- Use whole disk /dev/sdc format.
- Don't specify partition and let ceph-osd util create
and manage partition.
- On an OSD disk failure, during manintanance window,
Journal partition for failed OSD should be deleted.
This will allow ceph-osd util to reuse space for new partition.
- Disk partition count num will continue to
increase as more OSD fails.

Change-Id: I6900898fb90bcbb1743cd6382c176ad24b6624d7
2019-01-14 19:29:33 +00:00
Bryan Strassner
5d8e6b28ae Fix references to olso by correcting them to oslo
Transposed characters in the target replacements in
some of the deployment files can lead to unexpected
results (mostly that defaults are used instead of
overrides)

Since defaults were being used before, the endpoint definition needed to
be redefined to use the expected scheme (amqp) and path (/airflow)

Change-Id: I85a58c7b525e29208957845bf25ffbb0111c8f35
2019-01-14 19:29:22 +00:00
Zuul
7db4b789f2 Merge "Remove duplicate region overrides for barbican" 2019-01-07 17:05:40 +00:00
Evgeny L
fe82bacefb Remove duplicate region overrides for barbican
Change-Id: Id63fa4e18994f7cf9c3d59986d47a2f3d37caeda
2019-01-06 00:14:50 +00:00
Evgeny L
f6f9d7eaef Make keystone default host to be consistent with port
* "keystone-api" host is used for internal communication and
it listens on 5000 port.
* "keystone" host is used for public and admin, its port
is 443.
Ensure default host and port match if "host_fqdn_override"
is not specified.
This is also consistent with OSH defaults.

Change-Id: I020c5a3c13ea33849cd794b845427fbe03e914c5
2019-01-06 00:14:41 +00:00
Kaspars Skels
c73a2c8703 Remove port overrides for elasticsearch
- Due to latest changes client port is no longer exposed directly,
   and charts using elastic should use port 80.
   This fix relaxes port overrides to allow using chart defaults.

Change-Id: I8dac2d7240f3e8e925340b2479034a059ab85d42
2019-01-04 12:56:48 -06:00
Vladyslav Drok
aefba12f35 Add separate rabbit admin entry for shipyard
Needed-By: https://review.openstack.org/614610
Change-Id: I505a4d01233af2f9820ced77ec0cb4ed30f32f1f
2018-12-21 19:54:12 +00:00
Evgeny L
aa0e278f47 Update links to certs generation in certificates.yaml
Change-Id: I6b63001ac4ccba60e04d79446c0ba0178d13b446
2018-12-19 19:12:53 +00:00
Drew Walters
9c4abfd5de airskiff: Disable openstack-compute-kit sequencing
Charts in the `openstack-compute-kit` chart group are deployed in
sequence.  Currently, `libvirt` can fail while waiting for dependencies
from `neutron`. This commit disables sequencing for the
`openstack-compute-kit` chart group to allow for dependencies.

Change-Id: Id59cd22a6f548066414899df44d3067255936d17
2018-11-29 19:20:21 +00:00
Drew Walters
ba0d16dc52 site: Add Airskiff site
This change introduces Airskiff (see [0]), a development/learning environment
for the software delivery components of Airship, to the Airship-Treasuremap
repository. This change also adds a set of scripts accompanied by documentation
for easy deployment. During deployment, Armada, Deckhand, Pegleg, and Shipyard
are downloaded and built from source. Gate scripts from the OpenStack-Helm
project deploy a KubeADM-adminstered cluster. Armada deploys Armada, Deckhand,
and Shipyard into the cluster. The Airship components deploy OpenStack using
the documents provided by the Airskiff site. Airskiff is not safe for
production and should not be duplicated for production usage.

[0] https://github.com/mattmceuen/airskiff

Depends-On: https://review.openstack.org/#/c/613686/
Depends-On: https://review.openstack.org/#/c/614032/
Change-Id: Iae1efcca0812b98a9ad05aa8b869bdccfdb7e44b
2018-11-10 22:01:35 +00:00
Steve Wilkerson
7705bba7e2 OSH-Infra: Update monitoring chart configs
This updates chart configuration overrides for the monitoring
services, as well as adds missing secrets, charts and service
accounts for other exporters that have now been enabled

Change-Id: Ia1ed7bba38d7c262e85de8162d53012cdadf487e
2018-11-06 17:09:55 -06:00
Steve Wilkerson
0a1ba88004 Update Elasticsearch and Fluent-Logging configurations
This updates the Elasticsearch and Fluent-logging charts to use
the most recent configuration keys in their values overrides, and
also introduces support for the ceph-rgw s3 api for use for
Elasticsearch snapshot repositories

Change-Id: Ia998db9006350a22fcc7dc3052301d7a5b8259f4
2018-11-05 15:07:09 -06:00
Kaspars Skels
793062dae5 Use global full-site (reduntant file)
Change-Id: Icd64b63a0b6125a93c4f89d2c9df226a5338d734
2018-10-30 09:47:36 -05:00
Chinasubbareddy M
b45c02ff0b Ceph: uplift ceph charts
This is to uplift ceph charts  which will Initialize OSDs with a crush
weight of 0 to prevent automatic rebalancing the osds joing the cluster

This also updates the ceph-osd and ceph-mon versions to include the
update to remove the fluentbit sidecar containers.  This also
updates fluentd's configuration to target the ceph logs mounted
via the new hostpath

Change-Id: Id912291d47850cd56fc68abaf0e3edadd9a5e31f
2018-10-21 14:11:50 -05:00
Kaspars Skels
714f436492 Uplift to latest MAAS and enable Built-in proxy
Change-Id: I5cbca04b95b1064c4d59054f1cb830fce11edd86
2018-10-19 16:08:48 -05:00
Kaspars Skels
0fbcb3ac17 Adjust timeouts for deployment/MAAS
- MAAS can be slow on downloading images required.
 - Deployment of full-site takes 1h+

Change-Id: Id64d741a61ed3995ead61f1d3b219d5d3c021e6e
2018-10-16 13:42:31 +00:00
Kaspars Skels
44dafaa96e Add tenant ceph to global/site manifests
- Add tenant ceph manifests in globals
 - Add reference overrides for site in airship-seaworthy
 - Re-purpose 4th control as an additional compute to total 3.
   This allows to maintain proper ceph replication
 - Update disk layout to use partitions for journals

Change-Id: I0edf35bd56e4e5253f78c9074d88369283b6fac3
2018-10-15 23:17:07 -05:00
Kaspars Skels
a292a70695 Enable https for airship-seaworthy ingress endpoints
Change-Id: I0e04e896e537facc4a992c9efc8d7f12c6c14352
2018-10-12 08:07:12 -05:00
Kaspars Skels
68a1cc973e Fixes for ingress DNS and kubernetes-proxy
Change-Id: Ic54da4bece1e9ca084aebc1b65845027b506d4c2
2018-10-11 13:17:07 -05:00
Zuul
3f49725784 Merge "Add labels for ingress to enable layer overrides" 2018-10-09 16:06:12 +00:00
Kaspars Skels
c717602962 Calico v3 uplift and manifest fixes
Change-Id: Id189e74009c73ac10f9d920602dcdaee7b132bad
2018-10-08 08:03:44 -05:00
Kaspars Skels
e7fa1f5aa4 Add labels for ingress to enable layer overrides
Change-Id: Iaaf57e0cc38190e8768049946550626b94167a6d
2018-10-05 14:27:38 -05:00
Kaspars Skels
908db10033 Set ceph OSDs to use ceph-bootstrap label for genesis deployment
Change-Id: Id6610ee9b376f74be845b43c5b6d7c5a1ca0f801
2018-10-05 08:20:16 -05:00
Kaspars Skels
21dd6408c6 Set Keystone admin endpoint to match public
Change-Id: I1f82cd65fb21cb6a8147ffdc68b0da9197f3fdf7
2018-09-26 05:05:03 +00:00