Spec for system deployment of containerized openstack infrastructure
Submitting the following spec for review: system-deployment-of-containerized-openstack-infrastructure.rst Change-Id: Ic4bf44d2324b9c1f5d595daa19f260b612f4dc48 Signed-off-by: Bart Wensley <barton.wensley@windriver.com>
This commit is contained in:
Bart Wensley
parent
f7c04656d8
commit
9f239ab5fe
@ -0,0 +1,276 @@
|
||||
===========================================================
|
||||
System Deployment of Containerized OpenStack Infrastructure
|
||||
===========================================================
|
||||
|
||||
Storyboard: https://storyboard.openstack.org/#!/story/2003910
|
||||
|
||||
This story will update StarlingX to deploy its OpenStack infrastructure in a
|
||||
containerized configuration. Changes will be identified and implemented to
|
||||
enable end-to-end configuration of all the containers that will host
|
||||
OpenStack infrastructure services.
|
||||
|
||||
Problem description
|
||||
===================
|
||||
|
||||
Please see the following for background on the effort to containerize the
|
||||
StartlingX OpenStack infrastructure:
|
||||
https://wiki.openstack.org/wiki/Containerizing_StarlingX_Infrastructure
|
||||
|
||||
This story implements the end-to-end configuration of the StarlingX
|
||||
platform with the OpenStack infrastructure services running in containers.
|
||||
It builds on several other stories which are listed in the Dependencies
|
||||
section below.
|
||||
|
||||
Use Cases
|
||||
=========
|
||||
|
||||
Developers/testers/users need the ability to install and configure a StarlingX
|
||||
system with kubernetes master and worker nodes, in order to support a
|
||||
variety of containerized applications.
|
||||
|
||||
Developers/testers/users need the ability to install and configure the
|
||||
OpenStack application on a running StarlingX system.
|
||||
|
||||
Proposed change
|
||||
===============
|
||||
|
||||
The initial install of a StarlingX system will no longer include the OpenStack
|
||||
software (with the exception of Keystone and Horizon which are required by
|
||||
bare metal platform services). The OpenStack application will have its own
|
||||
instance of Keystone and Horizon.
|
||||
|
||||
To install the OpenStack application, the user will first label the hosts to
|
||||
be used for OpenStack controller functions (label: openstack-controller-node)
|
||||
and OpenStack compute functions (label: openstack-compute-node) using the
|
||||
following CLI:
|
||||
|
||||
system host-label-assign <hostname> <label>
|
||||
|
||||
Then the user will use the following CLI to import the OpenStack application:
|
||||
|
||||
system application-upload <app-name> <app-tarfile>
|
||||
|
||||
Finally, the user will install the OpenStack application:
|
||||
|
||||
system application-install <app-name>
|
||||
|
||||
The above CLIs are created as part of the stories listed in the Dependencies
|
||||
section below (see the Armada Integration story for details). This story
|
||||
provides the "glue" that performs the necessary configuration of platform
|
||||
services (e.g. System Inventory (sysinv), Virtual Infrastructure Manager
|
||||
(VIM)) to support the OpenStack application.
|
||||
|
||||
Alternatives
|
||||
============
|
||||
|
||||
This is the only reasonable approach to integrate the containerized OpenStack
|
||||
application with the StartlingX platform.
|
||||
|
||||
Data model impact
|
||||
=================
|
||||
|
||||
None - any data model impacts are described in the stories listed in the
|
||||
Dependencies section below.
|
||||
|
||||
REST API impact
|
||||
===============
|
||||
|
||||
None - any REST API impacts are described in the stories listed in the
|
||||
Dependencies section below.
|
||||
|
||||
Security impact
|
||||
===============
|
||||
|
||||
This story does not expose any new interfaces to the external world. Any
|
||||
security impacts are described in stories listed in the Dependencies section
|
||||
below.
|
||||
|
||||
Other end user impact
|
||||
=====================
|
||||
|
||||
Prior to this story, all StarlingX systems would come up with the OpenStack
|
||||
services installed by default (on bare metal) after initial system
|
||||
configuration.
|
||||
|
||||
After this story, all StarlingX systems will come up without the OpenStack
|
||||
services. If a user wants to install the OpenStack application
|
||||
(containerized), they will perform the actions described in the Proposed
|
||||
Change section above.
|
||||
|
||||
Performance Impact
|
||||
==================
|
||||
|
||||
The move from a bare metal OpenStack deployment to a containerized deployment
|
||||
will impact the performance of the system. These impacts will be assessed
|
||||
as the development is done and negative impacts will be mitigated.
|
||||
|
||||
Other deployer impact
|
||||
=====================
|
||||
|
||||
In order to install the StarlingX system, external network access will be
|
||||
required over the OAM interface on the controller hosts. This is necessary
|
||||
to download the required docker images, which will not be included in the
|
||||
StarlingX iso. This is both due to size considerations (the images required by
|
||||
he OpenStack application will total several GB in size) and to decouple the
|
||||
StarlingX software release from OpenStack docker image releases.
|
||||
|
||||
Patching of a StarlingX system will be different as the existing RPM based
|
||||
patching mechanism will not work for software running in containers (i.e. all
|
||||
the OpenStack components). The new patching mechanism for containers is TBD.
|
||||
|
||||
Developer impact
|
||||
================
|
||||
|
||||
Developers working on StarlingX will now need to build docker images in order
|
||||
to test changes to OpenStack components (e.g. keystone, nova, neutron) that
|
||||
were previously running on bare metal. They will also need to generate the
|
||||
OpenStack application tarfile, which includes manifests and Helm charts.
|
||||
|
||||
Upgrade impact
|
||||
==============
|
||||
|
||||
None - this is the first StarlingX release so there are no previous releases
|
||||
that we need to support upgrades from.
|
||||
|
||||
Implementation
|
||||
==============
|
||||
|
||||
Assignee(s)
|
||||
===========
|
||||
|
||||
Primary assignee:
|
||||
|
||||
* Bart Wensley (bartwensley)
|
||||
|
||||
Other contributors:
|
||||
|
||||
* Al Bailey (albailey)
|
||||
* Chris Friesen (cbf123)
|
||||
* Don Penney (dpenney)
|
||||
* Jerry Sun (jerry-sun-u)
|
||||
* Kevin Smith (kevin.smith.wrs)
|
||||
* Lachlan Plant (lachlan.plant)
|
||||
* Robert Church (rchurch)
|
||||
* Shoaib Nasir (snasir)
|
||||
* Tee Ngo (teewrs)
|
||||
|
||||
Repos Impacted
|
||||
==============
|
||||
|
||||
* stx-config
|
||||
* stx-integ
|
||||
* stx-nfv
|
||||
|
||||
Work Items
|
||||
==========
|
||||
|
||||
* Sysinv:
|
||||
|
||||
* Update VIM puppet plugin to disable all OpenStack plugins in the VIM when
|
||||
the OpenStack application is NOT installed and to enable them when the
|
||||
OpenStack application is installed.
|
||||
* Support new keystone configuration (e.g. auth URL, username, password) for
|
||||
containerized OpenStack services.
|
||||
* Use the pod based keystone when accessing OpenStack services (if it is
|
||||
configured).
|
||||
* Update sysinv/puppet to supply kubernetes configuration to sysinv/VIM when
|
||||
OpenStack application has been installed.
|
||||
* Update sysinv/puppet to generate platform openrc file in
|
||||
/etc/platform/openrc.
|
||||
* Detect when OpenStack application installation is complete and:
|
||||
|
||||
* Reconfigure sysinv with pod based keystone configuration.
|
||||
* Reconfigure VIM with pod based keystone configuration.
|
||||
|
||||
* Perform different semantic checks for worker nodes with OpenStack
|
||||
installed vs. worker nodes without OpenStack.
|
||||
* Add semantic checks to prevent label and override modifications for
|
||||
unlocked hosts.
|
||||
* Send notifications to VIM whenever labels are modified.
|
||||
* Avoid modifications to host aggregates for pure kubernetes worker nodes.
|
||||
|
||||
* VIM:
|
||||
|
||||
* Support new keystone configuration (e.g. auth URL, username, password) for
|
||||
containerized OpenStack services.
|
||||
* Use the pod based keystone when accessing OpenStack services (if it is
|
||||
configured).
|
||||
* Disable all interactions with nova, neutron and guest services for pure
|
||||
kubernetes worker nodes (based on absence of openstack-compute-node label).
|
||||
* host-add:
|
||||
|
||||
* When sysinv notifies the VIM that a host has been added, the VIM will
|
||||
no longer create the nova/neutron/guest services, as the host will
|
||||
start out as a pure kubernetes worker node.
|
||||
|
||||
* label-add:
|
||||
|
||||
* When openstack-compute-node label is added to compute, create the
|
||||
nova/neutron/guest services (previously done on host-add).
|
||||
|
||||
* host-delete:
|
||||
|
||||
* Only delete OpenStack services if openstack-compute-node label applied
|
||||
to host.
|
||||
|
||||
* Remove --kubernetes option from config_controller, along with the
|
||||
now-obsolete bare metal OpenStack related code (e.g. python code, puppet,
|
||||
service scripts, OCF scripts, SM config, pmon config).
|
||||
|
||||
Dependencies
|
||||
============
|
||||
|
||||
This requires new functionality being developed under the following stories:
|
||||
|
||||
* Kubernetes Platform Support:
|
||||
https://storyboard.openstack.org/#!/story/2002843
|
||||
* CEPH persistent storage backend for Kubernetes:
|
||||
https://storyboard.openstack.org/#!/story/2002844
|
||||
* Local Docker Registry:
|
||||
https://storyboard.openstack.org/#!/story/2002840
|
||||
* Docker Image Generation:
|
||||
https://storyboard.openstack.org/#!/story/2003907
|
||||
* Infrastructure HELM Chart Override Generation:
|
||||
https://storyboard.openstack.org/#!/story/2003909
|
||||
* Create HELM chart for nova-api-proxy:
|
||||
https://storyboard.openstack.org/#!/story/2004007
|
||||
* Create HELM chart for Fault project:
|
||||
https://storyboard.openstack.org/#!/story/2004008
|
||||
* Armada Integration:
|
||||
https://storyboard.openstack.org/#!/story/2003908
|
||||
|
||||
Testing
|
||||
=======
|
||||
|
||||
This story affects the configuration and deployment of all OpenStack services
|
||||
on StarlingX. In addition to the usual unit testing in the impacted code
|
||||
areas, this will require a full system regression of all StarlingX
|
||||
functionality. It will also require extensive performance testing in order
|
||||
to identify and address any performance impacts.
|
||||
|
||||
In addition, this story changes the way a StarlingX system is installed and
|
||||
configured, which will require changes in existing automated installation and
|
||||
testing tools.
|
||||
|
||||
Documentation Impact
|
||||
====================
|
||||
|
||||
This story affects the StarlingX installation and configuration documentation.
|
||||
Specific details of the documentation changes will be addressed once the
|
||||
implementation is complete.
|
||||
|
||||
References
|
||||
==========
|
||||
|
||||
None
|
||||
|
||||
History
|
||||
=======
|
||||
|
||||
.. list-table:: Revisions
|
||||
:header-rows: 1
|
||||
|
||||
* - Release Name
|
||||
- Description
|
||||
* - 2019.03
|
||||
- Introduced
|
||||
Loading…
Reference in New Issue
Block a user