There is a need to make the airflow worker a stateful set so that the name of the pod will be consistent. This will allow us to properly extract and correlate logs in the database. We are also adding pvc for the airflow worker pods so that the logs persist. Change-Id: I79917aa02b38672cac13d6148c4ed44007a78d32
|4 years ago|
|alembic||4 years ago|
|charts/shipyard||4 years ago|
|docs||4 years ago|
|etc/shipyard||4 years ago|
|generator||4 years ago|
|images||4 years ago|
|shipyard_airflow||4 years ago|
|shipyard_client||4 years ago|
|tests||4 years ago|
|tools||4 years ago|
|.coveragerc||4 years ago|
|.editorconfig||4 years ago|
|.gitignore||4 years ago|
|.gitreview||4 years ago|
|Makefile||4 years ago|
|README.md||4 years ago|
|alembic.ini||4 years ago|
|entrypoint.sh||4 years ago|
|requirements.txt||4 years ago|
|setup.cfg||4 years ago|
|setup.py||4 years ago|
|test-requirements.txt||4 years ago|
|tox.ini||4 years ago|
Shipyard is the directed acyclic graph controller for Kubernetes and OpenStack control plane life cycle management, and a component of the Undercloud Platform (UCP)
Shipyard provides the entrypoint for the following aspects of the control plane established by the UCP:
- Designs and Secrets
Site designs, including the configuration of bare metal host
nodes, network design, operating systems, Kubernetes nodes,
Armada manifests, Helm charts, and any other descriptors that
define the build out of a group of servers enter the UCP via
Shipyard. Secrets, such as passwords and certificates use the
The designs and secrets are stored in UCP's Deckhand, providing for version history and secure storage among other document-based conveniences.
- Interaction with the site's control plane is done via invocation of actions in Shipyard. Each action is backed by a workflow implemented as a directed acyclic graph (DAG) that runs using Apache Airflow. Shipyard provides a mechanism to monitor and control the execution of the workflow.
OpenStack Identity (Keystone)
provides authentication and support for role based authorization.
Apache Airflow provides the framework and automation of workflows provided by Shipyard.
PostgreSQL is used to persist information to correlate workflows with users and history of workflow commands.
Deckhand supplies storage and management of site designs and secrets
Drydock is orchestrated by Shipyard to perform bare metal node provisioning.
Promenade is indirectly orchestrated by Shipyard to configure and join Kubernetes nodes
Armada is orchestrated by Shipyard to deploy and test Kubernetes workloads