81066ae98f
This PS updates python modules and code to match Airflow 2.6.2 as well as deploys new Airflow: - bionic py36 gates were removed - python code corrected to match new modules versions - selection of python modules versions was performed based on airflow-2.6.2 constraints - airskiff deploy pipeline was aligned with latest in treasuremap v1.9 - shipyard chart was corrected to match new airflow cli, configuration items and their default values - added new celery configuration items and their values - updated airflow runtime logging config - disabled deprecation and future python warnings in airflow images - added celery to the list of airflow providers - adjusted airflow runtime scripts to match new cli - shipyard SQL queries to airflow DB were adjusted to match new SQL schema of the db - shipyard_airflow and shipyard_client unit tests were updated to match new DB structure and new cli - airflow db sync job is using db upgrade command - helm version uplifted to v3.12.2 Change-Id: Ife88e53ce0dd8dc77bf267de1f5e6b8361ca76fd
95 lines
2.3 KiB
INI
95 lines
2.3 KiB
INI
[tox]
|
|
skipsdist=True
|
|
envlist = all_jobs, docs
|
|
|
|
[testenv]
|
|
setenv=
|
|
PYTHONWARNING=all
|
|
passenv=
|
|
HTTP_PROXY
|
|
HTTPS_PROXY
|
|
http_proxy
|
|
https_proxy
|
|
NO_PROXY
|
|
no_proxy
|
|
|
|
[testenv:venv]
|
|
commands = {posargs}
|
|
|
|
# Please use `make docs` instead
|
|
[testenv:docs]
|
|
allowlist_externals=
|
|
rm
|
|
cp
|
|
tox
|
|
commands=
|
|
rm -rf {toxinidir}/doc/build
|
|
sphinx-build -W -b html {toxinidir}/doc/source {toxinidir}/doc/build/html
|
|
deps= -r{toxinidir}/doc/requirements.txt
|
|
|
|
# `all_jobs` is here to support invocation as simply `tox`, as is done in
|
|
# current pipeline.
|
|
[testenv:all_jobs]
|
|
allowlist_externals=
|
|
tox
|
|
commands=
|
|
tox -c {toxinidir}/src/bin/shipyard_airflow/tox.ini
|
|
tox -c {toxinidir}/src/bin/shipyard_client/tox.ini
|
|
|
|
[testenv:py38]
|
|
deps =
|
|
tox<=4.0.0
|
|
allowlist_externals=
|
|
tox
|
|
bash
|
|
commands=
|
|
tox -c {toxinidir}/src/bin/shipyard_airflow/tox.ini -e py38
|
|
tox -c {toxinidir}/src/bin/shipyard_client/tox.ini -e py38
|
|
tox -c {toxinidir}/src/bin/shipyard_airflow/tox.ini -e gen_all
|
|
bash -c "cp {toxinidir}/src/bin/shipyard_airflow/etc/shipyard/policy.yaml.sample {toxinidir}/doc/source/_static/shipyard.policy.yaml.sample"
|
|
bash -c "cp {toxinidir}/src/bin/shipyard_airflow/etc/shipyard/shipyard.conf.sample {toxinidir}/doc/source/_static/shipyard.conf.sample"
|
|
|
|
[testenv:cover]
|
|
deps =
|
|
tox<=4.0.0
|
|
allowlist_externals=
|
|
tox
|
|
sh
|
|
commands=
|
|
tox -c {toxinidir}/src/bin/shipyard_airflow/tox.ini -e cover
|
|
tox -c {toxinidir}/src/bin/shipyard_client/tox.ini -e cover
|
|
sh -c 'mv ./src/bin/shipyard_airflow/cover ./'
|
|
sh -c 'mv ./src/bin/shipyard_client/cover ./cover/'
|
|
|
|
[testenv:pep8]
|
|
allowlist_externals=
|
|
tox
|
|
commands=
|
|
tox -c {toxinidir}/src/bin/shipyard_airflow/tox.ini -e pep8
|
|
tox -c {toxinidir}/src/bin/shipyard_client/tox.ini -e pep8
|
|
|
|
|
|
[testenv:freeze]
|
|
allowlist_externals=
|
|
tox
|
|
commands=
|
|
tox -c {toxinidir}/src/bin/shipyard_airflow/tox.ini -e freeze
|
|
tox -c {toxinidir}/src/bin/shipyard_client/tox.ini -e freeze
|
|
|
|
|
|
[testenv:shipyard_client]
|
|
deps =
|
|
-r{toxinidir}/src/bin/shipyard_airflow/requirements-frozen.txt
|
|
-r{toxinidir}/src/bin/shipyard_client/requirements-frozen.txt
|
|
skipsdist=True
|
|
allowlist_externals=
|
|
pytest
|
|
commands =
|
|
pytest \
|
|
{posargs} \
|
|
--cov-branch \
|
|
--cov-report=term-missing:skip-covered \
|
|
--cov-config=.coveragerc \
|
|
--cov=shipyard_client \
|
|
--cov-report=html \
|
|
-vv |