releases/openstack_releases/tests
Hervé Beraud 9504e96b5d Fix validation to ensure that first release of series isn't a bugfix
We recently observed that this check was skipped. Indeed it was
possible to propose a bugfix version on the first release of a series
without facing validation errors [1].

The described situation was allowed by checks that we introduced
during Wallaby [2]. Those was designed to ensure that we can
build sdist from the proposed tag. Indeed, they temporarly created
the new git tag to build sdist from it. However we never delete this
tag after our tests so this temporary tag is see as an existing tag
and so that led us to the observed bug.

Our validation check that the first version number of series isn't a
bugfix after it tried to build the sdist from the new tag, so, without
this patch the tag newly created by the sdist check remains available
in the repo, and so a couple of next checks are skipped, including the
validation of the version number, because these checks are decorated
to ignore existing tags.

Indeed the function decorated with `skip_existing_tags` detect this
temporary tag as an existing tag, so, the decorated functions are
skipped.

We should notice that it surely impacted other checks in the same manner.
Indeed, all validation functions decorated with this function
`skip_existing_tags` are impacted by this bug.
Hopefully it didn't have too much side effects.

These changes delete the temporary tag after usage to ensure to restore
the initial environment and to stop skipping next checks.

[1] https://review.opendev.org/c/openstack/releases/+/795836
[2] 80652b5232

Change-Id: I5d9024528d08487a7582e0a0e73576b22708a6cf
2021-06-17 13:41:12 +02:00
..
units/cmd Allow list_unreleased_changes to format results at json & yaml formats 2020-07-07 19:07:25 +02:00
__init__.py add tests for launchpad validation 2016-11-28 12:47:17 +11:00
fixtures.py Update to latest hacking for pep8 checks 2020-07-27 16:33:03 -05:00
test_deliverable.py Add stein to docs landing page 2018-07-30 12:26:35 -05:00
test_new_release.py Update docs building, Python 3 cleanup 2020-04-20 11:16:46 +02:00
test_npmutils.py Update docs building, Python 3 cleanup 2020-04-20 11:16:46 +02:00
test_project_config.py Switch back to publish-to-pypi 2018-11-02 19:41:36 +01:00
test_puppetutils.py Update docs building, Python 3 cleanup 2020-04-20 11:16:46 +02:00
test_redirections.py Redirects to master should always be temporary 2019-10-03 15:10:33 -07:00
test_requirements.py Update docs building, Python 3 cleanup 2020-04-20 11:16:46 +02:00
test_series_status.py Add stein to docs landing page 2018-07-30 12:26:35 -05:00
test_validate.py Fix validation to ensure that first release of series isn't a bugfix 2021-06-17 13:41:12 +02:00
test_versionutils.py provide separate release types for server and non-server deliverables 2017-10-26 11:53:13 -04:00