tempest/manager.py has been deprecated for over 4 years already,
it's time to remove it.
Implements: blueprint tempest-scenario-manager-stable
Change-Id: Iea813d478a93a1638be597af48929cd50a5e6366
Following stestr's example where arguments such as --blacklist-file,
--black-regex and --whitelist-file are deprecated since its
3.1.0 release, let's do the change here as well in order to
get tempest consumers some time for the transition.
This change deprecates the following arguments and replaces them
by new ones which are functionally equivavelnt:
* --black-regex is replaced by --exclude-regex
* --blacklist-file is replaced by --exclude-list
* --whitelist-file is replaced by --include-list
For now, Tempest will accept both (new and old) arguments to make
the transition smoother for all consumers.
The patch also bumps min version of tox to 3.18.0 in order to
replace tox's whitelist_externals by allowlist_externals option:
https://github.com/tox-dev/tox/blob/master/docs/changelog.rst#v3180-2020-07-23
Change-Id: I3e09b31f63d2cd7ea41c48e62432bd3bc54fcf44
tempest-tox-plugin-sanity-check job is failing due to missing virtualenv.
As the job is running on master only and we don't support python2 anymore,
this patch edits the tempest-plugin-sanity.sh script so that it uses
python3 venv module to create a venv.
Change-Id: I3f711ec97ad9006c715bb45db9d8dd9d951bb6a1
This commit adds x/glare and x/tap-as-a-service to the BLACKLIST to
avoid sanity-job failures like following.
Failed Plugins: x/glare, x/tap-as-a-service,
+ [[ -n x/glare, x/tap-as-a-service, ]]
+ exit 1
It looks the root cause is related to pg_config installation but not
sure. So, this commit just blacklists them as a workaround.
Error: pg_config executable not found.
Change-Id: I03c6f01593b8e414b5e111d0e0c971ae156da715
x/kingbird doens't seem to be compatible with tempest anymore
which is breaking our tempest-tox-plugin-sanity-check gate job.
Change-Id: Icdaff49bbc2ba0e59cd528d55cad6c35014b7ad0
This commit removes barbican-tempest-plugin from the blacklist. The
patch[1] got already merged. The plugin should work for the sanity now.
[1] https://review.opendev.org/#/c/634631/
Change-Id: I34d119c58afa6b3c728d1a540b4ea1df27d9c4d0
This commit adds x/group-based-policy plugin to the blacklist. It looks
this plugin doesn't support python3 yet.
Change-Id: I2f97f2245434d21b83c790efd37a7092ef1bfeb2
This commit retries http requests to generate a plugins list. We often
see internal server errors(500) in the gate. It makes sanity jobs fail.
So, it would be better to retry internally instead of 'recheck'. To
accomplish it, this uses urllib3 module.
NOTE: The default total number of retries[0] is 10. It should be enough
for us.
[0] https://urllib3.readthedocs.io/en/latest/reference/urllib3.util.html#urllib3.util.retry.Retry
Change-Id: Id3da3e2895fc2324d5a2db91f82b12ec5bb610f8
This commit removes x/ranger-tempest-plugin from BLACKLIST. The patch[0]
is trying to support the tempest-sanity job. So, when the patch is
merged, we can remove it from BLACKLIST.
[0] https://review.opendev.org/#/c/672585/
Change-Id: Ia7f0bdad9f854c0f6724537e1ca0234f2952aca8
Depends-On: https://review.opendev.org/672585/
This commit adds ranger-tempest-plugin to the blacklist. The plugin
looks like very new and it looks it doesn't work correctly yet. So, it
might be better to skip to sanity for the plugin now.
Change-Id: I6d5d647d92916e5b62e8c67094d04f028e25ee67
This commit removes the nova-lxd plugin from the blacklist. The proposed
patch was already merged, so this plugin should pass the sanity job now.
Change-Id: I72eb62af993bc978127185a1aed0763af18ce9f3
This commit removes x/networking-ansible from the tempest plugins list.
The original patch[0] was abandoned because networking-ansible took a
different approach[1] for the testing. So, it's not a tempest plugin
anymore.
[0] https://review.opendev.org/#/c/634647/
[1] https://review.opendev.org/#/c/634918/
Change-Id: I554c438f27a7032f31e56eac2aac110e08bb3d7d
This commit removes the cyborg-tempest-plugin entry from the BLACKLIST
since the patch was already merged and this plugin should pass the
sanity job now.
Change-Id: Ifec2e45761961bc4dfc3b5c11709c0ac9e81855f
This commit makes the tempest plugin function raise non 404 errors
when it catches them. Without doing that, we just ignore the errors.
However we shouldn't do that because it just causes another error when
the variable is used.
Change-Id: Ia82ef2aa9cb0959ccee1600feff297abb451176a
This commit fixes to add prefixes to the blacklist. The blacklist was
moved to generate-tempest-plugins-list.py by the recent patch[0].
However, the blacklist was updated by the other patch[1] before that.
So, it should have been updated correctly when the conflict was
occurred.
[0] I707aba930037e86f5f94dac73da957f5afacf935
[1] Ieecb8989ff8959f1b2c0e5f2f6b8ea2c3ebbcaa9
Change-Id: I090dd235dd7911aa9bb0eb13d8e65b501dc206fe
This commit makes the BLACKLIST to be published on the Tempest plugin
registry page which we discussed at the PTG[0].
[0] https://etherpad.openstack.org/p/qa-train-ptg
Change-Id: I707aba930037e86f5f94dac73da957f5afacf935
This commit changes to publish non-openstack namespace tempest plugins
to the tempest registry doc page. We missed some tempest plugins such as
airship's tempest-plugin because of the recent namespace change. And
also, this commit adds two projects[0] to .zuul.yaml because it had
been added already.
This commit republish them on the doc page, and add two projects to the
blacklist to pass the sanity tests.
Change-Id: Ieecb8989ff8959f1b2c0e5f2f6b8ea2c3ebbcaa9
Thorough replacement of git.openstack.org and review.openstack.org URLs
with their opendev.org counterparts.
Change-Id: I88e894db7b854d32593c770f5aa9b8a91fad7866
This commit fixes the import error "No module named six.moves" without
using the module for the plugin sanity job. Because the job call the
script directly.
Change-Id: Id0fa1b15fe443d65a1b6ca008e490d0fa54d6b32
This commit fixes an error: "AttributeError: module 'urllib' has no
attribute 'urlopen'" with using six library. This is an incompatible
thing between python2 and python3.
Change-Id: I62ee7ee555708a2e948e6b812d996c3bb93cd6e8
As openstack/deb-, -specs and -ui project namespaces do not contain
tempest plugins. So, it is better to remove the above projects from
the list in which tempest plugin is searched.
Change-Id: Ie490073ea195a462cb7be0b88b6cb1b8a7b324b3
While using generate-tempest-plugins-list.py in tempest-plugin-sanity
CI jobs fails to run as it requires requests module to parse the git
url and is not install by default in CI job. If we are going to
install requests we need to use sudo for that which is not a
good idea, so it is better to move the script to urllib2.
Change-Id: Ifed51c67c03f993a4833413826ac15104db152fc
This commit introduces flake8-import-order to check import orders
automatically. We shouldn't do it manually.
Depends-On: Ia2140f5566ce169b076ffa5c9ebfbdbfc41e5bed
Change-Id: Iff75ebec42b295870edd1c04001adfb17460a682
This commit starts ignoring plugin hits from deb-* repos when generating
the plugin list for the plugin registry doc. These are just packaging
repos and not really relevant for a plugin list.
Change-Id: I5146936824c17476d4e7f3fab058c80fd932e512
This is based on the devstack plugin detection code, modified
to check setup.cfg for a tempest_plugins string. It is to be
executed from a periodic proposal job, generating a list of
plugins in the same format.
Change-Id: I53d082319b6af6fb47083ea42c3ff6b109882e72
