This warning prints old tempest tests (which are marked
as aliases in the guidelines) most of the time.
The warning confuses users becuase it may suggest that
a relevant test is missing, however, that's not the case,
aliases aren't supposed to be found because they were
renamed.
Therefore this commit increases the verbose level needed
to trigger these warnings. From now on, the warnings won't
be printed by default, debug level of verbosity will be
required.
Change-Id: Ic0e590d54d76e2d5839ced3f513e8b2ded705e6f
Allow refstack-client run also tests from tempest plugins
by not filtering out all tests whoose names don't start
with tempest.
Change-Id: Ic880967287f7cf7064d2440fde2c35c781477873
Following tempest's example where arguments such as --blacklist-file,
--black-regex and --whitelist-file are deprecated by [1], let's do
the change here as well.
A few occurrences cannot be renamed atm as refstack-client uses an older
tempest version which doesn't contain the change [1] yet. After we update
the tempest version used in this project, the rest occurrences will be
renamed as well.
[1] https://review.opendev.org/c/openstack/tempest/+/768583
Change-Id: I514fb688f6895338a877cbc706ddd8d6fc5f906d
The patch edits the code so that it complies with W605 rule
wherever it makes sense. W504 rule is added to a ignore list.
High version cap of pyflakes and flake8 packages is increased
as well.
Change-Id: I51558ee9c808e03b4164d0832fc525c5556dddd1
The review:
* adds a python3 job in order to test the refstack-client with
python3 as well.
* adds a job which runs unit tests by python3.7
* changes default python3 (when -p 3 is specified) in setup_env script
to version 3.6.0
* converts downloaded list of tests from bytes to str in order to unify
the types used for python2 and python3 compatibility.
* edits -p argument in the setup_env script so that it also accepts a full
version of Python a user wants to run with, before there were 2 options:
* python2.7.8
* python3.6.0
* sets object-storage.operator_role to Member in tempest.conf in order to run
tempest.api.object_storage.test_container_services.ContainerTest tests
Change-Id: I961f0f093bd7d40fde7e448ea12ef9907c61d126
Tempest has changed to use stestr instead of testr and testrepository
starting from 18.0.0,and the testr.conf was removed:
https://review.openstack.org/#/c/504345/
refstack-client will not able to run for tempest 18.0.0 as some commands
need the testr.conf in the path:
root@defcore:/home/defcore/refstack-client/refstack_client#
/home/defcore/refstack-client/.tempest/tools/with_venv.sh testr
list-tests
No .testr.conf config file
Tempest Commit SHA: 8316f962c52b01edc5be466b18e54904e2a1248a pointing
to tempest 19.0.0
Install tempest from master
Updated Guidelines to match 2018.02
Change-Id: Ic796cc7ad48037e64a4437d4834051c7fa7cbda1
Closes-Bug: #1765609
install_venv script was removed from tempest back in Jan, 2016
Further details see Ib7dd6b34533880e48b367732ae3520026a92500e
This patch removes script references since virtualenv management is
handled during refstack installation.
Change-Id: I9c6a9a84792c5f4afd38d53f8a5cb86ecfa344a3
Create a whilelist file including only the test names with
the regex expression "test_name\[" since some test names can be a
subset of others
Change-Id: I4b4e60e2c2e1bae7d6a86f9af993390ecd7ccf7b
QA community default test runner is ostestr, and using run_tempest.sh
script is no longer recommended. BP replaces run_tempest.sh script
with direct ostestr call passing the appropriate parameters.
Implements blueprint: implement-ostestr-refstackclient
Change-Id: If4ffed70c8320abb4b4c7bfd1b84ca7892272665
stdout from `testr list-tests' often contains useful information, so
report it to the user on failure.
Change-Id: Idc9d2e16d64fcdfad1de881a3458d13a7de33471
Closes-Bug: #1533655
Because test attributes can constantly change in test lists, refstack-client
should have a native argument for passing in test lists (instead of '-- --load-list')
Refstack-client will normalize the tests in the given list by matching it to
test IDs in the current Tempest environment.
Closes-Bug: #1475407
Change-Id: I1e3f026f5cd706cf73b6febfce98cb96b742d4d6
