dfb304355b
Tempest provides a LockFixture to avoid two potentially interfering tests to run in parallel. However, this solution does not scale when we want to separate a set of tests from many other test cases. For example, host aggregate and availability zone testing needs compute hosts without any nova servers to be able to test moving computes between aggregates but a lot of other tests are creating nova servers. To fully separate these aggregate tests from the rest of the tempest test cases, this patch proposes a @serial class decorator to mark a test class to be run totally independently of any other test classes. Under the hood, the @serial decorator is implemented with a tempest-wide interprocess read-write lock. The serial test classes always take the write lock, while the non-serial classes take the read lock. The lock allows in many readers OR a single writer. So the serial tests are run independently from the rest. To minimize the time a serial test blocks other tempest tests run in parallel, this patch also introduced a serial_tests test directory to store the serial tests. The current test ordering in a fresh env uses alphabetical order so the serial tests will run at the end of the execution not randomly in the middle. The gate uses fresh VMs for every run so we can rely on this optimization there. In local envs where tests are re-run, the subsequent runs will be ordered at runtime by stestr. Therfore, a longer runtime might be observed due to locking, but the correctness of the test execution is still kept. Related-Bug: #821732 Change-Id: I0181517edab75f586464a38c4811417f888783b1
26 lines
874 B
Plaintext
26 lines
874 B
Plaintext
# The order of packages is significant, because pip processes them in the order
|
|
# of appearance. Changing the order has an impact on the overall integration
|
|
# process, which may cause wedges in the gate later.
|
|
pbr!=2.1.0,>=2.0.0 # Apache-2.0
|
|
cliff!=2.9.0,>=2.8.0 # Apache-2.0
|
|
jsonschema>=3.2.0 # MIT
|
|
testtools>=2.2.0 # MIT
|
|
paramiko>=2.7.0 # LGPLv2.1+
|
|
cryptography>=2.1 # BSD/Apache-2.0
|
|
netaddr>=0.7.18 # BSD
|
|
oslo.concurrency>=3.26.0 # Apache-2.0
|
|
oslo.config>=5.2.0 # Apache-2.0
|
|
oslo.log>=3.36.0 # Apache-2.0
|
|
stestr>=1.0.0 # Apache-2.0
|
|
oslo.serialization!=2.19.1,>=2.18.0 # Apache-2.0
|
|
oslo.utils>=4.7.0 # Apache-2.0
|
|
fixtures>=3.0.0 # Apache-2.0/BSD
|
|
PyYAML>=3.12 # MIT
|
|
python-subunit>=1.0.0 # Apache-2.0/BSD
|
|
stevedore>=1.20.0 # Apache-2.0
|
|
PrettyTable>=0.7.1 # BSD
|
|
urllib3>=1.21.1 # MIT
|
|
debtcollector>=1.2.0 # Apache-2.0
|
|
defusedxml>=0.7.1 # PSFL
|
|
fasteners>=0.16.0 # Apache-2.0
|