The script will take a directory or url containing log files.
For now all non-whitelisted errors will be dumped to the console but
the script will always return success. Once we are convinced it is reliable
enough we can change it to fail on non-whitelisted errors.
Partially implements blueprint fail-gate-on-log-errors
Change-Id: I30b0eee1055f47aaad7984d886c739ccf5aa6186
This commit adds a new section to HACKING.rst to outline the
guidelines for adding negative tests to tempest.
Change-Id: Ieb3fc3670bb9229c6791e5c8c0a7ac4fbde03c4d
This commit updates lockutils from oslo incubator which adds a
LockFixture class. This also converts the tempest LockFixture to wrap
the fixture from oslo.
Change-Id: I4f5007109fa6ceff868c23d55d9962f9d703bb1f
There have been some issues with performance around security groups in
the past. Lets make sure they don't exist.
We gate on test_large_ops as part of gate-tempest-devstack-vm-large-ops
Change-Id: Ib655deab9fc12df969b47552d7d8edc999c0d06a
The scenario base class has code to properly clean up servers and
wait until they are fully deleted. Use this instead of custom cleanup
which doesn't wait for delete to complete.
Change-Id: Ic9fe5ea0d267116d5bc78f50d1945602e5247d6a
A duplicated variable definition is introduced by the early merge today
which should be fixed.
Change-Id: I1aef41d1002867988c05dbab2317365893f58569
Closes-Bug: #1237273
devstack has a small 10k max template size. This is too small for
many templates that may be used during development. Thus, we need
to change this and devstack to a larger value.
Change-Id: I474c7cbc196a4e94ba67cab4e2ca2263dc902e26
make a seperate file test_users_negative.py and move exist negative tests
over to it,also add some negative tests to it
- test_create_user_with_enabled_non_bool
- test_create_user_with_enabled
- create_user
- test_update_user_for_non_existant_user
- test_update_user_request_without_a_token
- test_update_user_by_unauthorized_user
- test_delete_user_request_without_a_token
Change-Id: I5a87d72ecb94046809faf0ce14b1af347c2e4dcc
tempest/config.py has many simliar tiny functions for register_*_opts.
We should remove the code duplication to providing a common function.
Change-Id: Ie8facc21a2d8a1e27687b1182a3db9f98bc1a05e
Closes-Bug: #1236498
Sometimes the nightly stress test run fails. This will catch all
exceptions in run_stress.py and log them.
Change-Id: Ib6abd2c157df3988ccae1c6c8f703ec0ed24ff00
Fixes-bug: 1234580
Change I8519cba1fcf6ff39d69839783d07359544509db5 was supposed to make
the setup for test_list_servers_negative.py handle the case that tempest
is being ran without tenant isolation, but it doesn't fix the entire
problem because it's only checking if the MULTI_USER global is False.
The MULTI_USER global is only False if allow_tenant_isolation=False and
user1 == user2. So if you're running tempest without tenant isolation
but you do have two separate users/tenants for running the tests, then
the setup can still fail.
This patch fixes the problem by always doing the cleanup if
allow_tenant_isolation=False regardless of what MULTI_USER is set to.
Closes-Bug: #1234370
Change-Id: I821e200d07c11ba04d8be788095b7648de1d820b
If we use skip_because decorator, the below error occurs.
_StringException: ImportError: Failed to import test module:...
And, all tests of the class having the skip_because decorator are not
tested.
This commit fixes it.
Change-Id: I98e51d3bfd8b13dc3ef462eb92b170295f5f142e
Closes-Bug: #1236220
