This commit adds a new section the HACKING and REVIEWING docs. It
explains the guidelines around inline documentation when
contributing new tests.
Change-Id: Ib56723d0c748baf41439975102d1363f81085f50
This patch fix the coding issue where "mutable" objects like list, dict
are being used as default value of param.
Current functions with mutable object as default value can create issues
if they will be called in more random order.
For example - first call with non default value and then with default
value. In this case original default will be overridden by the first
function call (as mutable object keep their state among function calls).
This commit also add the hacking check for the same and its
corresponding test.
Closes-Bug: #1330322
Change-Id: I251b316ef6d37f4b95c5e8d73a20a39005c22870
Since generate_scenario() call is not needed any longer update the
documentation to the current state.
Change-Id: I34e8b974d5c4851a27f53a20778a181985ff6b5b
With the introduction of the new negative testing framework the workflow
for new test has changed.
Partially-implements: bp negative-tests
Change-Id: I522c2be227a120a6a714349fa29b31e60b5e0bf4
Three paragraphs are misformated in the output due to
a leading space in a line. The leading space causes a
line break and the indent of the line.
Change-Id: I5c0d03a47a2ca305b2b077068df26fadccd72212
This commit just updates some of the hacking documentation around unit
tests. It also adds a new hacking rule to ensure that setUpClass isn't
used for the unit tests.
Partially implements bp unit-tests
Change-Id: Ie8b1c9f1312a467265d53bc28ee905fa1b5fbb53
This commit just adds some documentation around using the sample config
generator. It also adds a wrapper script that sets the env variable for
running the oslo generator script with tempest.
Change-Id: I860b17defeeb85174e68b1e8b046b0e43c30683b
In order to encourage people to add more and more stress tests we
need more documentation about it. This documents the stresstest
decorator and gives a global overview.
Change-Id: I65294fb278faba7a0d324782bf50e2fdedc5c1de
This commit adds a new section to HACKING.rst to outline the
guidelines for adding negative tests to tempest.
Change-Id: Ieb3fc3670bb9229c6791e5c8c0a7ac4fbde03c4d
this change introduces a skip_because decorator which accepts two args
a bug and a condition; also updates the skip tracker accordingly
Change-Id: If53f2ef81d6bddbce284267216254b467046855f
The previous github HACKING.rst doesn't exist anymore, so this commit
just updates the link in tempest's HACKING.rst to point it to the
correct location.
Change-Id: If49f938528ac9059a8e1983b281081fc6137b700
This commit adds a section to HACKING.rst to add some things to watch
out for now that we are running tempest in parallel by default. Part
of this documentation was taken from David Kranz's mailing list post:
http://lists.openstack.org/pipermail/openstack-dev/2013-August/014472.html
Change-Id: Ie688650fc528cf849c619e9afb64ba1f6b556ff8
This commit just adds a section to HACKING.rst explaining how to use
service tags.
Part of bp add-service-tags
Change-Id: I9724cec8e2009e9c2eb2d75d9254c2b5f10e7a85
* Adding a test case independence rule
* assertTrue/assertFalse msg argument
* Encouraging matcher usage for assertion
Change-Id: I89612a0dd66513f10e8bf53632f6a3d81ccf4129
The man page generation failed with sphinx v1.1.3
and docutils 0.10 and 0.11.
Adding docutils==0.9.1 to the test-requirements.txt
in order to solve this issue.
The docutils==0.9.1 is on the common OpenStack dependency list.
Several doc creation warning and error also fixed by this change.
Change-Id: Icb412876f5a989e6b8aa4886f2a246127a76521a
Adds a recommendation against submitting changesets with only
skipped tests and some recommendations for writing tests.
Change-Id: Iaf0accdcd1d5e37658ca56528b1709d0a00928d2
Reference the OpenStack hacking guide in HACKING.rst and remove
duplicate entries. Add section for tempest specific rules.
Change-Id: Idea236dfa7430fb49892c0d677f6f18175c1249d
This commit updates the hacking rules to add a strict format for bug
skips. Previously, there was no defined rules for skip formatting
which caused a number of test skips to be added without consistent
formatting. These skips then failed to get picked up by
tools/skip_tracker.py. This commit adds a new hacking test to ensure
that any skips added conform to a format that the skip_tracker will pick
up. HACKING.rst was also updated to explain the new rules being enforced.
Change-Id: I95f3ec7de2ee5e2039d53ad9565b5cec936a7672
This updates the hacking file to include notes about
openstack-common and update OpenStack LLC to the Openstack
Foundation
Change-Id: I2cee5f16b9e1f69ec5a44b76c4cc053cabfc9197
Use testtools as the base unittest test case class towards to
parallelizing the test runs. Catch places where setUp and tearDown
were not being chained properly, and fix these problems.Remove
custom skip, using testtools.skip instead. Add TestResourceManager.
Part of blueprint speed-up-tempest
Change-Id: I8e7b5686b22969a0f3db96100a357c93a4d5c03f
This adds hacking.py, based on the one in nova, to wrap around
pep8 and enforce more stringent checks on tempest. This adds
the rules that nova is currently enforcing on incoming commits.
The rules that pep8 is ignoring are copied from the pep8 check on
jenkins.
The HACKING file was also updated to indicate the inclusion
of the new rules that are being enforced.
Change-Id: I5c85829ee15d4264d8de2d9f0207d9dd3dfbbff2
