nova/nova/tests/functional/regressions
Chris Dent 787bb33606 Use external placement in functional tests
Adjust the fixtures used by the functional tests so they
use placement database and web fixtures defined by placement
code. To avoid making redundant changes, the solely placement-
related unit and functional tests are removed, but the placement
code itself is not (yet).

openstack-placement is required by the functional tests. It is not
added to test-requirements as we do not want unit tests to depend
on placement in any way, and we enforce this by not having placement
in the test env.

The concept of tox-siblings is used to ensure that the
placement requirement will be satisfied correctly if there is a
depends-on. To make this happen, the functional jobs defined in
.zuul.yaml are updated to require openstack/placement.

tox.ini has to be updated to use a envdir that is the same
name as job. Otherwise the tox siblings role in ansible cannot work.

The handling of the placement fixtures is moved out of nova/test.py
into the functional tests that actually use it because we do not
want unit tests (which get the base test class out of test.py) to
have anything to do with placement. This requires adjusting some
test files to use absolute import.

Similarly, a test of the comparison function for the api samples tests
is moved into functional, because it depends on placement functionality,

TestUpgradeCheckResourceProviders in unit.cmd.test_status is moved into
a new test file: nova/tests/functional/test_nova_status.py. This is done
because it requires the PlacementFixture, which is only available to
functional tests. A MonkeyPatch is required in the test to make sure that
the right context managers are used at the right time in the command
itself (otherwise some tables do no exist). In the test itself, to avoid
speaking directly to the placement database, which would require
manipulating the RequestContext objects, resource providers are now
created over the API.

Co-Authored-By: Balazs Gibizer <balazs.gibizer@ericsson.com>
Change-Id: Idaed39629095f86d24a54334c699a26c218c6593
2018-12-12 18:46:49 +00:00
..
README.rst add a place for functional test to block specific regressions 2016-02-24 18:14:27 +00:00
__init__.py add a place for functional test to block specific regressions 2016-02-24 18:14:27 +00:00
test_bug_1404867.py fixtures: Track volume attachments within CinderFixtureNewAttachFlow 2018-10-22 17:19:31 +01:00
test_bug_1522536.py replace chance with filter scheduler in func tests 2017-08-16 14:42:51 +00:00
test_bug_1541691.py Remove unused conf 2016-09-02 09:02:23 +08:00
test_bug_1548980.py replace chance with filter scheduler in func tests 2017-08-16 14:42:51 +00:00
test_bug_1552888.py Trivial-Fix: Fix typos 2016-06-13 06:41:08 +00:00
test_bug_1554631.py Catching OverQuota Exception 2017-05-03 19:00:34 +00:00
test_bug_1558866.py remove unnecessary conf imports 2018-03-09 14:30:10 -05:00
test_bug_1568208.py Fix generation of Guru Meditation Report 2016-04-13 17:00:32 +03:00
test_bug_1595962.py Use external placement in functional tests 2018-12-12 18:46:49 +00:00
test_bug_1620248.py Stop using mox stubs in cast_as_call.py 2017-07-25 00:40:41 +00:00
test_bug_1670627.py Clean up ports and volumes when deleting ERROR instance 2018-02-20 10:32:07 -05:00
test_bug_1671648.py Use external placement in functional tests 2018-12-12 18:46:49 +00:00
test_bug_1675570.py Use external placement in functional tests 2018-12-12 18:46:49 +00:00
test_bug_1678326.py Commit usage decrement after destroying instance 2017-04-05 15:19:15 -04:00
test_bug_1679750.py Use external placement in functional tests 2018-12-12 18:46:49 +00:00
test_bug_1682693.py Use external placement in functional tests 2018-12-12 18:46:49 +00:00
test_bug_1689692.py Clean up ports and volumes when deleting ERROR instance 2018-02-20 10:32:07 -05:00
test_bug_1702454.py Use external placement in functional tests 2018-12-12 18:46:49 +00:00
test_bug_1713783.py Use external placement in functional tests 2018-12-12 18:46:49 +00:00
test_bug_1718455.py Use external placement in functional tests 2018-12-12 18:46:49 +00:00
test_bug_1718512.py Use external placement in functional tests 2018-12-12 18:46:49 +00:00
test_bug_1719730.py Use external placement in functional tests 2018-12-12 18:46:49 +00:00
test_bug_1732947.py Implement new attach Cinder flow 2017-12-07 10:29:15 -05:00
test_bug_1735407.py Use external placement in functional tests 2018-12-12 18:46:49 +00:00
test_bug_1741125.py Remove the CachingScheduler 2018-10-18 17:55:36 -04:00
test_bug_1741307.py Use external placement in functional tests 2018-12-12 18:46:49 +00:00
test_bug_1746483.py Use external placement in functional tests 2018-12-12 18:46:49 +00:00
test_bug_1746509.py Use nova.db.api directly 2018-07-10 14:56:27 +00:00
test_bug_1764883.py Use external placement in functional tests 2018-12-12 18:46:49 +00:00
test_bug_1780373.py Use external placement in functional tests 2018-12-12 18:46:49 +00:00
test_bug_1781710.py Use external placement in functional tests 2018-12-12 18:46:49 +00:00
test_bug_1784353.py Use external placement in functional tests 2018-12-12 18:46:49 +00:00
test_bug_1794996.py Refactor TestEvacuateDeleteServerRestartOriginalCompute 2018-11-27 12:42:48 -05:00
test_bug_1797580.py Use external placement in functional tests 2018-12-12 18:46:49 +00:00
test_bug_1806064.py Use external placement in functional tests 2018-12-12 18:46:49 +00:00
test_bug_1806515.py Handle tags in _bury_in_cell0 2018-12-11 12:40:22 -05:00

README.rst

Tests for Specific Regressions

When we have a bug reported by end users that we can write a full stack reproduce on, we should. And we should keep a regression test for that bug in our tree. It can be deleted at some future date if needed, but largely should not be changed.

Writing Regression Tests

  • These should be full stack tests which inherit from nova.test.TestCase directly. (This is to prevent coupling with other tests).
  • They should setup a full stack cloud in their setUp via fixtures
  • They should each live in a file which is named test_bug######.py

Writing Tests Before the Bug is Fixed

TODO describe writing and landing tests before the bug is fixed as a reproduce.