In changes I0f7e1c9096dc1903903fb31c5e854f07800efbfd and I05e079237aec332925a88476e45071b34dc722c6 we started waiting for a floating IP to appear in the Nova 'show server details' API before continuing with the test. This left some useless test code left over that needlessly asserted that the floating IP was showing up (or had disappeared, in the case of disassociation) from the Nova 'show server details' API after the waiter had already checked the same thing. This patch cleans this up. Change-Id: I692402cf0d831c524ca5f49daf4aa9b0d19d41b5
|2 weeks ago|
|README.rst||5 years ago|
|__init__.py||9 years ago|
|manager.py||1 month ago|
|test_aggregates_basic_ops.py||2 years ago|
|test_compute_unified_limits.py||5 months ago|
|test_dashboard_basic_ops.py||2 years ago|
|test_encrypted_cinder_volumes.py||1 month ago|
|test_minimum_basic.py||2 weeks ago|
|test_network_advanced_server_ops.py||4 weeks ago|
|test_network_basic_ops.py||11 months ago|
|test_network_qos_placement.py||6 months ago|
|test_network_v6.py||1 year ago|
|test_object_storage_basic_ops.py||4 years ago|
|test_security_groups_basic_ops.py||1 year ago|
|test_server_advanced_ops.py||2 years ago|
|test_server_basic_ops.py||1 year ago|
|test_server_multinode.py||5 years ago|
|test_shelve_instance.py||1 year ago|
|test_snapshot_pattern.py||1 year ago|
|test_stamp_pattern.py||1 year ago|
|test_unified_limits.py||1 year ago|
|test_volume_backup_restore.py||1 year ago|
|test_volume_boot_pattern.py||1 month ago|
|test_volume_migrate_attached.py||1 year ago|
Tempest Field Guide to Scenario tests
What are these tests?
Scenario tests are "through path" tests of OpenStack function. Complicated setups where one part might depend on completion of a previous part. They ideally involve the integration between multiple OpenStack services to exercise the touch points between them.
Any scenario test should have a real-life use case. An example would be:
- "As operator I want to start with a blank environment":
- upload a glance image
- deploy a vm from it
- ssh to the guest
- create a snapshot of the vm
Why are these tests in Tempest?
This is one of Tempest's core purposes, testing the integration between projects.
Scope of these tests
Scenario tests should always use the Tempest implementation of the OpenStack API, as we want to ensure that bugs aren't hidden by the official clients.
Tests should be tagged with which services they exercise, as determined by which client libraries are used directly by the test.
Example of a good test
While we are looking for interaction of 2 or more services, be specific in your interactions. A giant "this is my data center" smoke test is hard to debug when it goes wrong.
A flow of interactions between Glance and Nova, like in the introduction, is a good example. Especially if it involves a repeated interaction when a resource is setup, modified, detached, and then reused later again.