21 Commits

Author SHA1 Message Date
Sean Dague
f237ccb19f Fix T401 and T402 errors
Fix all the one line docstring errors in T401 and T402, now
we no longer ignore any of our own rules in hacking.py

Fix run_tests.sh to pick up the 'stress' directory, which tox
does for pep8. Additional fixes to the stress tests for T4* tests

Change-Id: Ie569a924e8eb355afbbd9b244f77dec34061b5cb
2013-01-06 23:24:03 -05:00
Sean Dague
d18cfe5473 tempest error codes should start with T
Because this was originally based on the nova hacking.py
the error codes were all N*. But now that we are owning it
in tempest they should be T*, as we're diverging.

Change the ignores to follow the errors that we're ignoring.

Change-Id: I7b23325da41a3942ae51ee3d29a49f54c75c57f8
2013-01-06 23:23:50 -05:00
Sean Dague
97449cc66c add hacking.py rule to prevent docstrings
add new rule for hacking.py to catch and prevent docstrings on
test_ functions in the tempest/test directory. Found 2 oddballs
that I missed on the last conversion.

update ./run_tests.sh to not ingore all N4* errors (basically all
our custom rules), 401 and 402 still ignored because we actually
have a lot of errors on both of those.

Change-Id: I894d181433b7dcd1a9f4429f1a463be75018f05e
2013-01-04 15:21:03 -05:00
Maru Newby
3447fa1d28 Add python-quantumclient to pip-requires
Change-Id: If30572e695dd7a34553339ee3997aaf930a06f0c
2013-01-03 18:05:33 +00:00
Attila Fazekas
c9611551ad Do not limit the max versions in the requirements
* The tempest should be compatible with latest openstack componets

Change-Id: I1d981a18757cae4e8bc3599e7f8196eabd5c0a2a
2012-12-19 19:34:38 +01:00
Matthew Treinish
8e937d7023 Fix use of venv in Tempest.
Currently when running Tempest tests with run_tests.sh a venv
isn't being used. This leaves tempest at the mercy of whatever
required package versions are installed on the system.

This patch takes install_venv.py and with_venv.sh from nova and
integrates them into run_tests to ensure that the correct
dependencies versions from pip-requires and test-requires are
being used.

Change-Id: I4bf4a02890a33c4034e4493d1763ed4019fdf46e
2012-12-18 09:51:23 -05:00
Maru Newby
81f07a09ba Add smoke tests for quantum.
* Added test_network_basic_ops, a port of the devstack exercise
   script quantum-adv-test.sh.
 * Tenant network connectivity can be tested by setting
   the 'tenant_networks_reachable' key in tempest.conf to 'true'.
 * Public (floating ip) connectivity can be tested by setting the
   'public_network_id' key in tempest.conf.
 * Addresses bug 1043980

Change-Id: I506518c431a8da0b91e3044f2a6aabce48081d93
2012-12-14 18:43:54 +00:00
Jay Pipes
1a6425e0ca Adds paramiko to pip-requires
The whitebox/SSH tests use paramiko, but it is not listed
in the tools/pip-requires. This adds it.

Change-Id: Icd3df69a94446f85772e515a820d8a013f0271f8
fixes: lp bug #1089763
2012-12-12 23:47:47 -05:00
Matthew Treinish
8b37289f68 Improve pep8 checks to be similar to those in nova
This adds hacking.py, based on the one in nova, to wrap around
pep8 and enforce more stringent checks on tempest. This adds
the rules that nova is currently enforcing on incoming commits.

The rules that pep8 is ignoring are copied from the pep8 check on
jenkins.

The HACKING file was also updated to indicate the inclusion
of the new rules that are being enforced.

Change-Id: I5c85829ee15d4264d8de2d9f0207d9dd3dfbbff2
2012-12-12 11:49:30 -05:00
Attila Fazekas
5abb253c3c Start making setup.py similar to other OpenStack Projects
* Try /etc/tempest DIR if the config file not found
* Exit immediately if the config file not found
* Remove pika from dependencies
* tempest named starter script (pep8 removed run_tests.sh)

Change-Id: I1f0b1fb061a265c5f8e39627efd26decdc61ef63
2012-12-05 19:51:26 +01:00
Attila Fazekas
a23f500725 Add start of the EC2/S3 API testing to tempest
Continues the effort of the https://review.openstack.org/#/c/3064/

* add EC2 keypair and volume tests
* add EC2 snapshot from volume test
* add EC2 floating ip disasscioation
* add EC2 operation on security group
* add EC2/S3 image registration
* add EC2 instance run test
* add Integration test with ssh, console, volume
* add S3 object and bucket tests

Change-Id: I0dff9b05f215b56456272f22aa1c014cd53b4f4b
2012-11-27 14:52:26 +01:00
Zhongyue Luo
e6321ef3c3 Clean up pep8 E502 violations
Updated pep8 version requirement to 1.3.3
Fixed E502 errors
All ignores are to be removed in the next sequence of patches

Change-Id: I71c013061fb88d7b8b31cfa3b83498999455d8db
2012-09-26 08:54:12 +08:00
Brian Waldon
5f42d6d285 Add lxml to pip-requires
Change-Id: I3f406ab0e2527c4c8e539b75432aa7d938daf73e
2012-09-17 13:28:31 -07:00
Jay Pipes
051075a596 Addition of base Smoke and Whitebox tests
* Splits out the "manager" class into its own file (at least
  for now to keep the code change size down initially)
* Adds base manager classes for Fuzz and Default clients
* Adds base test case class and a derived base SmokeTest class
* Adds smoke test for basic server operations in compute
* Adds non-smoke test for advanced server operations in compute
* Adds Whitebox base test case class
* New basic db-checking whitebox tests for servers and images

This change builds upon the proposed refactoring to the Tempest Manager
and base test classes as per https://review.openstack.org/#/c/7069

Change-Id: I12125fffb725cad3a4fef3134c83e55437529252
2012-08-03 14:39:05 -04:00
Jay Pipes
a6aa5f2107 Fix checks in server listing only lok for an ID
The list server filter details checks were checking
entire mappings against the list of mappings returned
from a call to GET /servers/detail. Unfortunately, the
mappings returned by the GET /servers/detail and the
mapping returned by POST /servers are slightly different,
resulting in the comparison failing. We really only are
checking that the server instance we expect to be in the
returned list of instances is there, so checking for the
server ID in the returned list is fine.

Change-Id: If9680f56a1ea06ffe93393d06b23bd231ccddd01
Fixes: LP Bug 1028465pep8 build for tempest.
2012-07-24 19:40:29 -04:00
Jay Pipes
257d3f847b Adds a script for tracking bug skips in tempest
New file tools/skip_tracker.py can be used to show the
status and priority of bugs that are marking test methods
for skipping, and instruct the caller to remove skips
on bugs that have been fixed in upstream. Output looks like this:

jpipes@uberbox:~/repos/tempest$ python tools/skip_tracker.py
INFO: Total bug skips found: 52
INFO: Total unique bugs causing skips: 30
INFO: Bug # 940500 (      Medium - Fix Released)
INFO: Bug # 963248 (   Undecided -      Invalid)
INFO: Bug # 966249 (   Undecided - Fix Released)
INFO: Bug # 987121 (      Medium - Fix Released)
INFO: Bug # 988920 (   Undecided -      Opinion)
INFO: Bug # 997725 (      Medium - Fix Released)
INFO: Bug # 999084 (      Medium -      Triaged)
INFO: Bug # 999209 (         Low - Fix Released)
INFO: Bug # 999219 (        High -      Triaged)
INFO: Bug # 999567 (      Medium - Fix Released)
INFO: Bug # 999594 (      Medium -  In Progress)
INFO: Bug # 999608 (         Low - Fix Released)
INFO: Bug #1002892 (   Undecided -      Invalid)
INFO: Bug #1002901 (   Undecided -      Invalid)
INFO: Bug #1002911 (   Undecided -      Invalid)
INFO: Bug #1002918 (   Undecided -      Invalid)
INFO: Bug #1002924 (   Undecided -   Incomplete)
INFO: Bug #1002926 (   Undecided -      Invalid)
INFO: Bug #1002935 (   Undecided -      Invalid)
INFO: Bug #1004007 (         Low -    Confirmed)
INFO: Bug #1004564 (         Low -    Confirmed)
INFO: Bug #1005397 (   Undecided -      Invalid)
INFO: Bug #1005423 (         Low -      Triaged)
INFO: Bug #1006033 (   Undecided -          New)
INFO: Bug #1006725 (         Low -      Triaged)
INFO: Bug #1006857 (         Low -    Confirmed)
INFO: Bug #1006875 (         Low -    Confirmed)
INFO: Bug #1014647 (      Medium -    Confirmed)
INFO: Bug #1014683 (   Undecided -          New)
INFO: Bug #1022411 (   Undecided -  In Progress)
The following bugs have been fixed and the corresponding skips
should be removed from the test cases:

   940500
   966249
   987121
   997725
   999209
   999567
   999608

Change-Id: Ic58fc8beb2f6134504d4eb2f6ebe40fa24fe06f6
2012-07-08 23:01:31 -04:00
Hengqing Hu
9bf93bace2 Remove trailing whitespaces in regular file
Change-Id: I46306a96062ccd751e65351a0bf3e5951ae15905
2012-03-03 12:21:55 +08:00
Brian Waldon
e62141bc50 Adding paramiko and unittest2 to pip-requires
Change-Id: I485e167908718805e36c9cdb88940e9ca0c06ec5
2011-10-27 12:47:05 -04:00
Aaron Lee
78dbb64366 Making run_test.sh python version and directory
agnostic

Refactored some of the shell scripts to handle
being run from another directory, as well as to
not force the use of 2.6

edit: format the comments

Change-Id: Id92b9dc82743598b7c570e431cad423c8a2ee95d
2011-10-18 14:24:26 -05:00
James E. Blair
108c28fff0 Add rfc.sh to help with gerrit workflow. 2011-09-09 08:56:58 -07:00
Justin Shepherd
0d9bbd1471 Initial Release 2011-08-26 16:08:57 +02:00