Commit Graph

12425 Commits

Author SHA1 Message Date
Matt Riedemann
b572053303 Mark some slow tests as slow so they move out of the main job
We've seen a trend of tempest-full jobs timing out because of
tests taking a long time to complete which are not marked slow:

  http://status.openstack.org/elastic-recheck/#1783405

Based on some analysis of the slowest tests:

  https://ethercalc.openstack.org/dorupfz6s9qt

This change marks several tests as slow and gives reasons why
they are marked as slow - not only because they are slow, but
also because they are less common scenarios. These will still
be run in the tempest-slow job so we aren't losing test coverage
with this change.

If this makes the tempest-slow job itself take significantly
longer, we should consider running the tempest.api* slow tests
concurrently (like they are in tempest-full) and continue to
run the tempest.scenario* tests in serial. The tempest-slow job
currently runs all slow tests in serial, so this will make the
job take longer.

Partial-Bug: #1783405

Change-Id: I2a0e154ba38c7407b41b7e986a0bf9b451c65cae
2018-09-20 09:22:12 -04:00
Zuul
ecddd38ecb Merge "Set max_microversion 2.35 for nova image tests" 2018-09-18 16:06:40 +00:00
Zuul
c5a7c2b4c9 Merge "Removing duplicate variable "parsed_args.config_file"" 2018-09-18 00:01:57 +00:00
Zuul
2943006ac5 Merge "Run tempest-full(-py3) in stable/rocky" 2018-09-17 23:22:19 +00:00
Manik Bindlish
a067405c4d Removing duplicate variable "parsed_args.config_file"
In test_run.py, there is a variable "parsed_args.config_file"
which is used twice during it's assignment.
Second time assignment is overwriting the assignment of first time.

So this patch set will remove the un-necessary duplicity.

Change-Id: I03dfb6990984a165d49ed9742f20e243370dc765
Partially-Implements: blueprint tempest-cli-unit-test-coverage
2018-09-17 09:23:45 +00:00
Zuul
3674fb1382 Merge "Set CONF.image_feature_enabled.api_v1 default to False" 2018-09-13 19:53:10 +00:00
Zuul
206e4f9d8b Merge "Fix an assert sequence in test_image_share_accept" 2018-09-13 19:23:02 +00:00
Zuul
c9eb94f56e Merge "Follow devstack-plugin-ceph job rename" 2018-09-12 22:15:16 +00:00
Zuul
f7ac1b136e Merge "Fix deprecated_name in the help message in config.py" 2018-09-12 18:17:54 +00:00
zhufl
a2de09bc8d Fix an assert sequence in test_image_share_accept
In test_image_share_accept, we should first check length
of members before getting first item of members.

Change-Id: I3b2b3c66d930aff54e13aefa14ecaaa535e89b47
2018-09-12 17:51:01 +08:00
Andreas Jaeger
a9c528fa2c Follow devstack-plugin-ceph job rename
The devstack-plugin-ceph jobs have moved in-repo and renamed, follow
rename.

Remove post job  publish-openstack-python-branch-tarball,
it's part of python-jobs template.

Depends-On: https://review.openstack.org/543048
Change-Id: I4bcd77d4b1d09d026ac3459312e8454878201658
2018-09-12 04:52:59 +00:00
zhufl
dc7eeb43c5 Fix deprecated_name in the help message in config.py
1. vnc.vnc_enabled in nova.conf is deprecated, and vnc.enabled
   is used instead, so help message of vnc_console should be fixed
   accordingly.
2. The format "nova.conf: DEFAULT.enable_instance_password" is the
   clearest one to mention the config item in nova.conf, so change
   all the occurrences to this format.

Change-Id: Iec8c6aeafd04d6449f7c5250e9953e80eb8a9151
2018-09-12 11:10:16 +08:00
Matt Riedemann
55e0065ab1 Run tempest-full(-py3) in stable/rocky
Nova noticed that we aren't running any tempest-full*
job in stable/rocky. This makes the tempest-full and
tempest-full-py3 job run on stable/rocky changes.

Change-Id: I7a05aeb244c5719a6b5c30f99c95789a44414a2e
2018-09-11 22:32:06 +00:00
Zuul
138807b7e3 Merge "Use openstack-tox-cover template" 2018-09-11 15:51:59 +00:00
Zuul
01a17f74ee Merge "switch documentation job to new PTI" 2018-09-11 11:00:17 +00:00
Zuul
5e3f6ad134 Merge "import zuul job settings from project-config" 2018-09-11 10:39:29 +00:00
Zuul
a4daf9c36c Merge "Fix to enable --config-file option" 2018-09-10 18:17:30 +00:00
Zuul
7c2b9402d8 Merge "Update .mailmap for ghanshyam emails" 2018-09-09 21:28:17 +00:00
Andreas Jaeger
015a006bca Use openstack-tox-cover template
Use openstack-tox-cover template, this runs the cover job
in the check queue only.

Remove jobs and use template instead.

Change-Id: I4a7b469024442d30d60c572dde229f5b9fb4d0b3
2018-09-09 06:03:08 +02:00
Doug Hellmann
5f4c55d932 switch documentation job to new PTI
This is a mechanically generated patch to switch the documentation
jobs to use the new PTI versions of the jobs as part of the
python3-first goal.

See the python3-first goal document for details:
https://governance.openstack.org/tc/goals/stein/python3-first.html

Change-Id: I58d1ea9e63333a2f0375881658c852b8b83e643d
Story: #2002586
Task: #24327
2018-09-08 22:54:05 -04:00
Doug Hellmann
6db0b78f87 import zuul job settings from project-config
This is a mechanically generated patch to complete step 1 of moving
the zuul job settings out of project-config and into each project
repository.

Because there will be a separate patch on each branch, the branch
specifiers for branch-specific jobs have been removed.

Because this patch is generated by a script, there may be some
cosmetic changes to the layout of the YAML file(s) as the contents are
normalized.

See the python3-first goal document for details:
https://governance.openstack.org/tc/goals/stein/python3-first.html

Change-Id: I718253f2b58d5e6f36156f63d8b9acd32b59a124
Story: #2002586
Task: #24327
2018-09-08 22:53:21 -04:00
Zuul
f10cf32d7b Merge "Remove unnecessary response check in InstanceUsageAuditLogTestJSON" 2018-09-07 13:15:25 +00:00
Zuul
e6cd01c452 Merge "Bump up python version of unit test" 2018-09-07 11:16:28 +00:00
zhufl
dc68af740b Set CONF.image_feature_enabled.api_v1 default to False
Glance v1 APIs are deprecated and v2 APIs are current one,
but CONF.image_feature_enabled.api_v1 now defaults to True,
so CONF.image_feature_enabled.api_v1 must be explicitly set
to False in tempest.conf to avoid using api_v1, which is
annoying. So this is to set CONF.image_feature_enabled.api_v1
default to False.

Change-Id: Iab3a209c744375bf2618afc00a3f7731b62f557e
2018-09-07 17:31:40 +08:00
zhufl
6e7c86e119 Remove unnecessary response check in InstanceUsageAuditLogTestJSON
The response checks in InstanceUsageAuditLogTestJSON are already
covered by schema check, so no need to check it in testcases.

Change-Id: Ia4415d5cd8c3ebc85a5aa72e78e884c6f6f7b48e
2018-09-06 17:40:51 +08:00
Zuul
293e36c61d Merge "Add check for hypervisor state before getting uptime" 2018-09-05 15:11:10 +00:00
Zuul
2b9505ad3f Merge "Remove unnecessary class variables" 2018-09-05 12:11:52 +00:00
Zuul
27abf54b21 Merge "Add test for list snapshots with offset param" 2018-09-05 11:50:26 +00:00
Zuul
6e0922ca87 Merge "trivial: Correct class name for BaseVolumeQuotasAdminTestJSON" 2018-09-05 10:39:11 +00:00
ghanshyam
15eeb90b8d Update .mailmap for ghanshyam emails
Change-Id: Ie6b6d6551b1ccee55c2ab739c1e869d7d9134d1e
2018-09-05 08:45:46 +00:00
Zuul
e18f7e6466 Merge "Cleaning up a duplicated code" 2018-09-04 11:10:15 +00:00
zhufl
c7d65d1bd3 Add check for hypervisor state before getting uptime
show_hypervisor_uptime will take several minutes to
return fail info if hypervisor is not good, so this is to add
check for hypervisor state up before show_hypervisor_uptime
to save running time in the situation where there is abnormal
hypervisor in the system.

Change-Id: I93753a73ac84243d6837b3364d1f252018e03431
2018-09-04 16:48:31 +08:00
Zuul
94c822fc3c Merge "Do not set microversion for server diagnostics negative test" 2018-09-04 05:51:26 +00:00
Zuul
fdbc9d2688 Merge "Remove unused config.CONF" 2018-09-04 00:14:59 +00:00
Zuul
9d27667db2 Merge "Removing unnecessary else" 2018-09-03 20:44:24 +00:00
Felipe Monteiro
345f64f289 trivial: Correct class name for BaseVolumeQuotasAdminTestJSON
We are prefixing these class names with "Base" even though they
runs tests [0]. Nothing inherits from either as well, so we
should be able to safely drop "Base" prefix from both [1][2].

[0] e.g. http://logs.openstack.org/16/599316/1/check/tempest-full/591615d/job-output.txt.gz#_2018-09-03_09_27_59_970390
[1] http://codesearch.openstack.org/?q=BaseVolumeQuotasAdminTestJSON&i=nope&files=&
[2] http://codesearch.openstack.org/?q=BaseVolumeQuotasNegativeTestJSON&i=nope&files=&repos=

Change-Id: If0fb302b86c3f15b6107ed1fc1e390eb101e9774
2018-09-03 20:23:16 +00:00
Vishakha Agarwal
2354ea6034 Remove unused config.CONF
This is to remove unused config.CONF
to keep code clean.

Change-Id: I062be26814b7265904ab5a3ae478250fb3bc0a0d
2018-09-03 12:43:46 +00:00
zhufl
ef967ea00d Remove unnecessary class variables
Some variables in volume quota tests needn't be class variables,
so this is to change them to local variables.

Change-Id: Iabbeb5ea4bcdfb840dd974490a3648614443309b
2018-09-03 16:42:41 +08:00
Zuul
fb8c6c6a20 Merge "Update .mailmap email addresses" 2018-09-03 08:26:36 +00:00
Masayuki Igawa
80d30b8178
Bump up python version of unit test
This commit bumps up the python version to 3.6. This change encourages
developers to use our latest python version on unit tests.

Change-Id: I45d79c90939aa0f743750fec4b4e286f3679563b
2018-09-03 17:25:49 +09:00
Vishakha Agarwal
823450339e Removing unnecessary else
The patch addresses the removal of 'else'
written for if which is irrevalent.

Change-Id: I538ae1380681ec1b0feb0505142549a2ba4eb458
2018-09-03 12:36:32 +05:30
jeremy.zhang
8e3ecfd77e Add test for list snapshots with offset param
This patch is to add test for list snapshots with offset param.

Change-Id: I1f151e9181161e9fa3c3762270eeb2dc42e468f7
2018-09-03 14:46:31 +08:00
lkuchlan
91d5fe0573 Cleaning up a duplicated code
These tests do exactly the same thing except passing
a different size parameter.

Change-Id: I4339c1d05f53525b47fbc86dd38763fef71e3c46
2018-09-03 07:01:56 +03:00
Masayuki Igawa
9d9ce95cc3
Update .mailmap email addresses
This commit updates my email addresses in .mailmap because I'm trying
to abandon the domain.

Change-Id: Id6103088b9c010bff8538ec62c680660bba31686
2018-09-03 11:20:23 +09:00
Zuul
9144a05a87 Merge "Migration tests in v2.6 should not repeat all migration tests." 2018-08-31 10:21:23 +00:00
zhufl
550bf417b6 Do not set microversion for server diagnostics negative test
After microversion 2.48, response data from each hypervisor
differs from that before 2.48, so microversion is set in
test_server_diagnostics.py, but for server diagnostics negative
test("Non-admin user cannot view server diagnostic"), there
is no difference between before and after 2.48, so no need to
set microversion for server diagnostics negative test.

Change-Id: I0c256aa58258de934fd6e49cc5e1ef6b8ab1abd6
2018-08-31 16:18:21 +08:00
Zuul
693515dd63 Merge "Modify comment of scheduler_available_filters" 2018-08-30 09:36:44 +00:00
Zuul
6d4657a949 Merge "Fix nits and log from I996d257e089f0676e316f2b14207c343063ccf8e" 2018-08-30 07:55:57 +00:00
zhufl
6b76494ae6 Modify comment of scheduler_available_filters
nova.conf.DEFAULT.scheduler_available_filters is deprecated,
so this is to modify the comment of scheduler_available_filters
in config.py accordingly.

Change-Id: I43e64b8cd434bcd26cebad400ebec380245a68b3
2018-08-30 10:52:35 +08:00
ghanshyam
676492a6cc Fix nits and log from I996d257e089f0676e316f2b14207c343063ccf8e
This commit fixes some nits and improve logging for
I996d257e089f0676e316f2b14207c343063ccf8e

Change-Id: I0fdf0fdea650a19959031d0217c3157ce2aff67c
2018-08-30 01:52:51 +00:00