705 Commits

Author SHA1 Message Date
Federico Ressi
71bda86402 Add guest image customization to DevStack plugin.
CI jobs for this plugin use DevStack to install and configure
OpenStack and to upload guest images to be used for tests.

This change allow to customize guest images just before
being sent to image service with the purpose of installing
new packages (like socat), configuring N network devices, etc.

This change has been created because for testing multicast
socat is required, but it was designed with the idea
of being used to allow further guest images customizations.

Change-Id: I88491dbb65031fe3743d1c3d27c38a57b5511794
2018-10-02 16:23:19 +00:00
Zuul
fadb39e23c Merge "Wait for floating IP to be DOWN before checking port details" 2018-10-02 08:57:22 +00:00
Brian Haley
af347da20f Wait for floating IP to be DOWN before checking port details
Occasionally test_floatingip_port_details() fails, showing
the floating IP attached port status as 'BUILD'.  Wait for the
status to transition to 'DOWN' before checking other port details,
similar as is done to the fixed IP port's device_id value.

Changed afffected method to use constants for port status as well.

Change-Id: I862115b37c97d5a3cad082d8cd4e7b855ef3f88b
Closes-bug: #1792472
2018-10-01 14:30:44 -04:00
Federico Ressi
3dfa94cf4c Refactor test cases after adding new params to create_floatingip.
Change-Id: I1feaed67e46edce85397907528e23c4a5f487c1f
2018-09-27 07:16:17 +00:00
Zuul
e96fe65007 Merge "Add jobs for stable/rocky branch" 2018-09-26 23:44:22 +00:00
Zuul
1eafa25596 Merge "Mark NetworkMigrationFromHA scenario tests as unstable" 2018-09-26 05:25:41 +00:00
Hongbin Lu
b600bea6c0 Add jobs for stable/rocky branch
Change-Id: I5661e9f7c7649c85bf4584e3723f2c0da6a29df4
2018-09-25 15:13:15 +00:00
Slawek Kaplonski
e137cd003b Mark NetworkMigrationFromHA scenario tests as unstable
We know that those tests are failing 100% times because
router ports are not going DOWN when router's admin_state_up is
set to FALSE.
Let's make it unstable until this issue will be resolved to make
scenario jobs passing at least sometimes ;)

Change-Id: Ia9e4af5d798a769c5ff7056e686632bac6f79aec
Related-Bug: #1789434
2018-09-25 14:28:22 +02:00
Federico Ressi
c9f5ec58ce Update trunk tests to use create_trunk method.
Change-Id: I5eed63cf454596c1b58f1ec9546669c03f234341
2018-09-24 11:48:57 +00:00
Zuul
55dfb3193c Merge "Add release notes job to zuul template" 2018-09-18 04:41:16 +00:00
Brian Haley
2cbb10eb3f Add release notes job to zuul template
We are not running the release notes job, so are unable to
see the built release notes when they are included in a patch.
Add it as in the other neutron repos.

Also added a similar README.rst as the neutron repo to give
the basic info on release note generation, and fixed up
various issues in the configuration description.

Change-Id: I98ffed3ed77a16bba59cae69a73cb699ddb175fb
2018-09-13 15:26:04 -06:00
Slawek Kaplonski
6bf840f0a7 Fix bash cmd used in scenario trunk tests
In scenario trunk test test_subport_connectivity there
is bash command used to check name of base interface on
spawned vm (e.g. ens3 or eth0), configure vlan interface
with vlan_id used on trunk port (e.g. ens3.10),
make this vlan device up and run dhclient on this interface
if it's not running yet.

This command was broken and that cause failure of this test.

Change-Id: I4c0207f79cd6df2594f976b9509697209011edf2
Closes-Bug: #1766701
2018-09-12 06:21:18 +02:00
Zuul
5247e03ef3 Merge "Add delete_agent to NetworkClientJSON" 2018-09-14 05:27:05 +00:00
Mykola Yakovliev
299c4bd450 Add delete_agent to NetworkClientJSON
This patchset add delete_agent method that implements respective API [1]

[1] https://developer.openstack.org/api-ref/network/v2/index.html#delete-agent

Change-Id: I0f4927944cb48a19eb8cdff5312557b3ba044420
Closes-Bug: 1792007
2018-09-13 12:20:54 -05:00
Slawek Kaplonski
17bc8d851e Revert "Use nested virt in scenario jobs"
Nested virt doesn't work well on infra nodes.
This reverts commit 190755866c6dbbd735dcae3ee9434c8f03722763.

Change-Id: I43eeb502ba07cf5745a17015df7fdc7120df6eaa
Closes-Bug: #1788006
2018-09-10 16:14:05 -06:00
Zuul
5f371ea030 Merge "Add tests to assert filter validation" 2018-09-07 19:55:35 +00:00
Zuul
f785dd4ad4 Merge "Cleanup Tempest tests legacy resources" 2018-09-05 00:44:59 +00:00
Hongbin Lu
54f5592802 Add tests to assert filter validation
Add test cases to pass valid and invalid filters to server.
If a valid filter is passed, assert server returns the correct
list of resources. If an invalid filter is passed, assert
server returns a 400 response.

Change-Id: I2b8baa93a5587fa036a8a8ab124c216d2dba4444
Related-Bug: #1749820
2018-09-03 18:16:02 +00:00
Doug Hellmann
12685c6f23 import zuul job settings from project-config
This is a mechanically generated patch to complete step 1 of moving
the zuul job settings out of project-config and into each project
repository.

Because there will be a separate patch on each branch, the branch
specifiers for branch-specific jobs have been removed.

Because this patch is generated by a script, there may be some
cosmetic changes to the layout of the YAML file(s) as the contents are
normalized.

See the python3-first goal document for details:
https://governance.openstack.org/tc/goals/stein/python3-first.html

Change-Id: I0fe9ef7cabdb0b389bc3852708c0a75fef591510
Story: #2002586
Task: #24314
2018-08-29 17:37:50 -04:00
Zuul
7363c8a789 Merge "Reuse SSH connections for executing multiple commands." 2018-08-28 02:21:05 +00:00
Zuul
23f4c8e318 Merge "Consolidate irrelevant-files in zuul config" 2018-08-27 21:54:56 +00:00
Federico Ressi
6f0644e271 Reuse SSH connections for executing multiple commands.
When using SSH client to execute a command a Paramiko
client is created, it is connected to server and then the
client reference is forgot without closing socket.

This produces a leak of SSH connections. It also slow
down test executions when more than one command has to
be executed with the same SSH client (for example when
executing ping between VMs).

This change also add convenience methods to SSH client:

- connect() method allows to create and connect Paramiko
  client to be used by tests directly (for exaple to open
  a command like socat, cat, nc and redirect STDIN/STDOUT
  to generate or receive network traffic. The method is
  going to return the same Paramiko client instance
  until close() method is called.

- close() method allows to close paramiko client socket and
  release resources.

- execute_script() spawn a script interpreter (Bash by default) on
  a remote machinge to execute a script provided as a string.
  For convenience by default it combines STDOUT and STDERR to LOG
  an human friendly message when the script fails.

Change-Id: I3a70131f03aea342c8e8a04038000bd974cca921
2018-08-27 15:27:07 +00:00
Hongbin Lu
e208962b7d Consolidate irrelevant-files in zuul config
Change-Id: I3ff5c9e7852910c55d73db624cf59b18be10856c
2018-08-27 12:53:18 +00:00
Federico Ressi
bf877c84b3 Deprecate BaseTempestTestCase.create_and_associate_floatingip method
Add new 'debtcollector' dependency with the purpose of deprecating methods
that are going to be removed.

Mark BaseTempestTestCase.create_and_associate_floatingip for removal.

Replace create_and_associate_floatingip with create_floatingip in
BaseTempestTestCase class.

Change-Id: I5c5fd143a5cb4e138c46d13445f8225444bd2f58
2018-08-24 09:00:42 +02:00
Federico Ressi
a69dcd5aec Create floating IPs with additional parameters.
It adds missing parameters to create_floatingip method:
  - port: is translated to port_id=port['id']
  - client: is used to create/delete returned floating IP
  - **kwargs: are forwarded as they are to client

It deletes floating IPs on final cleanup even when created
  by other client than default one.

It implements delete_floatingip method.

Change-Id: Ie2421839947f9010e8d2590cde1fd86669092fb9
2018-08-24 09:00:42 +02:00
Zuul
d307f5635d Merge "Stop running designate scenario job on docs-only changes" 2018-08-24 02:09:13 +00:00
Dongcan Ye
2de722ef0a Cleanup Tempest tests legacy resources
There are lots of resources left after tempest tests finished,
we should cleanup.

This patch cleanup routers and security groups which
generated by default DevStack config, we still keeps
working on in the other patches.

Change-Id: I8dad97fdebd91f824a043dc60381b3a8ea29d5ed
Partial-Bug: #1759321
2018-08-21 13:27:58 +00:00
Zuul
d1020f8027 Merge "fix tox python3 overrides" 0.2.0 2018-08-20 11:13:10 +00:00
Zuul
67681af1c4 Merge "Assert extensions match in config file and server" 2018-08-17 06:45:39 +00:00
Zuul
9b7d7fb0d8 Merge "Add test tools for executing socat on guest images." 2018-08-16 11:51:20 +00:00
Federico Ressi
90a7ee18b6 Add test tools for executing socat on guest images.
Add socat helper module to execute socat via SSH in
test cases that require a more advanced tool than nc
(like for example multicast test).

Change-Id: I1a21d082422afaec37c24814cc4caebacb790874
2018-08-16 06:11:54 +00:00
Federico Ressi
82e83e3b45 Add create_trunk and delete_trunk methods.
Change-Id: I23f74551325a45147af054fe37b0f7e8b9bd3d5e
2018-08-16 06:08:04 +00:00
huang.zhiping
08dc747136 fix tox python3 overrides
We want to default to running all tox environments under python 3, so
set the basepython value in each environment.

We do not want to specify a minor version number, because we do not
want to have to update the file every time we upgrade python.

We do not want to set the override once in testenv, because that
breaks the more specific versions used in default environments like
py35 and py36.

Change-Id: I7bbfe9d9a240a4badf75623e5270afcd24770e5d
2018-08-15 02:30:09 +00:00
Slawek Kaplonski
7a5d022931 Stop running designate scenario job on docs-only changes
There is no need to run neutron-tempest-plugin-designate-scenario job
on patches where only docs or release notes are changed.

Change-Id: Idfe62149639644b3761791be5353727c3f9f09a6
2018-08-14 13:34:26 +02:00
Hongbin Lu
79318ac521 Assert extensions match in config file and server
If an API extension is enabled in tempest config file, we want
to ensure the extension is present in neutron server.
In before, we occasionally ran into issues that the list of
extensions is mismatch, which leads to failure of test cases.
This patch adds a test case to check that.

Change-Id: I4c59f407c30020e3865e96e67a1b61361e699014
2018-08-13 18:04:11 +00:00
Zuul
155164646d Merge "Add scenario test for fip port_details" 2018-08-11 23:13:56 +00:00
Slawek Kaplonski
1cd4fb4bd7 Skip test_connectivity_min_max_mtu if cirros image is used
Command "ping" available in cirros image don't have "-M" option.
This is necessary in test_connectivity_min_max_mtu scenario tests
to check connectivity without fragmenting packets.
So those tests will always fail with cirros and should be skipped
in such case.

Change-Id: Idb63cb37f6e1cc467106ea3ee99727824a4b1529
Closes-Bug: #1786472
2018-08-10 21:05:17 +02:00
Slawek Kaplonski
096b6a8de6 Wait until all router ports are DOWN before migration
In router migration tests, before migration is started, router
is set to admin_state_up=False. This cause that status of all
router ports should be set to DOWN.
This patch adds check (and wait) that all ports are really set
to DOWN state before migration of router is started.

Change-Id: I72ce0d4480c6d26e8ce1c8193e7ec18585df1c06
Related-Bug: #1785582
2018-08-07 22:05:42 +02:00
Zuul
1efafc921f Merge "FloatingIPQosTest: Stop inheriting QoSTest class" 2018-08-05 20:27:38 +00:00
Slawek Kaplonski
190755866c Use nested virt in scenario jobs
virt_type option in nova-compute will be now set to "kvm" instead
of "qemu" if test job will be running on node which supports
nested virtualization.
In case of nodes where it's not supported, devstack will
automatically switch it to "qemu" again. It's in [1].

This should improve time of booting vms so tests should be finished
faster and there should be less errors with ssh to instance timeouts.

[1] http://git.openstack.org/cgit/openstack-dev/devstack/tree/lib/nova#n289

Change-Id: Ifaa37398634f3cda73525363f8e197f03fd63a7d
2018-08-02 12:35:47 +02:00
YAMAMOTO Takashi
a2cc2e535b FloatingIPQosTest: Stop inheriting QoSTest class
Instead, have a separate class for shared code (QoSTestMixin)
so that we can add test cases to QoSTest without affecting
FloatingIPQosTest.

Change-Id: I2fc2d2a94e78298c2bded00b585c8a1ae852fc0a
2018-07-31 18:55:47 +09:00
Boden R
c2fd6d954c update requirements for neutron-lib 1.18.0
Neutron-lib 1.18.0 is our Rocky RC and is already being used by neutron
[1]. This patch updates the neutron-lib required version to match
neutron [1] in prep for the Rocky release.

[1] https://review.openstack.org/#/c/583671/

Change-Id: Iee7a1ab3559b3ef58354f90774c2854e41dc18ae
2018-07-23 07:25:56 -06:00
Zuul
db21cd5eaa Merge "Skip filter validation tests" 2018-07-21 12:38:55 +00:00
Zuul
3e1912286e Merge "Use latest Ubuntu 16.04 LTS guest image." 2018-07-19 23:23:00 +00:00
Zuul
44b202477f Merge "Allow to connect to SSH server using an intermediate SSH server" 2018-07-19 23:23:00 +00:00
Hongbin Lu
965b03dc12 Add scenario test for fip port_details
Change-Id: I275da05d4dae1a1ce1dff7d63f3b58ff5916aac3
Related-Bug: #1723026
2018-07-19 21:17:45 +00:00
Zuul
a1037291ac Merge "Refactor tests to use create_network convenience params." 2018-07-19 21:11:20 +00:00
Zuul
d052a5615d Merge "Add convenience parameters to create_network." 2018-07-19 21:11:19 +00:00
Zuul
e80584e81b Merge "Add a scenario test for internal dns_name" 2018-07-18 12:06:34 +00:00
Assaf Muller
92fdc78619 Add a scenario test for internal dns_name
Change-Id: Ie46ee889d75b64292c1d9268624c4600a186ee41
2018-07-17 12:51:01 -04:00