138 Commits

Author SHA1 Message Date
Goutham Pacha Ravi
e3e3af52b1 [grenade] Switch base version
Grenade jobs need to test Rocky-->Stien (dev)
in the master branch.

Change-Id: Id7664187e1d95920be072cd85ebbb817ef5b087d
2018-10-01 22:48:26 -07:00
Goutham Pacha Ravi
9f0b35b807 [ZFSOnLinux] Allow devstack bootstrap in Ubuntu > 16.04
The package seems to be present and maintained
in the ubuntu repositories for all releases
following Xenial Xerus.

[1] https://packages.ubuntu.com/search?keywords=zfsutils-linux

Change-Id: If212e0482b360f3c3888918242dba6a710ab2818
Needed-By: https://review.openstack.org/#/c/604929/
2018-09-25 12:43:42 -07:00
Zuul
3d8ae6ac4b Merge "Remove logging overrides from plugin.sh" 2018-08-17 01:24:16 +00:00
Goutham Pacha Ravi
9448c3360d Remove logging overrides from plugin.sh
Avoid overwriting the log formatters, reuse
the helper available in Devstack.

Closes-Bug: #1787310
Change-Id: I25eb16ea9a6e3e98de6a7ee349df17438847d601
2018-08-16 03:09:38 +00:00
Goutham Pacha Ravi
f9ae7aab05 Test share type per test suite changes
Make default share type and group type
creation optional in
manila-tempest-minimal-dsvm-dummy job.

Depends-On: https://review.openstack.org/#/c/540070/
Change-Id: I585c15d9eb4eefb843df62f7aad08838c83611e2
2018-08-06 17:05:04 +00:00
Tom Barron
093072536e [Grenade] Switch base to stable/queens
We should test two neighbour branches in grenade job.
So, after branching of stable/queens we should use it as
base for testing of manila migration to current master
branch (Rocky-dev).

Change-Id: I20a78d69b4adcedd2e1691c7ef672567826a6b79
2018-05-24 09:04:19 -04:00
Rishabh Dave
72df3cd79a Circumvent bug #1747721 to prevent CI failures
Change-Id: I0fb057657fdf568b591bc6a43cfd6eb355010523
Related-Bug: #1747721
Signed-off-by: Rishabh Dave <ridave@redhat.com>
2018-03-28 11:15:05 +05:30
Rishabh Dave
72f79e5c57 Fetch and install manila-tempest-plugin system-wide
And don't enlist manila-tempest-plugin for installation in venv-tempest.

Change-Id: I0844cdb48b9d415bd341c4687620412178be871b
Signed-off-by: Rishabh Dave <ridave@redhat.com>
2018-03-08 17:35:30 +05:30
Rodrigo Barbieri
dc93ae534c Update manila plugin to support IPv6
This patch makes necessary changes to devstack manila
plugin in order to be able to run IPv6 scenario tests.

Part of the changes included the dependency of
neutron-dynamic-routing plugin and the installation
of quagga, so routes in devstack host can be created
automatically for each router and private network
created by tempest during the tests.

Also, added a new config option "override_ip_for_nfs_access"
for manila tempest plugin that overrides the access rules used
for NFS scenario tests. This option can be set by exporting the
environment variable "OVERRIDE_IP_FOR_NFS_ACCESS" with the
intended value before running devstack.

This change is enabled by a following change and
tested alongside a change on manila-tempest-plugin
project.

Please note that we are temporarily disabling IPv6
functionality in Host-assisted Share Migration, as
the Data Service is not able to handle IPv4 + IPv6
scenarios.

Change-Id: I4ca727f92618998242af18908bbbda6bb5f86303
Needed-By: Id8b005cdd429d53a75624885fe7ca795746c3ede
2018-01-24 17:11:22 -02:00
Zuul
11bf61f5ba Merge "Remove in-tree tempest plugin" 2017-12-22 13:40:44 +00:00
Raissa Sarmento
797048c5ce Remove in-tree tempest plugin
Remove in-tree tempest plugin in favor of newly
created manila-tempest-plugin repository.

Change-Id: I1fb124598f38067fee469df124ee684f748c6f57
2017-12-22 11:11:38 +00:00
zhongjun
64eaeae6bd [policy in code] Add support for AZ, scheduler and message resource [9/10]
This patch adds policy in code support for availability_zone,
scheduler_stats and message resources.

Change-Id: I9a79b5ececc583e85149cc920321e461e832b245
Partial-Implements: blueprint policy-in-code
2017-12-20 06:22:02 +00:00
junboli
411855cda7 [Grenade] Switch base to stable/pike
We should test two neighbour branches in grenade job.
So, after branching of stable/pike we should use it as
base for testing of manila migration to current master
branch (Queens-dev).

Change-Id: I0794a7e699622051a7b094b81dcfc843e7b43880
2017-09-07 00:36:01 +00:00
Ben Swartzlander
3755978ef7 Allow 2 or more export IPs for LVM driver
Supporting dual IPv4/IPv6 backends will eventually require
multi-IP support in the first party backends. This change
enables multi-IP support (IPv4-only currently) in the LVM
driver.

Change-Id: Ib3594aa5d7751c829820fce830d87f6ceea6b049
Partial-Implements: blueprint support-ipv6-access
2017-07-18 16:05:27 -04:00
Yuval Brik
65f4a1c564 devstack: clone Manila client only if marked to
Currently, Manila's devstack plugin clone manilaclient. Some projects
depend on Manila but would like to install packaged manilaclient.
Clone the manilaclient only if it was marked to be used from git

Change-Id: Ia8e726b9358f6901c172a31f638a59eba523e0fa
Depends-On: I94d2f143159b60c4f8693e35fe844bc1e411e580
2017-05-03 11:21:01 +03:00
Valeriy Ponomaryov
16bfc82962 Add possibility to run 'manila-api' with wsgi web servers
One of the goals for Pike [1] is to make each API service be able to
run under web servers that support WSGI applications,
such as Apache (+mod-wsgi) and Nginx (+uWSGI).

Do following to address governance requirements:
- Split existing manila/wsgi.py module into 3 modules:
  First (manila/wsgi/eventlet_server.py) is used by
  eventlet-based WSGI application approach.
  Second (manila/wsgi/wsgi.py) is used for WSGI web servers.
  And third (manila/wsgi/common.py) is common code for both.
  All three are made in cinder-like way to have alike-approach.
- Reuse common code from "oslo_service/wsgi.py" module that
  allows us to remove code duplication.
- Delete config opts that are defined by newly reused common code.
- Register new entry point that will be manila wsgi app: "manila-wsgi".
- Fix "manila/api/openstack/wsgi.py" module to be compatible
  with str/bytes handling approach used by Apache mod-wsgi plugin using
  different python versions (2/3).
- Add web server config template "devstack/apache-manila.template"
- Add devstack support where usage of this feature can be
  enabled or disabled using "MANILA_USE_MOD_WSGI" env var.
  It is set to "True" by default, because it is requirement for Pike
  release - to have it running in all CI jobs.
  Disable it only for one CI job that uses dummy driver and tests
  various manila core features that are not covered by other CI jobs.

[1] https://governance.openstack.org/tc/goals/pike/deploy-api-in-wsgi.html

Partially-Implements BluePrint wsgi-web-servers-support
DocImpact
Change-Id: Ibdef3c6810b65a5d6f3611e2d0079c635ee523ab
2017-04-10 12:49:20 +03:00
Jenkins
fddb11eb74 Merge "devstack: skip nfs kernel install if nfs-ganesha" 2017-04-08 04:07:20 +00:00
Hongbin Lu
c0c3aa035c Move create_manila_accounts to post-config
In before, Manila devstack plugin create the service endpoint in
"extra" stage. This caused issue of other services that depends
on the manila endpoints that are not yet created. This commit
move the endpoint creation to "post-config" stage, which is the
practice of other OpenStack services

Change-Id: I3adfbf78d0792471a29c7ff979aad1418e6137d4
2017-03-24 21:28:07 -05:00
Tom Barron
ab778b3124 devstack: skip nfs kernel install if nfs-ganesha
is running under systemd since the services are incompatible.
Skip the samba install and startup as well since there is
no current use case for running samba plus nfs-ganesha.

TrivialFix

Change-Id: I6d6fe3a3babe2f7fcd9ca9461785ac413ff4ab2c
2017-03-15 14:40:39 -04:00
Valeriy Ponomaryov
9ea065ebea Enable share groups back
This feature was disabled by default in Ocata.
Now, enable it back to ease further work and updates of this feaure.

Change-Id: Ib57b55ce77df1b8e6481057014f2e9f6d743e34d
2017-03-14 16:51:12 +02:00
Tom Barron
af7ac539aa Start NFS and SMB services on fedora platforms
after installing them in the devstack plugin.

Change-Id: Idddbcdf8750a041aa79943f9950c20c4d9d35502
Closes-Bug: #1670434
2017-03-06 12:18:25 -05:00
vponomaryov
e79cf7bf33 Fix 3 CI breakages
1) Increase default RAM value in manila flavor to be able
   to use manila service image with new 64bit architecture.
2) Fix test requirement on "hacking" lib to avoid pep8 breakage.
3) Fix unstable maprfs driver unit test that depends on local hostnames
   and IPs.

Change-Id: Ib36113e33e3616984be5864fbaf73c1fc5d7a315
Closes-Bug: #1669412
Closes-Bug: #1659162
2017-03-02 18:22:40 +02:00
Thomas Bechtold
29203938a0 Fix syntax in devstack plugin
Shell syntax is "else", not "else:". This fixes:

/opt/stack/manila/devstack/plugin.sh: line 647: else:: command not found

Change-Id: I1742a71a3c637c4224c15e670862bf1b47d4a95f
2017-02-23 06:48:29 -05:00
Tom Barron
010354b3e1 Enable devstack deploy of container driver on Fedora
Change-Id: I31bf07ca46efb6858f78146c29372aad54347138
2017-02-14 18:44:49 +00:00
Valeriy Ponomaryov
0d30c50a60 [Grenade] Add test with creation of share snapshot
Extend test coverage for 'upgrade' devstack logic (grenade) by
adding new test that creates share snapshot.

Change-Id: I2610fe744123eab2b3fc6ed74ed191e38cecb92e
2017-02-09 18:27:26 +00:00
Valeriy Ponomaryov
f3218a1d42 [Grenade] Switch base to stable/ocata
We should test two neighbour branches in grenade job.
So, after branching of stable/ocata we should use it as base
for testing of manila migration to current master branch (Pike-dev).

Also, update existing code to be consistent with newer microversion.

Change-Id: Id78c30e2000186958a2eb8f6fd727042d9b31862
2017-02-09 14:50:39 +00:00
Jenkins
7c2c97d725 Merge "Disable share groups APIs by default" 2017-02-07 00:42:03 +00:00
Valeriy Ponomaryov
8ac4f0a913 Disable share groups APIs by default
as of Ocata because feature has not been completed.
Revert this change back in Pike.

Change-Id: Ibe2f7fba436e298b720a492594579d64b2e81a47
Closes-Bug: #1661639
2017-02-06 14:11:27 +02:00
Tom Barron
a05b5a3ae9 Fix devstack manila nfs install for fedora
nfs-utils-lib is obsolete and the functionality
we needed from it for the generic driver has been
pulled into nfs-utils package.

Change-Id: I7ff864391cbe0dc7775a84c90b83a9e830785e2b
Closes-bug: #1650941
2017-02-06 04:53:59 -05:00
Jenkins
40a030bf5d Merge "Enable host-assisted migration in ZFSOnLinux CI" 2017-02-02 16:02:48 +00:00
Valeriy Ponomaryov
8cfb1e2189 Fix setup of DHSS=False mode for generic driver
By moving creation of Nova VMs to later step when Nova configuration
is fully completed. In our case, after merge of [1] we are able
to create Nova VMs only in "test-config" section because latest Nova
step that is required for creation of VMs is performed in the end
of "post-extra" section.

[1] I8742071b55f018f864f5a382de20075a5b444a79

Change-Id: Ib941a5551fe340b39719e3c0e701067ce83bac02
Closes-Bug: #1660304
2017-01-31 18:08:46 +03:00
Rodrigo Barbieri
31ea6a3c14 Enable host-assisted migration in ZFSOnLinux CI
ZFSOnLinux CI is able to run host-assisted migration tests,
so enable them.

TrivialFix

Change-Id: I66578bad361867d1f698e39ceef07d94038c30c2
2017-01-31 09:02:05 -02:00
Jenkins
604a95f0a6 Merge "Make LVM export IP configurable" 2017-01-29 03:58:40 +00:00
Jenkins
6957d20442 Merge "Fix Generic driver DHSS=False setup" 2017-01-29 02:48:04 +00:00
Jenkins
eeaa99ef1f Merge "Revert "[Devstack] Workaround osclient breakage"" 2017-01-28 05:39:26 +00:00
vponomaryov
0f96b433e6 Fix Generic driver DHSS=False setup
Nova API started having bug where it does not list servers that really
exist. So, avoid this bug in manila parsing answer of "create" command
instead of doing second request with name of VM to get its ID.

Change-Id: Ice8e297e9055df6eec83d2c8f4b9932ad52a612f
Related-Bug: #1659391
2017-01-26 17:11:27 +02:00
Ben Swartzlander
436d9aa687 Make LVM export IP configurable
Change-Id: I0d67c9c2a774f19a20db8e4b3b8745e55d796148
2017-01-25 23:26:42 -05:00
Valeriy Ponomaryov
32708bda48 Revert "[Devstack] Workaround osclient breakage"
This reverts commit 10b14bb50e95d2a30bba4e4c37a7de9c4b564691.

Change-Id: I1cbc33a4b76e5ab8a65db86ed00b0ccba579d5d9
2017-01-25 18:36:58 +00:00
Jenkins
47507ee873 Merge "Fix devstack plugin to not depend on private network" 2017-01-25 16:25:35 +00:00
Ben Swartzlander
912360e807 Fix devstack plugin to not depend on private network
A private network is only needed in the devstack plugin in the
case of generic driver, dhss=false. Therefore we move the command
that depends on it into the loop so things don't break when the
network doesn't exist if it's not needed.

Change-Id: If8074e6b7ce5d42430666f23484167d6a7262be5
2017-01-24 09:57:34 -05:00
Andrew Kerr
1002642674 [Tempest] Add functional tests for share groups feature
Add functional tempest tests to new 'share group' feature [1].

[1] I79a80a62ae4e0015d6161edc2b93fd1f9ba69537

Co-Authored-By: Andrew Kerr <andrew.kerr@netapp.com>
Co-Authored-By: Valeriy Ponomaryov <vponomaryov@mirantis.com>
Partially-implements-blueprint: manila-share-groups
Depends-On: I8e29baed62355fc31caeec9c7a66eaebfcbdf184
Change-Id: I820eb959082995d961b1be992e4b2d1d1a985c1c
2017-01-23 19:30:33 +00:00
vponomaryov
10b14bb50e [Devstack] Workaround osclient breakage
Creation of security group using openstack client is broken. So,
use nova client for it temporary while 'related' bug is not fixed.

Change-Id: I51b5be5157bd49d5835b30eaa8b6b0e7185cabdf
Related-Bug: #1652317
2016-12-23 17:33:20 +02:00
vponomaryov
3ede2d1c48 [Grenade] Do not run tempest tests
Since tempest is not used in manila grenade logic skip run of its
tests.

Change-Id: I6c45448ec286fe6c365b4e9edcce56501e5c87bd
Closes-Bug: #1650482
2016-12-21 11:16:22 +02:00
Alexey Ovchinnikov
c19dbbd2e6 Enable scenario tests for LVM and ZFSonLinux drivers
In addition to functional tests.

Also, make some corrections to scenario tests code to make it work
with shares located on localhost.

Co-Authored-By: Alexey Ovchinnikov <aovchinnikov@mirantis.com>
Co-Authored-By: Valeriy Ponomaryov <vponomaryov@mirantis.com>
Change-Id: Ice61a7593f5e4e443cffbe78ecd71d683a9c274e
2016-12-13 12:53:03 +00:00
Victoria Martinez de la Cruz
4d36064cba Decouple Manila UI from Manila Devstack plugin
Whereas the bug report associated to this fix is about
Manila UI not working, this fix addresses more than this.

On the first place, it decouples Manila UI from Manila Devstack
plugin. This is a desired change since not every Manila user
needs to work with the UI, and it doesn't make sense to have
Manila UI bits on the Manila code if we can place all Manila UI
related code on the Manila UI repo and, in this case,
Manila UI Devstack plugin. This patch-set removes all the traces
of Manila UI setup from the Manila Devstack plugin.
Manila UI Devstack plugin was added in 457249be7ab3849b3479b96077a411ca37c37a95.

And, secondly, it fixes Manila UI deploy with Devstack. Enabling
manila-ui plugin on Devstack properly sets the UI component for
Manila.

Change-Id: I7a3372371e25c69d3df6d395c703a6412750effd
Closes-Bug: #1570033
2016-12-12 12:43:14 -03:00
Jenkins
ef14ee5905 Merge "[Devstack] Use openstack CLI instead of other clients" 2016-12-02 17:26:46 +00:00
Jenkins
3d135dcbac Merge "[Devstack] Fix DHSS=False setup for Generic driver" 2016-12-02 16:01:16 +00:00
Valeriy Ponomaryov
c549b202d2 [Devstack] Use openstack CLI instead of other clients
Switch manila devstack plugin for usage of only openstack client,
because other CLIs (such as neutron [1]) "are"/"going to be" deprecated
in favor of openstack client.

[1] https://review.openstack.org/#/c/243348/

Change-Id: If06dfc2c79df4628e747ac28d0add8d4a223777c
Closes-Bug: #1644589
2016-12-02 11:42:17 +00:00
Valeriy Ponomaryov
8c5ed29ba6 [Devstack] Fix DHSS=False setup for Generic driver
Recent change to devstack [1] broke our DHSS=False CI job running
generic driver that was depending on ip route from host to
private network. So, to avoid this error use floating ip address
for connection to service Nova VMs from host machine.
Also, fix generation of second export location that should be dedicated
for service needs such as mounting share doing host-assisted
migration.

[1] If45e3fc15c050cfbac11b57c1eaf137dd7ed816f

Change-Id: Ieea992293ae02898741c939da15f0dbb4609d8b0
Closes-Bug: #1644523
Closes-Bug: #1646097
2016-12-02 14:33:56 +03:00
Valeriy Ponomaryov
cb15c82293 [Devstack] Run tempest update in proper time
Recent devstack change [1] changed order of installing things,
where tempest now is installed later than it was. So, run our
tempest updates later too, when tempest is installed.

Closes-Bug: #1646492

[1] I3d98692e69d94756e0034c83a247e05d85177f02

Change-Id: I85ca94455ad0b7882cde70c6ba0091f9f83f39b8
2016-12-01 15:39:48 +02:00