devstack-plugins-ceph does not have the doc infra set
up and no doc publish job.
This is need to add the contributor doc as per the ussuri
community goal.
Change-Id: Ib62c34b52b28b753f7f3046d51492fd8d9fb6193
While the job itself is not currently voting within openstack/nova the
use of the plugin essentially is within the nova-live-migration job.
As such we should really enable voting of this job within this project
with the eventual goal of also enabling it within openstack/nova and
other projects using it.
Change-Id: Id243b92e800e2d6e8b2228fadbd1c72b194bbfb9
devstack-plugin-ceph-tempest is py2 job and not supposed
to run on master gate. devstack-plugin-ceph master gate already
run its py3 version devstack-plugin-ceph-tempest-py3.
We need to keep the devstack-plugin-ceph-tempest definition
for stable branches gate.
Change-Id: I6c512b29a0346db1f92de34b1dbfb56958fa2cad
I5698e451861828a8b1240d046d1610d8d37ca5a2 introduced support for this
test in Stein so enable the compute feature from Stein onwards.
Blueprint: extend-in-use-rbd-volumes
Change-Id: I6b2575b12fdb9636f106b3ca28681e29ad3eb8ac
In change I43de36ab570af40bc837d859568f5428c167f083, we started
installing the 'python3-' variants of the 'python-' packages installed
by the 'ceph-common' package in 'install_ceph_remote'. In that change,
we made the assertion that we didn't need to "both hiding this behind
the 'python3_enabled' function or 'USE_PYTHON3' variable since (a) these
packages can happily coexist, (b) projects should be switching to Python
3 now, and (c) using these would require sourcing additional, otherwise
unnecessary devstack libraries just to use this simple function".
However, this didn't take into account the fact that this plugin is not
versioned. This means *any* job that uses this plugin, including things
like stable/pike, will now attempt to install the 'python3-' packages.
Since the base OS on stable/pike, Xenial (16.04), doesn't actually
provide these 'python3-' variants, the command will always fail.
Start hiding the command behind a 'use_python3' function call. Hopefully
by time we drop Python 2 support here we won't have maintained branches
using Xenial. If we do, we'll need to branch or something like that.
Change-Id: I890a1e673fde212218eff4fcf82f7941b3283e5f
Signed-off-by: Stephen Finucane <stephenfin@redhat.com>
Closes-Bug: #1853280
Previously, this command would simply install the 'ceph-common' package,
which includes a number of Python dependencies. Unfortunately, these
packages are the 'python-' variants [1] and there doesn't appear to be a
'ceph-common-python3' package or similar to install the 'python3-'
variants. As a result, we need to install the 'python3-' variants
manually to ensure consumers of the plugin (like nova) can switch to
Python 3 in their tests.
We don't bother hiding this behind the 'python3_enabled' function or
'USE_PYTHON3' variable since (a) these packages can happily coexist, (b)
projects should be switching to Python 3 now, and (c) using these would
require sourcing additional, otherwise unnecessary devstack libraries
just to use this simple function.
[1] https://packages.ubuntu.com/bionic/ceph-common
Change-Id: I43de36ab570af40bc837d859568f5428c167f083
Signed-off-by: Stephen Finucane <stephenfin@redhat.com>
Cleanup of CephFS data and metadata pools for manila was only
being done for external CephFS installs.
Do it whenever manila is enabled.
Change-Id: Iee238f91b04231d1e41774a49615023fe26e56f3
We should be using "ceph fs set <fs_name> allow_new_snaps true"
instead of using the mds call
Change-Id: I7a709d49ec4c93b2a06e961ca8ca1414cf4c1918
Closes-Bug: #1838790
ceph-create-keys was being used to create keys.
This command has been deprecated and it does nothing.
For this reason, keys were not available when starting
daemons and this made the deployment to fail.
This change adds the correct key creation using ceph-authtool.
Change-Id: Ie1a41f67bbf1c7a58e89168b0c8ad63f101648b4
Co-Authored-By: Giulio Fidente <gfidente@redhat.com>
devstack-plugin-ceph is branchless and its jobs run on
stable branches. To tests the devstack-plugin-ceph changes
for stable branches, let' add the stable version of
devstack-plugin-ceph-tempest-py3 job in experimental pipeline.
Adding in experimental pipeline as we do not really have to run
those all the time on check gate but can be run on demand.
Change-Id: I9010f0d6226304537adcbe4e3f97250c754a7de9
The dependent nova fix resolves the issue with rbd and
shelve/unshelve testing in tempest. Re-enabling the test
needs to be branch-specific since devstack-plugin-ceph
is branch-less but the fixes in nova will be branch
specific so we don't want to enable this on any nova
branch that does not have the fix since it would break
the job on those branches.
Related-Bug: #1653953
Depends-On: https://review.opendev.org/457886/
Co-Authored-By: Matt Riedemann <mriedem.os@gmail.com>
Change-Id: Ifbfc15033020c430a93574f2726b2279c9be130d
This patch adds support for installing, configuring all required
ceph-iscsi related packages and daemons. ceph-iscsi requires kernel
version 4.16 or greater.
To enable set
ENABLE_CEPH_ISCSI=True
Adds new config options
CEPH_ISCSI_TARGET_IQN - the rbd-target-gw iqn to use to export volumes
CEPH_ISCSI_API_HOST - the rbd-target-api ip to use to listen on
CEPH_ISCSI_API_PORT - the rbd-target-api port
CEPH_ISCSI_API_USER - the rbd-target-api user for auth against the api
CEPH_ISCSI_API_PASSWORD - the rbd-target-api password for auth against the api
The following packages are required and their deps
tcmu-runner - this requires kernel version 4.16 and > to work. Ubuntu
doesn't have a prebuilt package for this, so we pull it down and compile it.
rtslib-fb - has a pypi package
configshell-fb - has a pypi package
targetcli-fb - doesn't have a pypi package.
ceph-iscsi - doesn't have a pypi package.
The reference documentaion to setup ceph-iscsi targets and daemons:
http://docs.ceph.com/docs/master/rbd/iscsi-target-cli-manual-install
Change-Id: Idfac4883b9d31e80124b8f2f1cc60dd9ce18c594
The manila CentOS jobs break often, and are not
maintained. Let's move them to experimental
so they don't gate every patch. The other manila
jobs currently provide necessary test coverage
to cephfs-native and cephfs-nfs protocols/drivers.
These jobs also run with python3, and we don't
need to support python3.5 any longer.
Change-Id: Ibb752a1d9aa818dd6862bcbbce4d6b6e366b4800
Devstack and tempest default to enable ssh validation in
a lot of API tests which can fail intermittently:
http://status.openstack.org/elastic-recheck/#1808010
Also see bug 1802971.
Since a ceph backend for storage shouldn't really have
any impact on whether or not ssh is going to work in a
tempest run, this change disables it in the
devstack-plugin-ceph-tempest jobs which should make the
job faster and more stable.
Change-Id: Iea948bcc43315286e5c130485728152d4710bfcb
There is really no point in running the tempest.api.network
tests in the devstack-plugin-ceph-tempest job since a ceph
backend shouldn't make any difference to those tests.
This should speed up the job slightly and more importantly
avoid unnecessarily random failures from tests that don't matter
for this setup.
Change-Id: Icf8d776a648b93b232b83fd4493e00b5f76b3ebf
This is a mechanically generated change to replace openstack.org
git:// URLs with https:// equivalents.
This is in aid of a planned future move of the git hosting
infrastructure to a self-hosted instance of gitea (https://gitea.io),
which does not support the git wire protocol at this stage.
This update should result in no functional change.
For more information see the thread at
http://lists.openstack.org/pipermail/openstack-discuss/2019-March/003825.html
Change-Id: I0ebfde9478ec07f9f8649e239adfccbf6f7431c6
Below patch enabled the multiattach feature in devstack ceph job
without branch variant. Multiattach feature is only available
from stein.
- https://review.openstack.org/#/c/638499/2
This commit makes two variant of job with multiattach enable from
stein onwards only.
Change-Id: Ib0a5667a6125fa5ae430086db93baf5a53be4877
Closes-Bug: #1820098
Tempest change I522a15ba3dbfee5d8ef417e43288a12319abf6ff is
enabling volume multiattach testing in the tempest-full and
tempest-full-py3 job configurations which we inherit for
devstack-plugin-ceph-tempest and devstack-plugin-ceph-tempest-py3
respectively. Since the rbd driver in cinder does not support
multiattach yet we need to disable multiattach testing for these
jobs.
Change-Id: Ia9bd6a42f33a7d9fe3041cf5c751ab691df19cb7
Builds for ubuntu bionic are working now.
We need newer features not yet packaged for ubuntu bionic
for python3 and ceph volume chmod support.
Change-Id: I20fa99c6f6da7d4042b50020ab0e9f34e7ac2de6
Add MANILA_TEMPEST_MIN_API_MICROVERSION and
MANILA_TEMPEST_MAX_API_MICROVERSION to the ci
post_test_hook. These options default to
the values specified in the api_version_request.py
file. On master branch don't set these as we
want to run with the latest.
Related-bug: #1781671
Change-Id: I085ed175dfbe132c80a6a86ab34a281b3c94f5f0
The shaman ceph and ganesha repos for ubuntu bionic are less
stable than those available with the bionic distro itself so
use the latter.
Also refactor the ceph/ganesha repo configuration so that it
is easier to read and maintain, and since bionic does not ship
with knfs installed make the service stop/disable for these
services robust in that case.
Change-Id: If00cc82cfb076c75a11738dcaca372b0cc7a1848