38 Commits

Author SHA1 Message Date
Takashi Kajinami
37f7f27145 Create only required ceph pools
... instead of creating all regardless of the enabled services and
backends.

Change-Id: Ifbb90e5ab70428c651b317fd0fbb5f67a1cd97b8
2023-08-07 10:22:25 +09:00
Zuul
e2ce75e573 Merge "rgw: Enable ssl in Rados GW" 2023-08-01 17:23:19 +00:00
Zuul
596b153838 Merge "Ceph: Enable Keystone integration of RADOS Gateway using profile" 2023-08-01 04:47:20 +00:00
Takashi Kajinami
1717c2aaa2 rgw: Enable ssl in Rados GW
... to improve the test coverage with SSL enabled.

Change-Id: I44d035b19d9aa17086f43dd3895c5dfac877d53e
2023-08-01 02:13:13 +09:00
Takashi Kajinami
51ca2596b5 Test ceph volume backup driver
This enables ceph volume backup driver in scenario 001 so that we can
test deployment of the driver.

Change-Id: Ia07f1be0491bb25a0e5d7b518e9c764a6281474d
2023-07-31 02:30:02 +09:00
Takashi Kajinami
79ab3258b1 Ceph: Enable Keystone integration of RADOS Gateway using profile
Depends-on: https://review.opendev.org/890028
Change-Id: I227fef4acb5c000c6462befa13b9c561585f427c
2023-07-30 21:08:12 +09:00
Takashi Kajinami
85937d4666 Enable manila with cephfs driver
This enables manila with cephfs backend in scenario 004 test.

Depends-on: https://review.opendev.org/884461
Change-Id: I60d6ce301cf714cd918becaf493eb7396ec9631a
2023-05-30 01:14:52 +00:00
Takashi Kajinami
9ab8f9a60f Reduce number of PGs
to avoid warning caused by too many pgs assigned to a single OSD.

The warning is seen in scenario 004 integration job because Rados
Gateway creates additional pools.

Change-Id: Ice01e0ea8313ae9732c0e48003f886fb85ecc9fd
2023-05-30 01:14:44 +00:00
Takashi Kajinami
f51e612495 Ceph: Disable IPv4 when IPv6 should be used
... instead of enabling both of IPv4 and IPv6. This allows us to detect
any configurations relying on IPv4.

Depends-on: https://review.opendev.org/c/openstack/puppet-ceph/+/876750
Change-Id: Ic5e428013d079d7bf4f759cd9af1b52b36b2cfb2
2023-03-08 13:37:04 +09:00
Takashi Kajinami
05e4a203a7 rgw: Fix the wrong option to define frontend address
The previous setting has been using the wrong option and did not limit
the host which rados gw listens to.

Change-Id: I0f51d56df8a73190071dd9e7568fcf3870ec1e8d
2023-03-08 13:36:30 +09:00
Takashi Kajinami
2f1d35f59c Replace legacy facts and use fact hash
... because the latest lint no longer allows usage of legacy facts and
top scope fact.

Change-Id: I25d27829f66c4ee56e2755579dad21530ef09c3a
2023-03-01 13:30:01 +09:00
Alfredo Moralejo
00d2805a44 Switch to Ceph Quincy from Pacific
Change-Id: I1fd10e3a25d26f69ffb386661446d5629af925f3
2022-09-14 17:40:04 +02:00
Takashi Kajinami
568fc9fb66 rgw: Switch to the beast frontend library
civetweb was deprecated since Ceph Pacific in favor of beast which has
been supported since Mimic.

Depends-on: https://review.opendev.org/853852
Change-Id: I278584d4e9be59e2fece94a9d135b54f331a5256
2022-08-21 05:40:05 +00:00
Takashi Kajinami
da12dde248 Remove workaround for old ceph package
This is a partial revert of 0c938590d2bc7e56a04b196ee8cf835786b9a6d4
and removes workaround for old ceph package. Now python3-ceph should
be installed instead of python2-ceph.

Change-Id: Ib139a7df91cadbf9ac77eb8d94791e5865414ba9
2022-01-24 21:05:08 +09:00
Takashi Kajinami
1668df9ec4 Remove usage of custom os_package_type fact
Currently we support usage of distro packages only, and this custom
fact can be simply replaced by the default fact.

Change-Id: I8cad680e0ec96388cf5fa0e34f50b2c4d5969523
2022-01-05 22:44:55 +09:00
Tobias Urdin
81687e2ead Convert all class usage to relative names
In Puppet 3 there was a need to use absolute
names to prevent issues. Since Puppet 4 everything
is absolute by default which makes this not needed.

We need to change this everywhere so that we can
revert the pin in [1] that now prevents us from
using the latest version of the puppet-lint check
puppet-lint-absolute_classname_check that properly
checks that we dont use absolute names.

[1] https://review.opendev.org/#/c/697742/

Change-Id: I78b74fbeb08be7234189e4d266412fb7fb7a73c0
2019-12-08 14:58:12 +01:00
Tobias Urdin
43618db3fe Stop using removed ceph::rgw::keystone params
These will be removed in [1].

[1] https://review.opendev.org/#/c/679020/

Change-Id: I67002be0e180adae76b4ee782bc516556d44c63f
2019-08-28 13:27:43 +02:00
ed4b1af4d1 Handle lvcreate failure by ensuring dep on lvm2
[1] added lvm_create task to create a lvm device
required by ceph-nautilus. lvcreate command fails
some times with below Error:-
/dev/ceph_vg/lv_data: not found: device not cleared

To overcome this let's add a direct dependency on 'lvm2'
package as lvm_create task needs that package, in addition
adds a sleep task of 5 seconds.

[1] https://review.opendev.org/#/c/650281

Change-Id: I61b6c353cb5216265bf31d56a9f40437821b92fc
2019-05-03 18:25:34 +05:30
Alfredo Moralejo
f2b7245520 Replace Ceph Mimic by Nautilus in CentOS
Ceph Nautilus has now a stable release 14.2.0 and it's being packaged
in CentOS Storage SIG. Mimic release was not LTS so let's replace it
by Nautilus where possible.

Since nautilus, the supported store backend is LVM which can use a block
device directly (not loopback) or a LVM logical volume for OSDs.

This patch is creating a LVM structure to create the OSD used to
validate Ceph and switching scenario004 to use nautilus instead of
mimic, so we will keep testing both Luminous and Nautilus, LTS releases.

Depends-On: https://review.opendev.org/#/c/650263/
Change-Id: I81441237a8b7cf651fa6926b2eb3c4ed0d42bb58
2019-04-24 05:02:41 +00:00
0c938590d2 Add support to all Scenarios to work with Fedora and RedHat > 7
Disable SSL as currently there are known issues in services
to work with python3 + SSL on Fedora.

Also fixed following:-
- watcher to work without SSL
- Handle source /etc/bashrc for users don't have .bashrc created
- Install python3-rbd in Fedora and RedHat > 7

Change-Id: I5b67f40ec3c687f5282c65e10b4a1ee1fe5528f3
2019-01-09 20:11:43 +05:30
Tobias Urdin
70cb017808 Change ceph caps to profile rbd
Based on the documentation [1] and this
bug [2] we should set caps for ceph keys
that use RBD to use the profile.

As we can see in the bug [2] setting it to wrong
can have cause very bad issues, this should direct
as a guideline since we will not hit this in CI.

[1] http://docs.ceph.com/docs/luminous/rbd/rbd-openstack/#setup-ceph-client-authentication
[2] https://bugs.launchpad.net/nova/+bug/1773449

Change-Id: I3767645807279afac77c1c367a70af6f0f9f4084
2018-06-26 17:35:02 +02:00
Alfredo Moralejo
df32382900 Switch role name from Member to member
keystone is creating default roles for member since [1]. This
is "member" and it's not configurable so we need to switch it
in p-o-i too to avoid conflicting names errors (keystone is not
case sensitive in object names).

[1] https://review.openstack.org/#/c/572243/

Depends-On: Icd91bd27d0c0f375d2e99e9c018d3971fc49ce18
Change-Id: Id838d69e4ace9b2ea6c2a9cc6f8fd079d2115dd6
2018-06-18 13:14:27 +02:00
Mohammed Naser
005097530a
Add Ceph Luminous support for CentOS 7 CI
Change-Id: Idf3287b13d8a1508ad1dc3fad498a8eb0259ebf4
Depends-On: Ia5db0bcc884d47c918c7da6657aa5b9bfdcdce44
2017-09-27 12:43:16 -04:00
Mohammed Naser
2fa8fb84e1 Add ceph-mgr to Ubuntu Xenial jobs
The Pike release of OpenStack now comes bundled with Ceph 12.x
which requires ceph-mgr in order to run properly.  This patch
installs it.

The ceph-mgr service is not available in 10.x which is what
CentOS ships, we can drop the conditional once CentOS ships
the latest stable Ceph release.

Change-Id: I9b9c63c835770f7632051ac114f8bf6b19e8e210
2017-09-04 22:43:38 +00:00
John Fulton
f9597b482a Pass rbd_default_features to puppet-ceph
The rbd_default_features extra configs parameter was removed from
this module as per I3242cfe0f141fe2bbb951ce2cf7071fd07456db8 so that,
as per I95cafec9160f5c3b1610a0408f2f80d567fcaa89, puppet-ceph could
manage it instead. This change passes the new rbd_default_features
parameter to puppet-ceph with a value of 15, the same value that this
module used to use for performance reasons.

Change-Id: I1810b0e58c47f3827b6396c039eb9a32510a7993
Depends-On: I477640c5db2cc84622da7734fb54cfe7740bd137
2017-01-13 21:10:04 +00:00
John Fulton
d8076c256e Remove rbd_default_features so puppet-ceph can mange it
Remove the client/rbd_default_features resource from this module
so that the puppet-ceph module can manage it instead as per
I477640c5db2cc84622da7734fb54cfe7740bd137. This change was
anticpated as per I95cafec9160f5c3b1610a0408f2f80d567fcaa89.

Change-Id: I3242cfe0f141fe2bbb951ce2cf7071fd07456db8
Related-Bug: 1633552
2017-01-13 17:33:22 +00:00
Keith Schincke
45d254d199 Update scenario004 for updates to puppet-ceph
puppet ceph used hardcoded values in ceph::rgw::keystone::auth
This updates p-o-i scenario004 to provide values to the previously
hardcoded parameters.

Change-Id: Ie9b8113351300ab8ab331f083a47fef7d4735e69
2016-11-28 16:32:57 -05:00
Emilien Macchi
4f9710d9ca Introduce scenario004
Introduce scenario004 that will test Ceph RGW with OpenStack.

Co-Authored-by: Emilien Macchi <emilien@redhat.com>
Co-Authored-by: Keith Schincke <keith.schincke@gmail.com>
Co-Authored-by: Andrew Woodward <awoodward@mirantis.com>

Change-Id: I0dc1ad61a5f7e4f149e368055f045846ce88c21c
2016-11-03 07:02:41 -04:00
Andrew Woodward
7a95d66faf Move rbd_default_features to ensure_resources
We are working to land I477640c5db2cc84622da7734fb54cfe7740bd137
which creates a duplicate declration, we should be able to move from create
to ensure resource to minimize this until it lands.

Related_bug: 1633552

Change-Id: I95cafec9160f5c3b1610a0408f2f80d567fcaa89
2016-10-21 18:31:42 +00:00
Keith Schincke
509a71e493 Update to openstack_integration::ceph to use new ceph parameters
This patch updates openstack_integration::ceph to use the
osd_max_object_name_len and osd_max_object_namespace_len parameters.
This will allow p-o-i jobs to use EXT4 file systems without
adding parameters via ceph_extra_config

Change-Id: Iea0dd5ae7bb1c438a68db0fd2af63bfa398efcd3
Depends-On: Id487d6d656e88dfe29eac80c378058551c92dfd9
2016-09-07 14:40:07 -04:00
Emilien Macchi
c18cb9d7c8 ceph: move osd data to /var/lib/ceph
Using /srv/data caused SElinux alerts:
https://bugzilla.redhat.com/show_bug.cgi?id=1354488

This patch is an attempt to reduce or remove the alerts in our CI and
use /var/lib/ceph directory to store OSD data, like recommended by Ceph
documentation.

Change-Id: I4e6f31838ffb2b9dcde73fc06fbff78cd084b0af
2016-07-13 08:11:04 -04:00
Keith Schincke
3a5e52c2a6 Add ext4 parameters to openstack_integration::ceph
Adding needed osd_journal_size osd_max_object_name[space]_len
configuration parameters to openstack_integration::ceph. This
is needed rebuild puppet_ceph beaker tests

Change-Id: I6715d11a90f1e864a6154733a1d62148c79de02d
2016-06-16 17:33:05 -04:00
Emilien Macchi
cb015ed05b repos/centos: deploy Ceph with SIG and get rid of EPEL
This patch will change the way we deployed Ceph on CentOS nodes.

* Use CentOS SIG by default
https://wiki.centos.org/SpecialInterestGroup/Storage/

* Stop deploying EPEL, which is conflicting with RDO packaging.

All our CI needs should be in RDO and SIG. Let's stop deploying EPEL at
all.

Depends-On: Ic42c19b2b5b4bc499565c69c3053395173c29a8e
Change-Id: I8d435a77c41c38354b20a40ab30dbc595cb6412c
2016-04-13 10:18:22 -04:00
Emilien Macchi
527a56895a scenario001/centos7: deploy Ceph on IPv6
Deploy scenario001 on centos7 by using IPv6 networks.
Keep IPv4 testing on Ubuntu Trusty.

Change-Id: I1fa62d8c20ae64db4163adc02e8b424553593c46
2016-04-07 17:32:04 -04:00
Emilien Macchi
9d25445194 scenario001: deploy Gnocchi with RBD backend
After Glance, Nova, Cinder, now we want to deploy Gnocchi with Ceph
backend instead of file.

Change-Id: I1f8c83da9d3dfcee597cec7643ebc0e09ecea30d
2016-02-23 11:09:34 -05:00
Emilien Macchi
478f8208ad scenario001: deploy Cinder and Nova with RBD backend
This patch enables robust and complete testing of a compute scenario
where RBD is used for Cinder and Nova.

* Allow cinder.pp and nova.pp to configure RBD backend.
* Switch scenario001 to run Cinder and Nova with RBD backend.
* Update README with more documentation about Cinder & Nova backends.
* Configure volume_clear option to 'none' so volumes are quickly
  deleted.
* Enable rbd_default_features to 15 to increase ceph performances.
* Increase compute build_interval in Tempest to 60s, useful for
  Bootfromvolume test where instance deletion can take time with RBD
  backend.

Depends-On: I69a7d40e7d1847be06a843986ace4f0602272fe1
Depends-On: I7302b89da5a995e779ec349ab0c0f519c69a3a98
Depends-On: Ic410cb66e7620b6ca6acbea38360d8dd890000c9

Change-Id: I5c8d9cf2ff8fc361553b3eed73b697ad87170434
2016-02-23 09:09:42 -05:00
Emilien Macchi
8d54ff588e ceph: deploy keys & pools
* Configure Ceph to use 'cephx' authentification method.
* Manage Admin, Mon and Clients keys.
* Manage pools for Glance, Cinder and Nova, used for RBD backend.

Depends-On: Ied38afc03d68f7868b1d1320752a48989fa2d018
Change-Id: I23b1163faf3253daa74c57121cd8e5da4f04cff9
2016-02-17 21:19:49 +00:00
Emilien Macchi
9c942a604e Deploy Ceph on scenario001
Deploy a simple Ceph setup on scenario001 with one mon and one osd.

Change-Id: I816f763c9ac89f62304c955184daf1e5a4406c3c
2016-02-01 13:39:44 +01:00