104 lines
3.5 KiB
ReStructuredText
104 lines
3.5 KiB
ReStructuredText
=========================================
|
|
Allow Kolla Ceph to deploy bluestore OSDs
|
|
=========================================
|
|
|
|
https://blueprints.launchpad.net/kolla/+spec/kolla-ceph-bluestore
|
|
|
|
Kolla Ceph currently only supports filestore. In Queens release, the version of
|
|
Ceph is Luminous, and the bluestore is the default store type. See [1].
|
|
|
|
This spec suggests to allow Kolla Ceph to deploy bluestore OSDs by default, and
|
|
make the store type configurable.
|
|
|
|
Problem description
|
|
===================
|
|
In Ceph Luminous, the bluestore is the default store type when deploy Ceph. As
|
|
Kolla Ceph currently only supports filestore, so it is not aligned with Ceph
|
|
default behaviour. We should support both filestore and bluestore in Kolla
|
|
Ceph.
|
|
|
|
In Ceph bluestore, there are up to three partitions belong to one Ceph OSD,
|
|
they are used for block, block.wal and block.db. We should support to activate
|
|
the three partitions when deploy Ceph bluestore OSDs if the corresponding
|
|
labels are defined and associated with the physical devices.
|
|
|
|
Use cases
|
|
---------
|
|
1. Deploy Kolla Ceph and enable bluestore as default (the default value of
|
|
the parameter ``ceph_osd_store_type`` is ``bluestore`` in
|
|
``/etc/kolla/globals.yml``)
|
|
2. Deploy Kolla Ceph and enable filestore in the configuration file (change
|
|
the value of the parameter ``ceph_osd_store_type`` to ``filestore`` in
|
|
``/etc/kolla/globals.yml``)
|
|
|
|
Proposed change
|
|
===============
|
|
|
|
Exposing the store type
|
|
-----------------------
|
|
Define new configuration parameter ``ceph_osd_store_type`` in Kolla
|
|
configuration file ``/etc/kolla/globals.yml`` to indicate the store type used
|
|
in Kolla Ceph.
|
|
|
|
Existing Kolla Containers
|
|
-------------------------
|
|
In the existing Ceph-OSD container, the OSD store type will be handled when
|
|
start the Ceph OSD container. If any one label of block, block.wal or
|
|
block.db is defined, activate the Ceph OSD according to the configuration. If
|
|
there is no label associated with block.wal and block.db, then activate Ceph
|
|
OSD in one docker volume.
|
|
|
|
Indicate block, block.wal and block.db belonging to the same Ceph OSD according
|
|
to the partition labels, it keeps the same method used in Kolla Ceph filestore.
|
|
* ``KOLLA_CEPH_OSD_BOOSTRAP_BS_xxx`` is the block volume label of one bluestore
|
|
OSD
|
|
* ``KOLLA_CEPH_OSD_BOOSTRAP_BS_xxx_W`` is the block.wal volume label of one
|
|
bluestore OSD
|
|
* ``KOLLA_CEPH_OSD_BOOSTRAP_BS_xxx_D`` is the block.db volume label of one
|
|
bluestore OSD
|
|
Here, ``xxx`` is the suffix used to indicate the above volumes belong to the
|
|
same Ceph OSD.
|
|
|
|
Security Impact
|
|
---------------
|
|
There is no security impact introduced.
|
|
|
|
Performance Impact
|
|
------------------
|
|
There is no performance imapct introduced.
|
|
|
|
Implementation
|
|
==============
|
|
|
|
Assignee(s)
|
|
-----------
|
|
Tone Zhang (tone_zrt)
|
|
|
|
Milestones
|
|
----------
|
|
Target Milestone for completion: Rocky
|
|
|
|
Work Items
|
|
----------
|
|
1. Expose OSD store type in Kolla configuration file
|
|
2. Check disk partition labels when start Ceph-OSD container if the store
|
|
type is bluestore
|
|
3. Modify the Ceph-OSD starting script to support bluestore
|
|
4. Active block, block.wal and block.db configurable in Ceph bluestore OSD
|
|
|
|
Testing
|
|
=======
|
|
The existing gate checks will be used to ensure Ceph bluestore OSD
|
|
successful deployment.
|
|
|
|
Documentation Impact
|
|
====================
|
|
The reference page ``Ceph in Kolla`` [2] should be updated.
|
|
The page will document how to change the Ceph store type and how to deploy Ceph
|
|
bluestore OSD.
|
|
|
|
References
|
|
==========
|
|
[1] http://docs.ceph.com/docs/master/
|
|
[2] https://docs.openstack.org/kolla-ansible/latest/reference/ceph-guide.html
|