b7c8b5e746
The "Default configuration files vary by distribution." note is duplicated in a lot of files. This patch moves this note into a separate file and includes this file in all files using this note. Change-Id: Ie61e378a217539259180f2e56282b137dd8aa30a
262 lines
7.4 KiB
ReStructuredText
262 lines
7.4 KiB
ReStructuredText
=======================================
|
|
Install and configure the storage nodes
|
|
=======================================
|
|
|
|
This section describes how to install and configure storage nodes
|
|
that operate the account, container, and object services. For
|
|
simplicity, this configuration references two storage nodes, each
|
|
containing two empty local block storage devices. Each of the
|
|
devices, :file:`/dev/sdb` and :file:`/dev/sdc`, must contain a
|
|
suitable partition table with one partition occupying the entire
|
|
device. Although the Object Storage service supports any file system
|
|
with :term:`extended attributes (xattr)`, testing and benchmarking
|
|
indicate the best performance and reliability on :term:`XFS`. For
|
|
more information on horizontally scaling your environment, see the
|
|
`Deployment Guide <http://docs.openstack.org/developer/swift/deployment_guide.html>`_.
|
|
|
|
To configure prerequisites
|
|
~~~~~~~~~~~~~~~~~~~~~~~~~~
|
|
|
|
You must configure each storage node before you install and configure
|
|
the Object Storage service on it. Similar to the controller node, each
|
|
storage node contains one network interface on the :term:`management network`.
|
|
Optionally, each storage node can contain a second network interface on
|
|
a separate network for replication. For more information, see
|
|
:ref:`environment`.
|
|
|
|
#. Configure unique items on the first storage node:
|
|
|
|
Configure the management interface:
|
|
|
|
* IP address: ``10.0.0.51``
|
|
* Network mask: ``255.255.255.0`` (or ``/24``)
|
|
* Default gateway: ``10.0.0.1``
|
|
|
|
Set the hostname of the node to ``object1``.
|
|
|
|
#. Configure unique items on the second storage node:
|
|
|
|
Configure the management interface:
|
|
|
|
* IP address: ``10.0.0.52``
|
|
* Network mask: ``255.255.255.0`` (or ``/24``)
|
|
* Default gateway: ``10.0.0.1``
|
|
|
|
Set the hostname of the node to ``object2``.
|
|
|
|
#. Configure shared items on both storage nodes:
|
|
|
|
* Copy the contents of the :file:`/etc/hosts` file from the controller
|
|
node and add the following to it:
|
|
|
|
.. code-block:: ini
|
|
:linenos:
|
|
|
|
# object1
|
|
10.0.0.51 object1
|
|
|
|
# object2
|
|
10.0.0.52 object2
|
|
|
|
Also add this content to the :file:`/etc/hosts` file on all other
|
|
nodes in your environment.
|
|
|
|
* Install and configure :term:`NTP` using the instructions in
|
|
:ref:`environment-ntp`.
|
|
|
|
* Install the supporting utility packages:
|
|
|
|
.. only:: ubuntu or debian
|
|
|
|
.. code-block:: console
|
|
|
|
# apt-get install xfsprogs rsync
|
|
|
|
.. only:: rdo
|
|
|
|
.. code-block:: console
|
|
|
|
# yum install xfsprogs rsync
|
|
|
|
.. only:: obs
|
|
|
|
.. code-block:: console
|
|
|
|
# zypper install xfsprogs rsync
|
|
|
|
* Format the :file:`/dev/sdb1` and :file:`/dev/sdc1` partitions as XFS:
|
|
|
|
.. code-block:: console
|
|
|
|
# mkfs.xfs /dev/sdb1
|
|
# mkfs.xfs /dev/sdc1
|
|
|
|
* Create the mount point directory structure:
|
|
|
|
.. code-block:: console
|
|
|
|
# mkdir -p /srv/node/sdb1
|
|
# mkdir -p /srv/node/sdc1
|
|
|
|
* Edit the :file:`/etc/fstab` file and add the following to it:
|
|
|
|
.. code-block:: ini
|
|
:linenos:
|
|
|
|
/dev/sdb1 /srv/node/sdb1 xfs noatime,nodiratime,nobarrier,logbufs=8 0 2
|
|
/dev/sdc1 /srv/node/sdc1 xfs noatime,nodiratime,nobarrier,logbufs=8 0 2
|
|
|
|
* Mount the devices:
|
|
|
|
.. code-block:: console
|
|
|
|
# mount /srv/node/sdb1
|
|
# mount /srv/node/sdc1
|
|
|
|
#. Edit the :file:`/etc/rsyncd.conf` file and add the following to it:
|
|
|
|
.. code-block:: ini
|
|
:linenos:
|
|
|
|
uid = swift
|
|
gid = swift
|
|
log file = /var/log/rsyncd.log
|
|
pid file = /var/run/rsyncd.pid
|
|
address = MANAGEMENT_INTERFACE_IP_ADDRESS
|
|
|
|
[account]
|
|
max connections = 2
|
|
path = /srv/node/
|
|
read only = false
|
|
lock file = /var/lock/account.lock
|
|
|
|
[container]
|
|
max connections = 2
|
|
path = /srv/node/
|
|
read only = false
|
|
lock file = /var/lock/container.lock
|
|
|
|
[object]
|
|
max connections = 2
|
|
path = /srv/node/
|
|
read only = false
|
|
lock file = /var/lock/object.lock
|
|
|
|
Replace ``MANAGEMENT_INTERFACE_IP_ADDRESS`` with the IP address of the
|
|
management network on the storage node.
|
|
|
|
.. note::
|
|
|
|
The ``rsync`` service requires no authentication, so consider running
|
|
it on a private network.
|
|
|
|
.. only:: ubuntu or debian
|
|
|
|
5. Edit the :file:`/etc/default/rsync` file and enable the ``rsync``
|
|
service:
|
|
|
|
.. code-block:: ini
|
|
:linenos:
|
|
|
|
RSYNC_ENABLE=true
|
|
|
|
6. Start the ``rsync`` service:
|
|
|
|
.. code-block:: console
|
|
|
|
# service rsync start
|
|
|
|
.. only:: obs or rdo
|
|
|
|
5. Start the ``rsyncd`` service and configure it to start when the
|
|
system boots:
|
|
|
|
.. code-block:: console
|
|
|
|
# systemctl enable rsyncd.service
|
|
# systemctl start rsyncd.service
|
|
|
|
Install and configure storage node components
|
|
~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~
|
|
|
|
.. include:: shared/note_configuration_vary_by_distribution.rst
|
|
|
|
.. note::
|
|
|
|
Perform these steps on each storage node.
|
|
|
|
#. Install the packages:
|
|
|
|
.. only:: ubuntu or debian
|
|
|
|
.. code-block:: console
|
|
|
|
# apt-get install swift swift-account swift-container swift-object
|
|
|
|
.. only:: rdo
|
|
|
|
.. code-block:: console
|
|
|
|
# yum install openstack-swift-account openstack-swift-container \
|
|
openstack-swift-object
|
|
|
|
.. only:: obs
|
|
|
|
.. code-block:: console
|
|
|
|
# zypper install openstack-swift-account \
|
|
openstack-swift-container openstack-swift-object python-xml
|
|
|
|
.. only:: ubuntu or rdo or debian
|
|
|
|
2. Obtain the accounting, container, object, container-reconciler, and
|
|
object-expirer service configuration files from the Object Storage
|
|
source repository:
|
|
|
|
.. code-block:: console
|
|
|
|
# curl -o /etc/swift/account-server.conf \
|
|
https://git.openstack.org/cgit/openstack/swift/plain/etc/account-server.conf-sample?h=stable/kilo
|
|
# curl -o /etc/swift/container-server.conf \
|
|
https://git.openstack.org/cgit/openstack/swift/plain/etc/container-server.conf-sample?h=stable/kilo
|
|
# curl -o /etc/swift/object-server.conf \
|
|
https://git.openstack.org/cgit/openstack/swift/plain/etc/object-server.conf-sample?h=stable/kilo
|
|
# curl -o /etc/swift/container-reconciler.conf \
|
|
https://git.openstack.org/cgit/openstack/swift/plain/etc/container-reconciler.conf-sample?h=stable/kilo
|
|
# curl -o /etc/swift/object-expirer.conf \
|
|
https://git.openstack.org/cgit/openstack/swift/plain/etc/object-expirer.conf-sample?h=stable/kilo
|
|
|
|
3. .. include:: swift-storage-node-include1.txt
|
|
4. .. include:: swift-storage-node-include2.txt
|
|
5. .. include:: swift-storage-node-include3.txt
|
|
6. Ensure proper ownership of the mount point directory structure:
|
|
|
|
.. code-block:: console
|
|
|
|
# chown -R swift:swift /srv/node
|
|
|
|
7. Create the :file:`recon` directory and ensure proper ownership of it:
|
|
|
|
.. code-block:: console
|
|
|
|
# mkdir -p /var/cache/swift
|
|
# chown -R swift:swift /var/cache/swift
|
|
|
|
.. only:: obs
|
|
|
|
2. .. include:: swift-storage-node-include1.txt
|
|
3. .. include:: swift-storage-node-include2.txt
|
|
4. .. include:: swift-storage-node-include3.txt
|
|
5. Ensure proper ownership of the mount point directory structure:
|
|
|
|
.. code-block:: console
|
|
|
|
# chown -R swift:swift /srv/node
|
|
|
|
6. Create the :file:`recon` directory and ensure proper ownership of it:
|
|
|
|
.. code-block:: console
|
|
|
|
# mkdir -p /var/cache/swift
|
|
# chown -R swift:swift /var/cache/swift
|