Commit Graph

785 Commits (0f057aee6e0351bdef68fadf1fc56ac315027c98)
 

Author SHA1 Message Date
Walter A. Boring IV 0f057aee6e Rename nvme to nvmeof
The nvme connector in os-brick is actually for nvme over fabrics, so
to avoid future confusion we have renamed the nvme connector object
to NVMeOF to better reflect it's capability.  This patch keeps the
backwards compatibility of the mapping of the initiator.NVME to
the renamed nvmeof object.

Change-Id: I97b41139f2e67ab42e2aa8075c51ef939b3cde18
4 years ago
Zuul 80da84a09d Merge "Make NFS already mounted message debug level" 4 years ago
Zuul 57caf9fffd Merge "Add pdf documentation build in tox" 4 years ago
Walter A. Boring IV 132a531e17 Add pdf documentation build in tox
This patch adds a tox command -e pdf-docs for building the pdf
documentation for os-brick.

Change-Id: Ib56ef75468bbbd39fcfec869c42ba4377ecbdd2c
4 years ago
Zuul db29f3c6b4 Merge "Fix param in s390x platform" 4 years ago
Zuul dd2cb55788 Merge "encryptors: Deprecate the CryptsetupEncryptor" 4 years ago
Zuul b7c40aa39b Merge "Delete redundant code" 4 years ago
jichenjc 6cb3427437 Fix param in s390x platform
641337bec2 (diff-fc0623f8e70d3f7227e540c84c0546c5L78)

made some changes but it's for x86 only, we need s390x change as well

Change-Id: Ibc804ee7de66b64b6ace0809280551f7f637fd11
4 years ago
Lee Yarwood b3e5aa3761 encryptors: Deprecate the CryptsetupEncryptor
This encryptor and the underlying plain cryptsetup encryption format it
provides is not widely used, inflexible (no key rotation) and as a
result no longer required in os-brick. This change starts the
deprecation process.

Additional changes will be posted to ensure the retype workflow between
this encryptor and the LUKS based encryptors is well tested ahead of any
removal.

Change-Id: Ibb560da269a2f330526af6761fa509c262e3d361
4 years ago
pengyuesheng 99c579c51a Blacklist sphinx 2.1.0 (autodoc bug)
See https://github.com/sphinx-doc/sphinx/issues/6440 for upstream details

Change-Id: Ie1952c7b65542ac493e506c8916da0e1a856e838
4 years ago
Zuul 68faaeb665 Merge "Add generate_connector_list" 4 years ago
Zuul 1768a1f8b5 Merge "Bump the openstackdocstheme extension to 1.20" 4 years ago
Zuul 1c02d525bb Merge "Check path alive before get scsi wwn" 4 years ago
Chris M 81f26f822d Fix bad argument to iscsiadm in iSCSI discovery
Fix a call to _iscsiadm_update() in which a list was being passed as
the target_iqn connection property.  This property is used directly as
an argument to the iscsiadm -T option, so it must be a plain string.

Change-Id: I9c2ff1de1f89fb49dd6c5a90679d5c4238d5476a
Closes-bug: 1838820
4 years ago
pengyuesheng 7465d90254 Bump the openstackdocstheme extension to 1.20
Some options are now automatically configured by the version 1.20:
- project
- html_last_updated_fmt
- latex_engine
- latex_elements
- version
- release.

Change-Id: I2281904c98f574dc5f42f31a12ebf5d1a4bdb48c
4 years ago
yenai acf44b0c51 Delete redundant code
Method _discover_mpath_device isn't overwrited in FibreChannelConnector,
just use it by self._discover_mpath_device.

Change-Id: I3d5a6e0010e56d256da17e4b20be3db0569c6702
4 years ago
Zuul 066ba564cc Merge "Sync Sphinx requirement" 4 years ago
Zuul e0a3b09a4c Merge "iSCSI single path: Don't fail if there's no WWN" 4 years ago
jacky06 6cbe27051c Sync Sphinx requirement
1. Sync sphinx dependency with global requirements. It caps python 2 since
sphinx 2.0 no longer supports Python 2.7.
2. Remove unncessary "=="

Change-Id: I2c87490faba283c4d4bcb3fbe386955a49601945
4 years ago
Lee Yarwood 97b085f448 luks: Explicitly use the luks1 type to ensure LUKS v1 is used
I152fe10ff5a3131950b789d3fd4efa15c554ff09 attempted to ensure LUKS
volumes were formatted using the LUKS v1 header format by using a type
of `luks`. However from cryptsetup 2.1.0 (incorrectly referenced as
2.0.6 in the previous change) this type can actually refer to the newer
LUKS v2 header format in environments where cryptsetup has not complied
with the `--with-default-luks-format=LUKS1` build time configuration
option [1].

This change now explicitly uses the luks1 type when formatting a device
to ensure the correct LUKS v1 header format is used.

[1] https://gitlab.com/cryptsetup/cryptsetup/blob/master/docs/v2.1.0-ReleaseNotes

Closes-Bug: #1834851
Change-Id: I0010e9014c06a3a812d24d9d5ef598425ac5d5d4
4 years ago
Gorka Eguileor 1c07f221f2 iSCSI single path: Don't fail if there's no WWN
This patch relaxes the single-pathed connections and allows them to
complete even when we cannot detect the WWN on the sysfs, just like
multipath connections do.

Closes-Bug: #1834443
Change-Id: Iae5a304329a2b172bc6b7f310623fad18956ae45
4 years ago
Corey Bryant 4ec35ed3b0 Add Python 3 Train unit tests
This is a mechanically generated patch to ensure unit testing is in place
for all of the Tested Runtimes for Train.

See the Train python3-updates goal document for details:
https://governance.openstack.org/tc/goals/train/python3-updates.html

Change-Id: If2aeeb1597146528b94b1cb76e3be6061831a0b1
Story: #2005924
Task: #34200
4 years ago
Sean McGinnis 44a3caba77
Make NFS already mounted message debug level
When a share is already mounted there is currently a message logged at
info level stating this whenever mount is called. Mount is called for
every remote share when collecting stats, so this results in
unactionable and useless messages filling the log file once a minute by
default.

Since nothing needs to be done in this case, and it is not really useful
information to the administrator, this changes that logging to debug
level so it is only seen if enabling the verbosity where an admin would
want to see something like this.

Change-Id: If7dc84c50ca7c9bae878a72b330c6d5ef9a3bab1
Signed-off-by: Sean McGinnis <sean.mcginnis@gmail.com>
4 years ago
zengjia 3b8d5b7886 Check path alive before get scsi wwn
In FC environment, when disconnect volume,
if the first path in the loop is failed,
it will lead get scsi wwn to failure.
So I think we need to add path validity check
before get scsi wwn

Change-Id: I9d3a9dac13dcd585330e7b891c61b2626e5aabec
Closes-Bug: 1831621
4 years ago
Zuul 0afbf125b3 Merge "FC: Ignore some HBAs from map for single WWNN" 4 years ago
Lee Yarwood 9cf135c686 linuxscsi: Stop waiting for multipath devices during extend_volume
Previously linuxscsi.extend_volume would always attempt to wait for
multipath devices to appear regardless of multipath actually being used
by the connector.

This change corrects this by passing down the existing use_multipath
attribute from the iSCSI and FC connectors into linuxscsi.extend_volume.
The same attribute is introduced to the NVMe connector to also allow it
to skip this search for multipath devices.

Change-Id: I29d65ae036957f3a63cba93dd330b14e3361a1b9
Closes-bug: #1832247
4 years ago
Lee Yarwood 94312bd90f luks: Default to LUKS v1 when formatting volumes
cryptsetup 2.0.6 has started to default to LUKS v2 or LUKS2 when
formatting volumes.  However QEMU currently has no support for v2 and
will fail to open the volume when being used to natively decrypt.

For now we should default the original LUKS encryptor to v1 when
formatting volumes, introducing a new LUKS2 encryptor and encryption
constant in a future change.

Closes-bug: 1831994
Change-Id: I152fe10ff5a3131950b789d3fd4efa15c554ff09
4 years ago
Gorka Eguileor 70899a9aa3 FC: Ignore some HBAs from map for single WWNN
Current FC OS-Brick code only checks for single WWNN to exclude some
HBAs from scanning when we don't receive an initiator_target_map from
the backend.

There are storage arrays,like XtremIO, that due to their architecture
and design have all target ports automatically mapped to LUNs and are
returning the initiator_target_map, but some of those ports may not be
connected to our HBAs, so we end up with another case of bug #1765000.

This patch makes sure that we always check if the target implements
single WWNN, not only when we don't receive the initiator_target_map.

With this we decrease the likelihood of ending with unexpected devices
in our system, because now we will ignore unconnected HBAs (even if
reported in the initiator_target_map) if we are working with single WWNN
target.

Related-Bug: #1765000
Closes-Bug: #1828440
Change-Id: I02c208142f5b342f894666831449243863eccbfe
4 years ago
Zuul 8cb5fe3623 Merge "Replace git.openstack.org URLs with opendev.org URLs" 4 years ago
Zuul 0e9e73e586 Merge "Provide setting to ignore lvm descriptor leak warnings" 4 years ago
Sean McGinnis 5dc5a55d33 Provide setting to ignore lvm descriptor leak warnings
For some reason the leaked descriptor warning message coming
from LVM is causing Cinder to fail startup and it appears to be
masking out the vg response in vgs calls.

We typically don't hit this, but due to the nature of Kolla and
I guess going through the different processes via the containers
this gets logged every time vgs is called.  Eric Harney rightly
pointed out that rather than use exception handling and such
that we should use the LVM env variable mechanism we already have
in place in Cinder.

This was added to the LVM local_dev code in the openstack/cinder repo,
but was not also added to os-brick. The long term goal is to have all of
this handling in os-brick, so this replicates the changes from cinder
done in I85612fa49475beea58d30330c8fe8352a2f91123.

Change-Id: I9d5aaad0e6213535afc1ce071f12190cc6aa02d0
Signed-off-by: Sean McGinnis <sean.mcginnis@gmail.com>
4 years ago
Zuul 152e0e16e2 Merge "Ignore pep8 W503/W504" 4 years ago
Eric Harney 80e37a3e61 Ignore pep8 W503/W504
W503 has been reversed in current pep8, so we
shouldn't start enforcing this here.

W504 takes the opposite stance of W503.

Neither of these seem worth enforcing in our
code for now, just punt on a strict rule for
this and aim for readable code.

Change-Id: Id38b2629ea22792bbc7b4dce77fa9e7039be140f
4 years ago
caoyuan 255b5c8c8a Replace git.openstack.org URLs with opendev.org URLs
Change-Id: Ib380ce9533dc54544257418cef6449cf8525219d
4 years ago
OpenDev Sysadmins 2b36eaffca OpenDev Migration Patch
This commit was bulk generated and pushed by the OpenDev sysadmins
as a part of the Git hosting and code review systems migration
detailed in these mailing list posts:

http://lists.openstack.org/pipermail/openstack-discuss/2019-March/003603.html
http://lists.openstack.org/pipermail/openstack-discuss/2019-April/004920.html

Attempts have been made to correct repository namespaces and
hostnames based on simple pattern matching, but it's possible some
were updated incorrectly or missed entirely. Please reach out to us
via the contact information listed at https://opendev.org/ with any
questions you may have.
4 years ago
Walter A. Boring IV f6761989e8 Add generate_connector_list
This patch adds a new tool that generates a list of connectors
that exist in os-brick.

Change-Id: I59c4f9360f13ec3913b9e2b0a9e81d1d517911b7
4 years ago
Sean McGinnis d71c267b9d
Fix invalid escape sequence warnings
Starting with py36, DeprecationWarnings are raised for special
characters in strings that are not being used as valid escape sequences.
This addresses a couple instances we had for string replacement by
changing the replacement strings to be raw strings.

Change-Id: I93291e978aacaf3f639f32174605528f0038f13a
Signed-off-by: Sean McGinnis <sean.mcginnis@gmail.com>
4 years ago
OpenStack Release Bot 614b2cb1d5 Update master for stable/stein
Add file to the reno documentation build to show release notes for
stable/stein.

Use pbr instruction to increment the minor version number
automatically so that master versions are higher than the versions on
stable/stein.

Change-Id: I54570e4d32416def24d0f73364a3e415085724b3
Sem-Ver: feature
4 years ago
Yury Kulazhenkov 05b6c9f9fa Fix ScaleIO KeyError after upgrade
A long time ago the driver was changed to store volume_id
in the nova database and use that. Previously it would use the
volume_name and make a call to get the volume_id.

Both should be supported, but as the code path currently throws
a KeyError it will never reach the backwards compatible code.
This makes sure that the driver works even after an upgrade from Mitaka.

Depends-On: https://review.openstack.org/#/c/643130/
Change-Id: Iab6a3ca6bf92dc5606c7723dc6c62bf07fa1d934
Closes-Bug: #1648629
4 years ago
Walter A. Boring IV 3cfdf89837 Revert "rename ScaleIO connector to VxFlex OS"
This reverts commit a7f7abc5b8.

The Cinder ScaleIO driver has been rebranded to VxFlexOS, which is fine.
What shouldn't have happened is that the rebranding made it's way
into os-brick, resulting in a new connector protocol and mapping.
The new VxFlexOS driver in cinder should just use the existing
scaleio connector protocol, as it's not customer/user facing, and
ensures backwards and forwards compatibility.

Change-Id: Ia1e119c16091bbf6ff79e0acea8c1a7c656d6dd1
4 years ago
Walter A. Boring IV ba2168d8fe Revert "Fix VxFlexOs KeyError after upgrade"
This reverts commit 6b60614afa.

The Cinder ScaleIO driver has been rebranded to VxFlexOS, which is fine.
What shouldn't have happened is that the rebranding made it's way
into os-brick, resulting in a new connector protocol and mapping.
The new VxFlexOS driver in cinder should just use the existing
scaleio connector protocol, as it's not customer/user facing, and
ensures backwards and forwards compatibility.

Change-Id: Icf7063eb47368cb7b0ffb2e3f5e30903797c7b34
4 years ago
Avishay Traeger 6adbce5ef7 Revert "Verify WWN of connected iSCSI devices if passed"
This reverts commit 14be08d0b5.

Change-Id: I1c99cdff5074180a09c315954c743b2bb0565f53
Related-Bug: #1819577
4 years ago
Zuul a22d316f79 Merge "Fix VxFlexOs KeyError after upgrade" 4 years ago
Zuul 71cc39438f Merge "Remove py35 from setup.cfg" 4 years ago
Tejdeep Kautharam a2b72a967f Remove trailing newline character in UUID
Trailing newline character is present in UUID returned by
_get_system_uuid method. This causes problems when the returned UUID
is not checked for newline. Remove trailing newline before returning
UUID.

Change-Id: Ibe37a14f67ce7452f088d7913a76c6233202ccea
Closes-Bug: #1819062
4 years ago
Erik Olof Gunnar Andersson 6b60614afa Fix VxFlexOs KeyError after upgrade
A long time ago the driver was changed to store volume_id in the
nova database and use that. Previously it would use the volume_name
and make a call to get the volume_id.

Both should be supported, but as the code path currently
throws a KeyError it will never reach the backwardscompatible
code.

This makes sure that the driver works even after an upgrade
from Mitaka.

Change-Id: Ic389e1a8f0f43ef410eee89202fef19d554fce90
Closes-Bug: #1648629
4 years ago
whoami-rajat b6de2cce49 Remove py35 from setup.cfg
This is a followup to Drop py35 jobs from gate and tox env[1].

[1] https://review.openstack.org/#/c/639387/

Change-Id: I9e27e95a4493d9887a7dd8c7d7c7c5b511277f95
4 years ago
Sean McGinnis c88071dc19
Drop py35 jobs
Python 3.5 was the target runtime for the Rocky release. The current
target py3 runtime for Stein is Python 3.6, so there is no reason to
keep testing against the older version.

https://governance.openstack.org/tc/reference/runtimes/stein.html#python-runtime-for-stein

Change-Id: I3a8d2137a1d3158a476a6c23b8a6229b1dfc20f6
Signed-off-by: Sean McGinnis <sean.mcginnis@gmail.com>
4 years ago
Zuul 961e906849 Merge "add python 3.7 unit test job" 4 years ago
Zuul eaff50d9a0 Merge "Fix get keyring content failed when ceph auth disabled" 4 years ago