Fuel plugin for Mellanox support
You can not select more than 25 topics Topics must start with a letter or number, can include dashes ('-') and can be up to 35 characters long.
OpenDev Sysadmins b73d34ce9d OpenDev Migration Patch 1 month ago
bootstrap/sync Upgrading to Mellanox OFED 3.4-1 GA 2 years ago
deployment_scripts Add support for ConnectX-5 adapters 1 year ago
doc Added "Limitations" section, change version to 3.2.1 in docs 2 years ago
repositories Initial commit 4 years ago
scripts Upgrading to Mellanox OFED 3.4-1 GA 2 years ago
specs Changing plugin version to 8.0 3 years ago
.gitignore Changing plugin version to 8.0 3 years ago
.gitreview OpenDev Migration Patch 1 month ago
.version Changing plugin version to 8.0 3 years ago
LICENSE Initial commit 4 years ago
README.md Fix README.md with ConnectX-4 release changes 2 years ago
build.sh Changing plugin version to 8.0 3 years ago
deployment_tasks.yaml Remove link_astute_file deployment task 2 years ago
environment_config.yaml Enhancing web UI section 2 years ago
metadata.yaml Upgrading to Mellanox OFED 3.4-1 GA 2 years ago
post_install.sh Fixed post install script output message with MAX num vfs parameter 2 years ago
pre_build_hook Add support for ConnectX-5 adapters 1 year ago
requirements-bootstrap.txt Added bootstrap replacement support 4 years ago
uninstall.sh Upgrading to Mellanox OFED 3.4-1 GA 2 years ago

README.md

Mellanox Plugin for Fuel

Mellanox plugin overview

The Mellanox Fuel plugin is a bundle of scripts, packages and metadata that will extend Fuel and add Mellanox features such as SR-IOV for networking and iSER protocol for storage. Fuel can configure Mellanox ConnectX-4 network adapters to accelerate the performance of compute and storage traffic. This implements the following performance enhancements:

  • Compute nodes network enhancements:
    • SR-IOV based networking
    • VXLAN traffic offload
  • Cinder nodes use iSER block storage as the iSCSI transport rather than the default iSCSI over TCP.

These features reduce CPU overhead, boost throughput, reduce latency, and enable network traffic to bypass the software switch layer (e.g. Open vSwitch). Mellanox Plugin integration with Mellanox NEO SDN Controller enables switch VLAN auto provisioning and port configuration for Ethernet and SM PKey auto provisioning for InfiniBand networks, over private VLAN networks.

Developer’s specification

Please refer to: HowTo Install Mellanox OpenStack Plugin for Mirantis Fuel 8.0

Requirements

Requirement Version/Comment
Mirantis OpenStack compatibility 8.0

The Mellanox ConnectX-4 adapters family supports up to 100 Gb/s. To reach 100 Gb/s speed in your network with ConnectX-4 adapters, you must use Mellanox Ethernet / Infiniband switches supporting 100 Gb (e.g. SN2700 (ETH), SB7700 (IB)). The switch ports should be configured specifically to use 100 Gb speed. No additional configuration is required on the adapter side.

Mellanox plugin configuration

For detailed setup configuration of Ethernet or Infiniband networks, please refer to Mellanox plugin configuration section in HowTo Install Mellanox OpenStack Plugin for Mirantis Fuel 8.0

Installation Guide

To install Mellanox plugin, follow these steps:

  1. Install Fuel Master node. For more information on how to create a Fuel Master node, please see Mirantis Fuel 8.0 documentation

  2. Download the plugin rpm file for MOS 8.0 from Fuel Plugin Catalog

  3. Copy the plugin on already installed Fuel Master. scp can be used for that:

     # scp mellanox-plugin-3.2-3.2.0-1.noarch.rpm root@<Fuel_Master_ip>:/tmp
    
  4. Install the plugin:

     # cd /tmp
     # fuel plugins --install mellanox-plugin-3.2-3.2.0-1.noarch.rpm
    
  5. Verify the plugin was installed successfully by having it listed using fuel plugins command:

     # fuel plugins
     #  id | name              | version | package_version
     #  ---|-------------------|---------|----------------
     #  1  | mellanox-plugin   | 3.2.0   | 3.0.0
    
  6. Create new bootstrap image for supporting infiniband networks create_mellanox_vpi_bootstrap can be used Example:

    ``` [root@fuel ~]# create_mellanox_bootstrap --link_type eth --max_num_vfs 31

    Try to build image with data:
    bootstrap:
    certs: null
    container: {format: tar.gz, meta_file: metadata.yaml}
    . . .
    . . .
    . . .
    Bootstrap image f790e9f8-5bc5-4e61-9935-0640f2eed949 has been activated.
    

    [root@fuel ~]# create_mellanox_bootstrap --help

    usage: create_mellanox_bootstrap [-h] [--link_type {eth,ib,current}]

                               [--max_num_vfs MAX_NUM_VFS]
    

    Available link_type values are:


    • eth for changing link type to Ethernet
    • ib for changing link type to Infiniband
    • current for leaving link type as is

    optional arguments: -h, --help show this help message and exit --link_type {eth,ib,current} --max_num_vfs MAX_NUM_VFS

                      an integer for the maximum number of vfs to be
                      burned in bootstrap
    

    ```

  7. In case of using the customized bootstrap image, you must reboot your target nodes with the new bootstrap image you just created. If you already have discovered nodes you can either reboot them manually or use reboot_bootstrap_nodes command. Run reboot_bootstrap_nodes -h for help.

User Guide

Please read the Mellanox Plugin User Guide.

Reporting Bugs

Bugs should be Reported for Fuel Plugin Mellanox.

Contributors