Because nova-powervm follows nova at a development level, we have to install the latest master branch, so we can't put nova in our [test-]requirements.txt. Instead, we put it in our tox.ini testenv deps as a git clone and install. This pulls in nova's requirements.txt, but not its test-requirements.txt. Change  moved nova's wsgi_intercept dependency from requirements.txt to test-requirements.txt; but this didn't cause problems yet because wsgi_intercept wasn't actually being imported in a path that mattered to nova-powervm testing until . This change set explicitly adds nova's test-requirements.txt, pulled from the master branch, to the nova-powervm testenv deps.  I0d8325e12ed7d5d022877782d6aa4ba4055c30db  I03b3abea152d45575ac6dde22ccbe32b6acb4646 Change-Id: I9f4263f22fb73bf694bf0d2f766d1b921c1f2704 Closes-Bug: #1707951
|6 years ago|
|devstack||6 years ago|
|doc||6 years ago|
|nova||6 years ago|
|nova_powervm||6 years ago|
|specs||6 years ago|
|tools||6 years ago|
|.gitignore||7 years ago|
|.gitreview||8 years ago|
|.testr.conf||9 years ago|
|CONTRIBUTING.rst||8 years ago|
|HACKING.rst||7 years ago|
|LICENSE||9 years ago|
|README.rst||6 years ago|
|babel.cfg||8 years ago|
|openstack-common.conf||9 years ago|
|requirements.txt||6 years ago|
|setup.cfg||6 years ago|
|setup.py||6 years ago|
|sonar-project.properties||8 years ago|
|test-requirements.txt||6 years ago|
|tox.ini||6 years ago|
PowerVM Nova Driver
The IBM PowerVM hypervisor provides virtualization on POWER hardware. PowerVM admins can see benefits in their environments by making use of OpenStack. This driver (along with a Neutron ML2 compatible agent and Ceilometer agent) provides the capability for operators of PowerVM to use OpenStack natively.
As ecosystems continue to evolve around the POWER platform, a single OpenStack driver does not meet all of the needs for the various hypervisors. The standard libvirt driver provides support for KVM on POWER systems. This nova driver provides PowerVM support to OpenStack environment.
This driver meets the following:
- Built within the community
- Fits the OpenStack model
- Utilizes automated functional and unit tests
- Enables use of PowerVM systems through the OpenStack APIs
- Allows attachment of volumes from Cinder over supported protocols
This driver makes the following use cases available for PowerVM:
- As a deployer, all of the standard lifecycle operations (start, stop, reboot, migrate, destroy, etc.) should be supported on a PowerVM based instance.
- As a deployer, I should be able to capture an instance to an image.
- VNC console to instances deployed.
To use the driver, install the nova-powervm project on your NovaLink-based PowerVM system. The nova-powervm project has a minimal set of configuration. See the configuration options section of the dev-ref for more information.
It is recommended that operators also make use of the networking-powervm project. The project ensures that the network bridge supports the VLAN-based networks required for the workloads.
There is also a ceilometer-powervm project that can be included.
Future work will be done to include PowerVM into the various OpenStack deployment models.
Overview of Architecture
The driver enables the following:
- Provide deployments that work with the OpenStack model.
- Driver is implemented using a new version of the PowerVM REST API.
- Ephemeral disks are supported either with Virtual I/O Server (VIOS) hosted local disks or via Shared Storage Pools (a PowerVM cluster file system).
- Volume support is provided via Cinder through supported protocols for the Hypervisor (virtual SCSI and N-Port ID Virtualization).
- Live migration support is available when using Shared Storage Pools or boot from volume.
- Network integration is supported via the ML2 compatible Neutron Agent. This is the openstack/networking-powervm project.
- Automated Functional Testing is provided to validate changes from the broader OpenStack community against the PowerVM driver.
- Thorough unit, syntax, and style testing is provided and enforced for the driver.
The intention is that this driver follows the OpenStack Nova model.
The driver is being promoted into the nova core project in stages, the first of which is represented by blueprint powervm-nova-compute-driver. The coexistence of these two incarnations of the driver raises some Dual Driver Considerations.
Data Model Impact
- The evacuate API is supported as part of the PowerVM driver. It optionally allows for the NVRAM data to be stored to a Swift database. However this does not impact the data model itself. It simply provides a location to optionally store the VM's NVRAM metadata in the event of a rebuild, evacuate, shelve, migration or resize.
REST API Impact
No REST API impacts.
No known security impacts.
No new notifications. The driver does expect that the Neutron agent will return an event when the VIF plug has occurred, assuming that Neutron is the network service.
Other End User Impact
The administrator may notice new logging messages in the nova compute logs.
The driver has a similar deployment speed and agility to other hypervisors. It has been tested with up to 10 concurrent deploys with several hundred VMs on a given server.
Most operations are comparable in speed. Deployment, attach/detach volumes, lifecycle, etc... are quick.
Due to the nature of the project, any performance impacts are limited to the Compute Driver. The API processes for instance are not impacted.
Other Deployer Impact
The cloud administrator will need to refer to documentation on how to configure OpenStack for use with a PowerVM hypervisor.
A 'powervm' configuration group is used to contain all the PowerVM specific configuration settings. Existing configuration file attributes will be reused as much as possible (e.g. vif_plugging_timeout). This reduces the number of PowerVM specific items that will be needed.
It is the goal of the project to only require minimal additional attributes. The deployer may specify additional attributes to fit their configuration.
The code for this driver is currently contained within a powervm project. The driver is within the /nova/virt/powervm_ext/ package and extends the nova.virt.driver.ComputeDriver class.
The code interacts with PowerVM through the pypowervm library. This python binding is a wrapper to the PowerVM REST API. All hypervisor operations interact with the PowerVM REST API via this binding. The driver is maintained to support future revisions of the PowerVM REST API as needed.
For ephemeral disk support, either a Virtual I/O Server hosted local disk or a Shared Storage Pool (a PowerVM clustered file system) is supported. For volume attachments, the driver supports Cinder-based attachments via protocols supported by the hypervisor (e.g. Fibre Channel).
For networking, the networking-powervm project provides Neutron ML2 Agents. The agents provide the necessary configuration on the Virtual I/O Server for networking. The PowerVM Nova driver code creates the VIF for the client VM, but the Neutron agent creates the VIF for VLANs.
Automated functional testing is provided through a third party continuous integration system. It monitors for incoming Nova change sets, runs a set of functional tests (lifecycle operations) against the incoming change, and provides a non-gating vote (+1 or -1).
Developers should not be impacted by these changes unless they wish to try the driver.
The intent of this project is to bring another driver to OpenStack that aligns with the ideals and vision of the community. The intention is to promote this to core Nova.
No alternatives appear viable to bring PowerVM support into the OpenStack community.
- Primary assignees:
adreznec efried kyleh thorst
- Other contributors:
- Utilizes the PowerVM REST API specification for management. Will utilize future versions of this specification as it becomes available: http://ibm.co/1lThV9R
- Builds on top of the pypowervm library. This is a prerequisite to utilizing the driver.
Prior to Ocata, only the out-of-tree nova_powervm driver existed. The in-tree driver is introduced in Ocata.
In Liberty and Mitaka, the namespace of the out-of-tree driver is
nova_powervm.virt.powervm. In Newton, it was moved to
nova.virt.powervm. In Ocata, the new in-tree driver occupies the
nova.virt.powervm namespace, and the out-of-tree driver is moved to
nova.virt.powervm_ext. Ocata consumers have the option of using the in-tree driver, which will provide limited functionality until it is fully integrated; or the out-of-tree driver, which provides full functionality. Refer to the documentation for the
nova.conf settings required to load the desired driver.
Live Migrate Data Object
In order to use live migration prior to Ocata, it was necessary to run the customized nova_powervm conductor to bring in the
PowerVMLiveMigrateData object. In Ocata, this object is included in core nova, so no custom conductor is necessary.
Since the tempest tests should be implementation agnostic, the existing tempest tests should be able to run against the PowerVM driver without issue.
Tempest tests that require function that the platform does not yet support (e.g. iSCSI or Floating IPs) will not pass. These should be ommitted from the Tempest test suite.
A sample Tempest test configuration for the PowerVM driver has been provided.
Thorough unit tests exist within the project to validate specific functions within this implementation.
A third party functional test environment has been created. It monitors for incoming nova change sets. Once it detects a new change set, it will execute the existing lifecycle API tests. A non-gating vote (+1 or -1) will be provided with information provided (logs) based on the result.
Existing APIs should be valid. All testing is planned within the functional testing system and via unit tests.
See the dev-ref for documentation on how to configure, contribute, use, etc. this driver implementation.
The existing Nova developer documentation should typically suffice. However, until merge into Nova, we will maintain a subset of dev-ref documentation.
- PowerVM REST API Specification (may require newer versions as they become available): http://ibm.co/1lThV9R
- PowerVM Virtualization Introduction and Configuration: http://www.redbooks.ibm.com/abstracts/sg247940.html
- PowerVM Best Practices: http://www.redbooks.ibm.com/abstracts/sg248062.html