Unified SDK for OpenStack
Go to file
Monty Taylor 08e9f6ee67
Fix private_v4 selection related to floating ip matching
The change to look for floating ips first when looking for the public
address exposed a latent bug in the private ip finding
code. When we get the mac address of the floating ip, we then look for
the corresponding fixed ip to return for private_v4. However, we weren't
specifying fixed before, so we were just getting the first one that
matched. That *happened* to be the fixed ip by accident.

Add in ext_tag='fixed' so that we look for the matching MAC from a fixed
interface.

We have to also add a second pass through the loop without the fixed
tag, as old nova network dicts do not have the fixed/floating tag like
that.

Includes a test which shows the breakage.

Story: 2001619
Change-Id: I60562a99f78c0c363f49106c285935448f804084
2018-03-03 08:56:45 -06:00
devstack Merge tox, tests and other support files 2017-10-04 14:51:08 -05:00
doc Rename BaseProxy to Proxy 2018-02-15 08:54:34 -06:00
examples Remove openstack_cloud factory function 2018-01-31 11:26:02 -06:00
extras Remove python-ironicclient 2017-12-10 07:34:21 -06:00
openstack Fix private_v4 selection related to floating ip matching 2018-03-03 08:56:45 -06:00
playbooks/devstack Collect tox and testr output in functional tests 2018-02-15 08:53:47 -06:00
releasenotes Fix private_v4 selection related to floating ip matching 2018-03-03 08:56:45 -06:00
tools Avoid tox_install.sh for constraints support 2017-12-01 08:58:30 +01:00
.coveragerc Fix coverage configuration and execution 2016-03-14 07:34:53 +00:00
.gitignore Merge tox, tests and other support files 2017-10-04 14:51:08 -05:00
.gitreview Update .gitreview for new namespace 2015-10-17 22:37:27 +00:00
.mailmap Merge tox, tests and other support files 2017-10-04 14:51:08 -05:00
.stestr.conf Merge shade and os-client-config into the tree 2017-11-15 09:03:23 -06:00
.zuul.yaml Temporarily disable osc-functional-devstack-tips 2018-03-03 08:56:34 -06:00
babel.cfg setting up the initial layout; move the api proposals to api_strawman 2014-01-24 22:58:25 -06:00
bindep.txt Fix py35 and pypy tox env 2017-11-30 17:56:21 -06:00
CONTRIBUTING.rst Merge shade and os-client-config into the tree 2017-11-15 09:03:23 -06:00
create_yaml.sh Fix the network quota tests 2017-02-19 09:46:52 -07:00
docs-requirements.txt Add requirements.txt file for readthedocs 2015-05-21 08:16:44 -07:00
HACKING.rst Update all test base classes to use base.TestCase 2018-02-16 23:19:41 -06:00
LICENSE setting up the initial layout; move the api proposals to api_strawman 2014-01-24 22:58:25 -06:00
MANIFEST.in setting up the initial layout; move the api proposals to api_strawman 2014-01-24 22:58:25 -06:00
post_test_hook.sh Update load_balancer for v2 API 2017-07-18 18:05:29 -07:00
README.rst Remove openstack_cloud factory function 2018-01-31 11:26:02 -06:00
requirements.txt Updated from global requirements 2018-02-17 10:17:32 +00:00
setup.cfg Merge tox, tests and other support files 2017-10-04 14:51:08 -05:00
setup.py Updated from global requirements 2017-03-02 11:55:11 +00:00
SHADE-MERGE-TODO.rst Merge Connection and OpenStackCloud 2018-01-31 11:25:21 -06:00
test-requirements.txt Updated from global requirements 2018-01-27 18:35:23 +00:00
tox.ini Fix coverage running 2018-02-24 16:50:56 +01:00

openstacksdk

openstacksdk is a client library for for building applications to work with OpenStack clouds. The project aims to provide a consistent and complete set of interactions with OpenStack's many services, along with complete documentation, examples, and tools.

It also contains an abstraction interface layer. Clouds can do many things, but there are probably only about 10 of them that most people care about with any regularity. If you want to do complicated things, the per-service oriented portions of the SDK are for you. However, if what you want is to be able to write an application that talks to clouds no matter what crazy choices the deployer has made in an attempt to be more hipster than their self-entitled narcissist peers, then the Cloud Abstraction layer is for you.

A Brief History

openstacksdk started its life as three different libraries: shade, os-client-config and python-openstacksdk.

shade started its life as some code inside of OpenStack Infra's nodepool project, and as some code inside of the Ansible OpenStack Modules. Ansible had a bunch of different OpenStack related modules, and there was a ton of duplicated code. Eventually, between refactoring that duplication into an internal library, and adding the logic and features that the OpenStack Infra team had developed to run client applications at scale, it turned out that we'd written nine-tenths of what we'd need to have a standalone library.

Because of its background from nodepool, shade contained abstractions to work around deployment differences and is resource oriented rather than service oriented. This allows a user to think about Security Groups without having to know whether Security Groups are provided by Nova or Neutron on a given cloud. On the other hand, as an interface that provides an abstraction, it deviates from the published OpenStack REST API and adds its own opinions, which may not get in the way of more advanced users with specific needs.

os-client-config was a library for collecting client configuration for using an OpenStack cloud in a consistent and comprehensive manner, which introduced the clouds.yaml file for expressing named cloud configurations.

python-openstacksdk was a library that exposed the OpenStack APIs to developers in a consistent and predictable manner.

After a while it became clear that there was value in both the high-level layer that contains additional business logic and the lower-level SDK that exposes services and their resources faithfully and consistently as Python objects.

Even with both of those layers, it is still beneficial at times to be able to make direct REST calls and to do so with the same properly configured Session from python-requests.

This led to the merge of the three projects.

The original contents of the shade library have been moved into openstack.cloud and os-client-config has been moved in to openstack.config. Future releases of shade will provide a thin compatibility layer that subclasses the objects from openstack.cloud and provides different argument defaults where needed for compatibility. Similarly future releases of os-client-config will provide a compatibility layer shim around openstack.config.

openstack

List servers using objects configured with the clouds.yaml file:

import openstack

# Initialize and turn on debug logging
openstack.enable_logging(debug=True)

# Initialize cloud
conn = openstack.connect(cloud='mordred')

for server in conn.compute.servers():
    print(server.to_dict())

openstack.config

openstack.config will find cloud configuration for as few as 1 clouds and as many as you want to put in a config file. It will read environment variables and config files, and it also contains some vendor specific default values so that you don't have to know extra info to use OpenStack

  • If you have a config file, you will get the clouds listed in it
  • If you have environment variables, you will get a cloud named envvars
  • If you have neither, you will get a cloud named defaults with base defaults

Sometimes an example is nice.

Create a clouds.yaml file:

clouds:
 mordred:
   region_name: Dallas
   auth:
     username: 'mordred'
     password: XXXXXXX
     project_name: 'shade'
     auth_url: 'https://identity.example.com'

Please note: openstack.config will look for a file called clouds.yaml in the following locations:

  • Current Directory
  • ~/.config/openstack
  • /etc/openstack

More information at https://developer.openstack.org/sdks/python/openstacksdk/users/config

openstack.cloud

Create a server using objects configured with the clouds.yaml file:

import openstack.cloud

# Initialize and turn on debug logging
openstack.enable_logging(debug=True)

# Initialize connection
# Cloud configs are read with openstack.config
conn = openstack.connect(cloud='mordred')

# Upload an image to the cloud
image = conn.create_image(
    'ubuntu-trusty', filename='ubuntu-trusty.qcow2', wait=True)

# Find a flavor with at least 512M of RAM
flavor = conn.get_flavor_by_ram(512)

# Boot a server, wait for it to boot, and then do whatever is needed
# to get a public ip for it.
conn.create_server(
    'my-server', image=image, flavor=flavor, wait=True, auto_ip=True)

Links