Unified SDK for OpenStack
Go to file
Monty Taylor 983cc997ff Return empty lists for resources if neutron doesn't exist
It's the general design of the cloud layer to return empty resources
rather than throw exceptions when a user tries to fetch a non-existent
resource.

Change-Id: I1c6ce28af767f466f349b51a47abe27c0dcdd3fb
2019-07-09 11:35:58 -04:00
devstack Finish updating links to point to opendev 2019-04-21 12:31:44 +00:00
doc Merge "Allow deeper levels of nesting for pdf builds" 2019-07-05 17:43:31 +00:00
examples Add DNS support 2019-03-02 09:09:56 +01:00
extras Merge "Add ansible functional tests" 2018-05-30 17:09:03 +00:00
openstack Return empty lists for resources if neutron doesn't exist 2019-07-09 11:35:58 -04:00
playbooks/devstack Finish updating links to point to opendev 2019-04-21 12:31:44 +00:00
releasenotes Return empty lists for resources if neutron doesn't exist 2019-07-09 11:35:58 -04:00
tools Fix the conflict of urlparse between python2 and python3 2018-10-31 17:00:42 +08:00
.coveragerc Fix coverage configuration and execution 2016-03-14 07:34:53 +00:00
.gitignore Merge tox, tests and other support files 2017-10-04 14:51:08 -05:00
.gitreview OpenDev Migration Patch 2019-04-19 19:47:46 +00:00
.mailmap Merge tox, tests and other support files 2017-10-04 14:51:08 -05:00
.stestr.conf Merge shade and os-client-config into the tree 2017-11-15 09:03:23 -06:00
.zuul.yaml Replace nodepool func jobs 2019-06-27 10:18:05 -07:00
babel.cfg setting up the initial layout; move the api proposals to api_strawman 2014-01-24 22:58:25 -06:00
bindep.txt pypy is not checked at gate 2018-04-27 08:56:58 -05:00
CONTRIBUTING.rst Finish updating links to point to opendev 2019-04-21 12:31:44 +00:00
create_yaml.sh Fix the network quota tests 2017-02-19 09:46:52 -07:00
docs-requirements.txt Add requirements.txt file for readthedocs 2015-05-21 08:16:44 -07:00
HACKING.rst Fix some typos 2019-03-09 17:25:16 +01:00
LICENSE setting up the initial layout; move the api proposals to api_strawman 2014-01-24 22:58:25 -06:00
lower-constraints.txt Pin to latest os-service-types 2019-06-06 15:57:25 -05:00
MANIFEST.in setting up the initial layout; move the api proposals to api_strawman 2014-01-24 22:58:25 -06:00
post_test_hook.sh Update load_balancer for v2 API 2017-07-18 18:05:29 -07:00
README.rst Finish updating links to point to opendev 2019-04-21 12:31:44 +00:00
requirements.txt Pin to latest os-service-types 2019-06-06 15:57:25 -05:00
setup.cfg Change openstack-dev to openstack-discuss 2018-12-04 17:19:57 +00:00
setup.py Updated from global requirements 2017-03-02 11:55:11 +00:00
SHADE-MERGE-TODO.rst Use discovery instead of config to create proxies 2018-10-06 07:44:29 -05:00
test-requirements.txt Make factory for a CloudRegion from CONF objects 2019-06-04 08:36:23 -05:00
tox.ini Finish updating links to point to opendev 2019-04-21 12:31:44 +00:00

openstacksdk

openstacksdk is a client library for building applications to work with OpenStack clouds. The project aims to provide a consistent and complete set of interactions with OpenStack's many services, along with complete documentation, examples, and tools.

It also contains an abstraction interface layer. Clouds can do many things, but there are probably only about 10 of them that most people care about with any regularity. If you want to do complicated things, the per-service oriented portions of the SDK are for you. However, if what you want is to be able to write an application that talks to clouds no matter what crazy choices the deployer has made in an attempt to be more hipster than their self-entitled narcissist peers, then the Cloud Abstraction layer is for you.

A Brief History

openstacksdk started its life as three different libraries: shade, os-client-config and python-openstacksdk.

shade started its life as some code inside of OpenStack Infra's nodepool project, and as some code inside of the Ansible OpenStack Modules. Ansible had a bunch of different OpenStack related modules, and there was a ton of duplicated code. Eventually, between refactoring that duplication into an internal library, and adding the logic and features that the OpenStack Infra team had developed to run client applications at scale, it turned out that we'd written nine-tenths of what we'd need to have a standalone library.

Because of its background from nodepool, shade contained abstractions to work around deployment differences and is resource oriented rather than service oriented. This allows a user to think about Security Groups without having to know whether Security Groups are provided by Nova or Neutron on a given cloud. On the other hand, as an interface that provides an abstraction, it deviates from the published OpenStack REST API and adds its own opinions, which may not get in the way of more advanced users with specific needs.

os-client-config was a library for collecting client configuration for using an OpenStack cloud in a consistent and comprehensive manner, which introduced the clouds.yaml file for expressing named cloud configurations.

python-openstacksdk was a library that exposed the OpenStack APIs to developers in a consistent and predictable manner.

After a while it became clear that there was value in both the high-level layer that contains additional business logic and the lower-level SDK that exposes services and their resources faithfully and consistently as Python objects.

Even with both of those layers, it is still beneficial at times to be able to make direct REST calls and to do so with the same properly configured Session from python-requests.

This led to the merge of the three projects.

The original contents of the shade library have been moved into openstack.cloud and os-client-config has been moved in to openstack.config. Future releases of shade will provide a thin compatibility layer that subclasses the objects from openstack.cloud and provides different argument defaults where needed for compatibility. Similarly future releases of os-client-config will provide a compatibility layer shim around openstack.config.

openstack

List servers using objects configured with the clouds.yaml file:

import openstack

# Initialize and turn on debug logging
openstack.enable_logging(debug=True)

# Initialize cloud
conn = openstack.connect(cloud='mordred')

for server in conn.compute.servers():
    print(server.to_dict())

openstack.config

openstack.config will find cloud configuration for as few as 1 clouds and as many as you want to put in a config file. It will read environment variables and config files, and it also contains some vendor specific default values so that you don't have to know extra info to use OpenStack

  • If you have a config file, you will get the clouds listed in it
  • If you have environment variables, you will get a cloud named envvars
  • If you have neither, you will get a cloud named defaults with base defaults

Sometimes an example is nice.

Create a clouds.yaml file:

clouds:
 mordred:
   region_name: Dallas
   auth:
     username: 'mordred'
     password: XXXXXXX
     project_name: 'shade'
     auth_url: 'https://identity.example.com'

Please note: openstack.config will look for a file called clouds.yaml in the following locations:

  • Current Directory
  • ~/.config/openstack
  • /etc/openstack

More information at https://docs.openstack.org/openstacksdk/latest/user/config/configuration.html

openstack.cloud

Create a server using objects configured with the clouds.yaml file:

import openstack.cloud

# Initialize and turn on debug logging
openstack.enable_logging(debug=True)

# Initialize connection
# Cloud configs are read with openstack.config
conn = openstack.connect(cloud='mordred')

# Upload an image to the cloud
image = conn.create_image(
    'ubuntu-trusty', filename='ubuntu-trusty.qcow2', wait=True)

# Find a flavor with at least 512M of RAM
flavor = conn.get_flavor_by_ram(512)

# Boot a server, wait for it to boot, and then do whatever is needed
# to get a public ip for it.
conn.create_server(
    'my-server', image=image, flavor=flavor, wait=True, auto_ip=True)

Links