Unified SDK for OpenStack
Go to file
James E. Blair 75eaaab0b8
Don't wait for task in submit_task
The exception shifting performed by the Task class is meant to
protect the TaskManager run method from encountering any exceptions
done in the course of running a task.  This is especially important
for subclasses of TaskManager which implement alternate run
strategies.  The exception is shifted so that it is raised by the
Task.wait method.  In a multi-thread environment, it is the caller
of the submit_task method which should receive the exception, and
therefore it is submit_task which should call Task.wait.  Currently
it is the _run_task method which calls Task.wait, which means the
TaskManager itself receives the exception.

Change-Id: I3a6e61601164811fdd255ae54470011768c99a7d
2018-08-04 10:29:03 -05:00
devstack Rename python-openstacksdk to openstacksdk in zuul.yaml 2018-03-23 11:05:28 -05:00
doc Merge "Docs: Remove duplicate content in connection page" 2018-07-21 13:23:53 +00:00
examples Add set_provision_state and wait_for_provision_state for baremetal Node 2018-07-17 13:58:43 +02:00
extras Merge "Add ansible functional tests" 2018-05-30 17:09:03 +00:00
openstack Don't wait for task in submit_task 2018-08-04 10:29:03 -05:00
playbooks/devstack Collect tox and testr output in functional tests 2018-02-15 08:53:47 -06:00
releasenotes Merge "python-shade expose MTU setting." 2018-07-31 11:06:09 +00:00
tools Avoid tox_install.sh for constraints support 2017-12-01 08:58:30 +01:00
.coveragerc Fix coverage configuration and execution 2016-03-14 07:34:53 +00:00
.gitignore Merge tox, tests and other support files 2017-10-04 14:51:08 -05:00
.gitreview Update python-openstacksdk references to openstacksdk 2018-03-23 12:31:24 -05:00
.mailmap Merge tox, tests and other support files 2017-10-04 14:51:08 -05:00
.stestr.conf Merge shade and os-client-config into the tree 2017-11-15 09:03:23 -06:00
.zuul.yaml Add a simple baremetal functional job 2018-07-30 20:24:31 +02:00
babel.cfg setting up the initial layout; move the api proposals to api_strawman 2014-01-24 22:58:25 -06:00
bindep.txt pypy is not checked at gate 2018-04-27 08:56:58 -05:00
CONTRIBUTING.rst Fix bugtracker and documentation references 2018-04-25 13:17:02 +02:00
create_yaml.sh Fix the network quota tests 2017-02-19 09:46:52 -07:00
docs-requirements.txt Add requirements.txt file for readthedocs 2015-05-21 08:16:44 -07:00
HACKING.rst Update all test base classes to use base.TestCase 2018-02-16 23:19:41 -06:00
LICENSE setting up the initial layout; move the api proposals to api_strawman 2014-01-24 22:58:25 -06:00
lower-constraints.txt Add method for returning a raw response for an object 2018-07-27 19:49:29 -04:00
MANIFEST.in setting up the initial layout; move the api proposals to api_strawman 2014-01-24 22:58:25 -06:00
post_test_hook.sh Update load_balancer for v2 API 2017-07-18 18:05:29 -07:00
README.rst Add release note link in README 2018-06-29 08:53:59 +00:00
requirements.txt Implement signature generation functionality 2018-07-18 13:18:40 +00:00
setup.cfg Add python 3.6 jobs 2018-05-09 11:53:30 -05:00
setup.py Updated from global requirements 2017-03-02 11:55:11 +00:00
SHADE-MERGE-TODO.rst Update python-openstacksdk references to openstacksdk 2018-03-23 12:31:24 -05:00
test-requirements.txt Updated from global requirements 2018-03-23 01:51:33 +00:00
tox.ini Add a simple baremetal functional job 2018-07-30 20:24:31 +02:00

openstacksdk

openstacksdk is a client library for building applications to work with OpenStack clouds. The project aims to provide a consistent and complete set of interactions with OpenStack's many services, along with complete documentation, examples, and tools.

It also contains an abstraction interface layer. Clouds can do many things, but there are probably only about 10 of them that most people care about with any regularity. If you want to do complicated things, the per-service oriented portions of the SDK are for you. However, if what you want is to be able to write an application that talks to clouds no matter what crazy choices the deployer has made in an attempt to be more hipster than their self-entitled narcissist peers, then the Cloud Abstraction layer is for you.

A Brief History

openstacksdk started its life as three different libraries: shade, os-client-config and python-openstacksdk.

shade started its life as some code inside of OpenStack Infra's nodepool project, and as some code inside of the Ansible OpenStack Modules. Ansible had a bunch of different OpenStack related modules, and there was a ton of duplicated code. Eventually, between refactoring that duplication into an internal library, and adding the logic and features that the OpenStack Infra team had developed to run client applications at scale, it turned out that we'd written nine-tenths of what we'd need to have a standalone library.

Because of its background from nodepool, shade contained abstractions to work around deployment differences and is resource oriented rather than service oriented. This allows a user to think about Security Groups without having to know whether Security Groups are provided by Nova or Neutron on a given cloud. On the other hand, as an interface that provides an abstraction, it deviates from the published OpenStack REST API and adds its own opinions, which may not get in the way of more advanced users with specific needs.

os-client-config was a library for collecting client configuration for using an OpenStack cloud in a consistent and comprehensive manner, which introduced the clouds.yaml file for expressing named cloud configurations.

python-openstacksdk was a library that exposed the OpenStack APIs to developers in a consistent and predictable manner.

After a while it became clear that there was value in both the high-level layer that contains additional business logic and the lower-level SDK that exposes services and their resources faithfully and consistently as Python objects.

Even with both of those layers, it is still beneficial at times to be able to make direct REST calls and to do so with the same properly configured Session from python-requests.

This led to the merge of the three projects.

The original contents of the shade library have been moved into openstack.cloud and os-client-config has been moved in to openstack.config. Future releases of shade will provide a thin compatibility layer that subclasses the objects from openstack.cloud and provides different argument defaults where needed for compatibility. Similarly future releases of os-client-config will provide a compatibility layer shim around openstack.config.

openstack

List servers using objects configured with the clouds.yaml file:

import openstack

# Initialize and turn on debug logging
openstack.enable_logging(debug=True)

# Initialize cloud
conn = openstack.connect(cloud='mordred')

for server in conn.compute.servers():
    print(server.to_dict())

openstack.config

openstack.config will find cloud configuration for as few as 1 clouds and as many as you want to put in a config file. It will read environment variables and config files, and it also contains some vendor specific default values so that you don't have to know extra info to use OpenStack

  • If you have a config file, you will get the clouds listed in it
  • If you have environment variables, you will get a cloud named envvars
  • If you have neither, you will get a cloud named defaults with base defaults

Sometimes an example is nice.

Create a clouds.yaml file:

clouds:
 mordred:
   region_name: Dallas
   auth:
     username: 'mordred'
     password: XXXXXXX
     project_name: 'shade'
     auth_url: 'https://identity.example.com'

Please note: openstack.config will look for a file called clouds.yaml in the following locations:

  • Current Directory
  • ~/.config/openstack
  • /etc/openstack

More information at https://docs.openstack.org/openstacksdk/latest/user/config/configuration.html

openstack.cloud

Create a server using objects configured with the clouds.yaml file:

import openstack.cloud

# Initialize and turn on debug logging
openstack.enable_logging(debug=True)

# Initialize connection
# Cloud configs are read with openstack.config
conn = openstack.connect(cloud='mordred')

# Upload an image to the cloud
image = conn.create_image(
    'ubuntu-trusty', filename='ubuntu-trusty.qcow2', wait=True)

# Find a flavor with at least 512M of RAM
flavor = conn.get_flavor_by_ram(512)

# Boot a server, wait for it to boot, and then do whatever is needed
# to get a public ip for it.
conn.create_server(
    'my-server', image=image, flavor=flavor, wait=True, auto_ip=True)

Links