575 Commits

Author SHA1 Message Date
Sean Dague
e263c82e48 add shebang lines to all lib files
With gerrit 2.8, and the new change screen, this will trigger syntax
highlighting in gerrit. Thus making reviewing code a lot nicer.

Change-Id: Id238748417ffab53e02d59413dba66f61e724383
2014-12-10 11:28:05 -05:00
Julien Danjou
c187b88e69 Add tooz support from Oslo
Change-Id: I4ccf4bf08e10c0ba651f973aa62562af85ea0f19
2014-12-09 15:41:55 +01:00
Kyle Mestery
20b839fd51 Update devstack to work with new split neutron services repos
This commit udpates devstack to work with the latest neutron services, which
are now in their own repositories. This will also unblock third party CI for
services testing. This also allows devstack users to run neutron with
services again.

Change-Id: I9cdd51f09edaccf218988240b48ce733d5771a65
2014-12-08 11:06:43 +00:00
Sean Dague
2f8e08b572 remove nova baremetal driver support
This has been deleted from the nova tree, we should purge it from
devstack, as it will not work any more.

Change-Id: I20501fec140998b91c9ddfd84b7b10168624430a
2014-12-05 08:31:16 -05:00
Sean Dague
aecd189f80 add unit tests for GIT* definitions
This adds unit tests for all the GIT* definitions, ensuring that for
libraries we think should be defined, they are. It exposed a bug in
glance_store definitions in the process.

The GITDIR definition for python-openstackclient is moved to stackrc
for testability.

Change-Id: Ibd9ab665f0362a84f4f7e80e80da56a4737f584e
2014-11-20 08:32:26 -05:00
Jenkins
aa29090fe2 Merge "add LIBS_FROM_GIT to docs" 2014-11-19 11:49:35 +00:00
Jenkins
3f054b48d4 Merge "Add oslo.context" 2014-11-18 23:24:03 +00:00
Sean Dague
91b229058c apparently the upstream naming is tempest-lib
tempest_lib was how this was generally referred to, however that meant
that the job naming wasn't specifying the correctly src
library. Change to tempest-lib to actually test these things before
release.

Change-Id: I4c0712156d7ff71ee43747f30ab940e249d12ebc
2014-11-18 07:13:35 -05:00
Sean Dague
07d7e5b1f9 add LIBS_FROM_GIT to docs
Also reformat common configuration variables to have an additional
header level which makes it easy to direct link to specific
configuration vars when directing someone.

Reformat header markup to us a more standard == = - for h1, h2, h3

Change-Id: I10bac5a93529cdfbcde0a05f9ebdbc1799d403cd
2014-11-18 06:44:20 -05:00
Davanum Srinivas
958111e188 Add oslo.context
Treat the new oslo.context library just like the other Oslo
libraries. i.e. make it possible to either test with upstream
released library, or with git versions of oslo.context.

Change-Id: I2dc498324d6c405655a8e2e249465c5b351ca960
2014-11-17 17:35:44 -05:00
Jenkins
b76746333d Merge "move keystonemiddleware to pypi libs" 2014-11-16 14:59:06 +00:00
Jenkins
af05a2d4e7 Merge "support installing django_openstack_auth from pypi" 2014-11-16 14:58:57 +00:00
Jenkins
42fbce5641 Merge "Fix a typo of python-cinderclient GITBRANCH" 2014-11-14 20:10:52 +00:00
Sean Dague
658312ca2f move keystonemiddleware to pypi libs
Make keystonemiddleware install from pypi releases by default

Change-Id: I3dc4b096b4184f4cf00fb0df66b76fcc8f19785b
2014-11-14 11:36:45 -05:00
Sean Dague
3c8973a90a support installing django_openstack_auth from pypi
Part of the libs from pypi conversion, convert django_openstack_auth
to this format.

Change-Id: I97c8ea19d8aed1e0bdd62c06cfadd1d616573d76
2014-11-14 10:40:46 -05:00
Chris Dent
425e8447f1 Fix a typo of python-cinderclient GITBRANCH
A left out N. Causes various failures in shell evaluation.

Change-Id: Icc09998c645ef2b975cb24b56d0f71c60289c188
2014-11-14 11:10:30 +00:00
Sean Dague
ee5ae7b923 further pypi libs conversions
glance_store and saharaclient were missed in the last round, make
them install from released clients in this patch.

Change-Id: I2e0ed2b7fb5994ae6abd92612a67ce5fd82b3f7e
2014-11-13 17:17:45 -05:00
Sean Dague
e08ab104e6 fix python-* lib from git installation
We're using all the magic variables based on python-fooclient, however
all the inline code was using fooclient for variables. So we had a
mismatch, which was kindly pointed out by some of the 3rd party ci
testers.

Change-Id: I27a56222c7e8e610fba8bf97672d2a42f5cf14ca
2014-11-13 17:17:38 -05:00
Sean Dague
5cb190697c support installing clients at released versions
expand the devstack support for libraries from released versions to
support python-* clients and tempest_lib.

Depends-On: I81b0d228e7769758c61e5b0323ecfce8c8886d39

Change-Id: I26fac0ccf8fd4818e24618d56bf04b32306f88f6
2014-11-04 10:18:58 +01:00
Jenkins
483940350e Merge "allow for soft updating of global-requirements" 2014-10-29 19:08:03 +00:00
Nikhil Manchanda
3ec8a90327 Use updated trove mysql image location
Use the updated trove mysql image at:
tarballs.openstack.org/trove/images/ubuntu/mysql.qcow2
instead of the older deprecated image at:
tarballs.openstack.org/trove/images/ubuntu_mysql.qcow2/ubuntu_mysql.qcow2

Change-Id: If76f25dfe0f975faf1883f0a6d993c21b26e1b29
2014-10-28 00:47:08 -07:00
Sean Dague
def1534ce0 allow for soft updating of global-requirements
This creates a devstack REQUIREMENTS_MODE which is how we handle
syncing of global requirements. The default is 'strict', which is
current behavior. There is a new 'soft' mode which does a
--soft-update for projects *not* found in projects.txt, which lets
them specify additional requirements.

Change-Id: I4aa606514131b5dde67d87f5c8db5a3f3e50fc03
Depends-On: I1f195ef9ff1509659848e14ec9936ff6f66a6496
2014-10-27 12:26:04 -04:00
Joe Gordon
cac1317676 Move to download.fedoraproject.org
download.fedoraproject.org is the mirror system, while
dl.fedoraproject.org is just one system. We have seen performance issues
with dl.fedoraproject.org and using download.fedoraproject.org was a
recommended as a solution by the folks at #fedora-admin.

Local testing on a rackspace server with dl.fedoraproject.org got about
70K/s while download.fedoraproject.org got over 1M/s

Move over to https as well.

Related-Bug: #1383928
Change-Id: I318d8844cfcfbc42c1e552e443c6b793d20f321f
2014-10-23 11:40:18 -07:00
Jenkins
e5dbec252a Merge "Fix docs build errors" 2014-10-08 22:14:51 +00:00
Jenkins
bb67896cd9 Merge "Relocate SERVICE_TIMEOUT to stackrc" 2014-10-04 20:52:21 +00:00
Jenkins
048da844db Merge "Source functions from stackrc" 2014-10-04 19:57:36 +00:00
Adam Gandelman
0e4cd03828 Source functions from stackrc
stackrc now requires GITREPO, GITBRANCH, GITDIR and has been
dependent on functions for a while (is_package_installed).  Ensure
we source the required functions file when stackrc is loaded.  Avoids
unexpected issues in grenade where they may or may not have been loaded
depending on the configuration.

Closes-bug: #1377274

Change-Id: I5027cfad07af0de7ff39f424601d6f7ec5dcadae
2014-10-03 13:29:46 -07:00
Sean Dague
24516d04fb restructure stackrc into groupings
in order to support installing from stable libraries we first need to
actually sort out all the categories our giant list of git repos fit
into. This will make it much easier to not lose one in the process.

Change-Id: I708c65428fdc7442e1661037f425e466048166d3
2014-10-03 08:04:00 -04:00
Sean Dague
b7cda38937 fix olso != oslo typos
Apparently oslo is the hardest word in the world for me to understand
that I didn't spell correctly.

Change-Id: Id1b52529001319eaf41321118ab560711c752003
2014-10-03 08:04:00 -04:00
Jenkins
5e02da7c84 Merge "use released library versions by default" 2014-10-03 01:38:36 +00:00
Dean Troyer
3324f19f5a Fix docs build errors
Fix shocco errors during docs generation

Closes-Bug: 1362691
Change-Id: I2b7fb008c89f0b4e7280b2d0a054320765e83e47
2014-10-02 15:30:50 -05:00
Sean Dague
cc52406a78 use released library versions by default
This patch provides a new path for installing libraries in devstack so
that it's possible to either test with upstream released libraries, or
with git versions of individual libraries.

Libraries are added by name to 3 associative arrays GITREPO,
GITBRANCH, GITDIR. When we get to the library install phase we inspect
LIBS_FROM_GIT and look for libraries by name (i.e. "oslo.config") and
if they exist we'll clone and install those libraries from
git. Otherwise we won't, and just let pip pull them as dependencies
when it needs them.

This patch provides the conversion of the oslo libraries, including
pbr.

Devstack-gate jobs for these libraries will need to change to support
actually forward testing their content.

Change-Id: I6161fa3194dbe8fbc25b6ee0e2fe3cc722a1cea4
2014-10-01 16:20:22 -04:00
Monty Taylor
50495b0163 Install dib from pip
diskimage-builder makes releases to PyPI and is not part of the
integrated release. Since it's not, we don't need to consume its
master branch - rather, we can consume its releases.

Change-Id: If9297a28604612140c39dfe44e77107d1372f0bb
2014-09-30 09:54:36 -07:00
John Griffith
44e16e01da Relocate SERVICE_TIMEOUT to stackrc
cinder_driver_cert.sh restarts volume services
and needs the SERVICE_TIMEOUT variable set, but
that was being declared in stack.sh.

Rather than create another duplicate variable in
the cert script, just move the SERVICE_TIMEOUT
variable to stackrc so it can be shared like other
common variables.

Change-Id: I650697df015fed8f400101a13b6165ac39626877
Closes-Bug: 1350221
2014-09-29 15:13:58 -06:00
Jenkins
106b379741 Merge "Set default API_WORKERS" 2014-09-20 03:46:26 +00:00
Dean Troyer
05bd7b803d Set default API_WORKERS
Set the API_WORKERS default to control memory usage. Maximum is nproc / 2 and
minimum is 2.

* Also updates https://review.openstack.org/#/c/117517/ to remove the
  conditional test as API_WORKERS should always be set.
* Update https://review.openstack.org/#/c/109058/ for ceilometer to use API_WORKERS

The following reviews can move forward either as-is or with minor tweaks:
* Keystone: https://review.openstack.org/#/c/121384/ - remove the if check
* Swift: https://review.openstack.org/#/c/121456/ - unabandon, the default
  to 1 is fine, or remove it to match the others.
* Trove: https://review.openstack.org/#/c/121438/ - remove the if check

https://etherpad.openstack.org/p/devstack-workers has the details

Change-Id: Id28d72ebf01c88b7df301edf7d1dd7ec23fcd0d6
2014-09-19 09:06:21 -05:00
Matthew Treinish
3472386273 Install tempest-lib as part of install_tempest
This commit adds support to devstack to install the newly created
tempest-lib project.

Change-Id: Ifcf56639757ec4814dcd31f791931afe61f5a672
2014-09-16 21:52:03 -04:00
Jenkins
d577fdc794 Merge "Allow setting the number of workers to be used." 2014-09-13 07:18:05 +00:00
Bob Ball
2f72050ace Allow setting the number of workers to be used.
Environments with large numbers of CPUs will create a large
number of workers which can have an unnecessarily large
impact on memory usage, particular where you know how many
workers are needed.

Change-Id: Ie4bb075310a61a0873c9e56e4974600dbb4794a1
2014-09-09 15:54:36 +01:00
Flavio Percoco
4f78f8f391 Test against latest glance_store code
Install glance_store from git so we can test Glance against master. This
is useful for both, glance and glance_store gates, to make sure nothing
is broken there.

Change-Id: I6c01165c4384c41f46f2c32d64475703b3178dab
2014-09-09 09:37:42 +02:00
Jenkins
4bd4264960 Merge "Allow devstack to build ironic agent ramdisk" 2014-09-09 03:04:49 +00:00
Jenkins
154b400e3b Merge "Add oslo.log" 2014-09-07 17:05:45 +00:00
Jenkins
1821200bc5 Merge "Add oslo.concurrency and oslo.middleware" 2014-09-07 13:00:02 +00:00
Jim Rollenhagen
f00766b8bb Allow devstack to build ironic agent ramdisk
This provides a way to test Ironic-python-agent code that is
not yet merged.

Change-Id: I85084c383263173a33250592a95a17f46827b347
2014-09-04 16:31:02 -07:00
Davanum Srinivas
13249f8709 Add oslo.log
Install the oslo.log library from source so the gate tests
are run against master.

Change-Id: Id2925ce733773d8189ecc0d24b0384c44fad7b72
2014-09-04 13:17:46 +00:00
Davanum Srinivas
0b9464d406 Add oslo.concurrency and oslo.middleware
Install the oslo.concurrency and oslo.middleware libraries from source so
the gate tests are run against master.

Change-Id: I194fc160127ab8b4b7d0086586d8ba7f92c67076
2014-09-04 13:17:13 +00:00
Doug Hellmann
5cd17f71ca Add oslo.utils and oslo.serialization
Install the oslo.utils and oslo.serialization libraries from source so
the gate tests run against master.

Change-Id: I2cb35c9dfd18588e4caa11134e6a34d83324e136
2014-08-27 09:53:22 -04:00
Ihar Hrachyshka
cf355aa012 Install sqlalchemy-migrate from master if requested
Added possibility to install sqlalchemy-migrate from master instead of
pypi packages.

Change-Id: I8af92cbb03609799442b05db9772e3c82b76725b
2014-08-21 12:28:30 +02:00
Jenkins
89a263bc41 Merge "A service to install diskimage-builder" 2014-08-21 05:46:12 +00:00
Jenkins
8d5a84029f Merge "Install heat-cfntools and heat-templates repos" 2014-08-21 05:43:39 +00:00