349 Commits

Author SHA1 Message Date
Jenkins
3805b3770c Merge "Allow installing keystoneauth from git" 2015-07-23 14:17:49 +00:00
Jenkins
d523a71514 Merge "XenAPI: Update to a newer Cirros image" 2015-07-12 22:38:58 +00:00
Bob Ball
ee61617203 XenAPI: Update to a newer Cirros image
Update to 0.3.4 as it has support for config drive v2

Change-Id: Id8143f16fb3f0b6ce82c1332e8f695ac739a9e8c
2015-07-10 14:11:59 +01:00
Jenkins
ac3d3f336c Merge "Add IPv6 support to devstack infrastructure" 2015-07-08 12:44:51 +00:00
Jamie Lennox
21a9077d7c Allow installing keystoneauth from git
Keystoneauth is not marked as stable yet however to ensure that the
integration between it, keystoneclient and other services don't break
compatibility we want to test it with tempest.

Unfortunately you can't put -e links in requirements.txt files so add
it to devstack so we can set the test environment. This will also make
it available when keystoneauth is released.

Change-Id: I43ca1df9c6ae2f0ac1a687c9ce1e2ccb97e81652
2015-07-06 23:17:15 +00:00
Jenkins
287fc59b40 Merge "Move USE_CONSTRAINTS normalization back to stackrc" 2015-07-05 07:46:42 +00:00
Brian Haley
180f5eb652 Add IPv6 support to devstack infrastructure
By default, most Openstack services are bound to 0.0.0.0
and service endpoints are registered as IPv4 addresses.
With this change we introduce two new variables to control
this behavior:

SERVICE_IP_VERSION - can either be "4" or "6".

When set to "4" (default if not set) devstack will operate
as today - most services will open listen sockets on 0.0.0.0
and service endpoints will be registered using HOST_IP as the
address.

When set to "6" devstack services will open listen sockets on ::
and service endpoints will be registered using HOST_IPV6 as the
address.

There is no support for "4+6", more work is required for that.

HOST_IPV6 - if SERVICE_IP_VERSION=6 this must be an IPv6
address configured on the system.

Some existing services, like the Openvswitch agent, will continue
to use IPv4 addresses for things like tunnel endpoints.  This is
a current restriction in the code and can be updated at a later
time.  This change is just a first step to supporting IPv6-only
control and data planes in devstack.

This change is also partly based on two previous patches,
https://review.openstack.org/#/c/140519/ and
https://review.openstack.org/#/c/176898/

Change-Id: I5c0b775490ce54ab104fd5e89b20fb700212ae74
Co-Authored-By: Sean Collins <sean@coreitpro.com>
Co-Authored-By: Baodong Li <baoli@cisco.com>
Co-Authored-By: Sridhar Gaddam <sridhar.gaddam@enovance.com>
Co-Authored-By: Adam Kacmarsky <adam.kacmarsky@hp.com>
Co-Authored-By: Jeremy Alvis <jeremy.alvis@hp.com>
2015-07-02 15:16:34 -06:00
Jenkins
fee742ba72 Merge "Move Sahara into in-tree plugin" 2015-07-02 18:39:38 +00:00
Jenkins
17a16f3144 Merge "constraints file support for devstack." 2015-07-02 17:35:53 +00:00
Dean Troyer
0ffdb368a6 Move USE_CONSTRAINTS normalization back to stackrc
stackrc needs to do all of the initialization for situations (Grenade,
unstack.sh, etc) that do not run stack.sh

Change-Id: Ib8c7b923dde817b37f852515dd049fcf970b999a
2015-07-02 09:10:45 -05:00
Robert Collins
635a5ba992 constraints file support for devstack.
Constraints files allow a global view of dependencies for devstack
without the side effect that requirements files have of installing
everything everytime. This is part of the cross project
requirements-management spec.

Change-Id: If089d30146629e6cf817edd634e5c2b80f1366dd
2015-07-02 11:37:22 +12:00
Sergey Lukjanov
3381e09f72 Move Sahara into in-tree plugin
Once the Sahara related code moved to Sahara repo and used, we can
remove Sahara specific code from Devstack.

Partial-Implements: bp sahara-devstack-intree

Change-Id: I34412b5cb2e86944b8555b8fd04b43556eb2bbe6
Depends-on: I2e00b2ebc59dd3be6a0539dea2985f2e801a1bd7
Depends-on: I07c3fede473030e8a110cbf5a08309f890905abf
2015-07-01 16:09:56 +00:00
Davanum Srinivas
77a7d11dfa Add new oslo libraries
Full list for liberty is as follows:
* oslo.service
* oslo.reports
* automaton
* futurist

oslo.cache was already added in the earlier review

Some of the entries are already there, though automaton was
missing in one spot. Made sure all references have all five
libraries.

Change-Id: Iffb720d46058424924469695a3ae1e4f20655f99
2015-06-30 18:43:56 +00:00
Steve Martinelli
531017cf3e Add oslo.cache to devstack
as part of the graduation process, add oslo.cache to lib/oslo
and stackrc.

Change-Id: I2baf0384dd5d71d234a95b7acd0bfe5534f2732c
2015-06-27 15:10:51 +00:00
Sean Dague
7af8a1b9b3 only soft enforce requirements not in projects.txt
We're adding the ability to have devstack plugins, which should be
much more free to require new things not in global requirements. Our
old thinking of locking down all the requirements doesn't really work
in a plugin model.

Instead, if the project is in projects.txt, continue with the old
behavior. If it is not, do a soft update (update all the requirements
we know about, leave the ones we don't). This was previously the SOFT
requirements update mode, but now it will just be the default.

Change-Id: Ic0c6e01a6d7613d712ac9e7e4a378cc3a8ce75e6
2015-06-24 05:55:02 -04:00
Davanum Srinivas
18d1cca6cb Add oslo.service to devstack
Add the ability to switch on oslo.service master using
LIBS_FROM_GIT

Change-Id: I00fe7776aea005b6d4e0a84fce54f33a862b57e3
2015-06-18 06:32:04 -04:00
Joshua Harlow
e3a640d573 Add futurist to lib/oslo and stackrc
Part of blueprint adopt-futurist

Change-Id: I17e27a085c7c509bad6018016e90d0114543b073
2015-06-10 11:57:41 -07:00
Joshua Harlow
96c6b2deb3 Add automaton to lib/oslo and stackrc
Part of blueprint adopt-automaton

Change-Id: I520643b74aced431f7a46b7d7b94616bb2e6bf8e
2015-06-10 11:48:50 -07:00
Ramy Asselin
10e1fd420d Allow override of os-brick library used by cinder
os-brick code was pulled out of cinder and made into its own library
https://review.openstack.org/#/c/155552/

added to requirements:
https://review.openstack.org/#/c/177372/

Integration tests were added
https://review.openstack.org/#/c/188156/

But they still use the version of os-brick from pip.

This change updates devstack to pull in the changes from
os-brick patch sets instead, when configured to do so.

Needed-by: Id2bc10782847861fe4bb5e9e46245654450e38fd

Change-Id: I5359dd37dfe94bd469d5ca35f9fbaeda61b5fac4
2015-06-08 09:54:16 -07:00
Jenkins
d986c59d6b Merge "Honor the flag for Identity v3 API only jobs" 2015-05-28 00:04:47 +00:00
Samuel de Medeiros Queiroz
3fd71d6893 Honor the flag for Identity v3 API only jobs
When the property ENABLE_IDENTITY_V2 is set to
False in the local.conf file, devstack will:

* Disable the v2 API in Keystone paste config;
* Set Tempest to skip Identity v2 tests and use
  v3 auth tokens to run all the other tests;
* Set Horizon to use v3 API and v3 auth tokens;
* Register the Identity endpoint as v3.

Change-Id: I2575a516244b848e5ed461e7f488c59edc41068d
2015-05-27 14:27:30 -03:00
James E. Blair
9e220b9b2b Move trove into in-tree plugin
Once the trove code is copied into the trove repo and it is used
as a devstack-plugin, we can remove trove-specific code from
devstack.

Change-Id: I8f9f1a015edb7ec1033e2eaf0b29ab15d89384ce
Depends-On: I3506dec0e6097f9c2e9267110fdfb768faa23c85
2015-05-14 07:57:23 -07:00
Jenkins
db8898c495 Merge "Update default cirros version" 2015-05-08 18:43:38 +00:00
Jens Rosenboom
9fd75f57fd Update default cirros version
Update the default CIRROS_VERSION to 0.3.4, which has better support
for IPv6 and some other bugfixes.

Co-Authored-By: Scott Moser <smoser@ubuntu.com>
Change-Id: I03ee6e1403680fb6c421225a7cadaf8a82edf702
Depends-On: Iac9f108d947ff4a51f99c6e8ad9d1ac5b32c000a
2015-05-07 16:06:02 +02:00
Yalei Wang
2443c37c1d Add n-cauth into defalut services
n-cauth work with n-novnc to provide the vnc service for VMs.

Change-Id: Ia5c53aaaf7fe4f881d525a31b097b167fdb8e5c8
Closes-Bug: #1447774
2015-04-24 10:58:52 +08:00
Thiago Paiva
73af846ca0 Fixing n-crt removal from stackrc
The commit 279cfe75198c723519f1fb361b2bff3c641c6cef removed the n-crt
service from the default devstack setup. As such, the stack.sh script
begun to thrown the following error when trying to "nova x509-create-cert":

  ERROR (ClientException): The server has either erred or is incapable of
  performing the requested operation. (HTTP 500)

This patches reintroduces the n-crt as a default service.

Change-Id: Id9695a37e1c6df567f2c86baa4475225adcfb0ee
Closes-bug: #1441007
2015-04-14 20:22:03 +00:00
Sushil Kumar
72a3312904 Fixes devstack stackrc
One of the earlier patchset while updating stackrc
missed on adding "+=" while adding multiple services.

Closes-Bug: #1439983
Change-Id: I74f788e15b7da05a93fc8d99c562e51386b65053
2015-04-03 09:33:22 +00:00
Sean Dague
279cfe7519 minimize the default services
This changes the default service list in devstack to minimize what is
running out of the box, so that it's likelihood of working in a 4G vm
is much higher.

This removes heat from the default enabled service list.

It drops the ec2 only needed n-obj and n-crt services.

It drops all the alternative consoles (xvnc, consoleauth). novnc is
fine for libvirt which is the default.

It adds dstat, because that's turned out to be so useful in debugging
things.

Change-Id: I84457260dff6f42a5c6ebcc2c60fb6e01aec9567
2015-04-01 07:33:55 -04:00
Dean Troyer
dc97cb71e8 Mostly docs cleanups
Fix documentation build errors and RST formatting

Change-Id: Id93153400c5b069dd9d772381558c7085f64c207
2015-03-28 14:35:12 -05:00
Jenkins
c392fd3b5f Merge "Add global venv enable/disable knob" 2015-03-26 20:32:31 +00:00
Jenkins
82145dcd51 Merge "Do not download Fedora cloud image for heat" 2015-03-26 03:18:08 +00:00
Sean Dague
eeb7bda510 eliminate TEST_ONLY differentiation
devstack is a development and test environment, but by default we were
only installing the runtime dependencies. We should install all the
testing required packages as well.

Change-Id: I7c95927b9daad15766aac9d1276b10ca62efb24c
2015-03-25 11:55:32 -04:00
Steve Baker
89983b6dfe Do not download Fedora cloud image for heat
Tempest can now do all heat tests with cirros, and heat functional
tests now load a custom test image from tarballs.o.o, so devstack
no longer needs to register the fedora cloud image.

Depends-On: I6041b8d6e7e9422f6e220d7aef0ca38857085e4b
Change-Id: I9b3ea2c157b96dee139a24f0fa6f68f6764a7d67
2015-03-25 00:11:44 +00:00
Dean Troyer
5686dbc45d Add global venv enable/disable knob
Adds USE_VENV to globally enable/disable use of virtual environments.

ADDITIONAL_VENV_PACKAGES is used to manually add packages that do not
appear in requirements.txt or test-requirements.txt to be installed
into each venv.  Database Python bindings are handled this way when
a dataabse service is enabled.

Change-Id: I9cf298b936fd10c95e2ce5f51aab0d49d4b7f37f
2015-03-20 09:48:43 -05:00
Steve Baker
1681995103 Install missing heat agent projects
This change adds the dib-utils repo, and adds git_clone calls for the
required os-*-config projects.

Change-Id: I2641feb0c462d2940f2698515ff62a2ff06c0e70
2015-03-19 09:50:13 +13:00
Jenkins
bf8881e6c2 Merge "Add support for oslo.versionedobjects" 2015-03-06 16:04:59 +00:00
Steve Baker
249e36dec6 Remove lib/dib
diskimage-builder is a utility rather than a service, and is already
installed in devstack via pip when required.

lib/dib was created to allow an image to be created during a devstack
run for the heat functional tests, however this approach is no longer
being taken and there are no other known uses for lib/dib.

This change removes lib/dib and moves the pip mirror building to
lib/heat so that snapshot pip packages of the heat agent projects can
be made available to servers which the heat functional tests boot.

This also removes tripleo-image-elements, which has never
been utilised, and since images won't be created
during heat functional test runs it is no longer required.

Change-Id: Ic77f841437ea23c0645d3a34d9dd6bfd1ee28714
2015-03-06 10:57:52 +13:00
Doug Wiegley
93e682c558 Revert change to remove lbaas from devstack; it breaks grenade.
Change-Id: Ie2adaeb7f27d6d646ca2e6e575fb430b9b74b276
2015-03-03 10:31:30 -07:00
Dan Smith
aca8a7fd99 Add support for oslo.versionedobjects
Change-Id: I01dba39259a3b264d4ec2b21db8429d340751979
2015-03-03 08:50:27 -08:00
Al Miller
b124f4d595 Remove LBaaS support from devstack
Devstack support for LBaaS is being migrated to an external
plugin in the neutron-lbaas repository.  The only LBaaS-
specific code that remains in devstack is a hook to support
existing configs that enable q-lbaas.  In that case, load
the external plugin if necessary.

Change-Id: I592f64407ccf1e722b8d9788917879d0236acf0b
Depends-On: I64a94aeeabe6357b5ea7796e34c9306c55c9ae67
2015-02-27 16:36:51 +00:00
Jenkins
7cffc6c992 Merge "Remove duplicated isset function" 2015-02-25 01:33:31 +00:00
Joshua Harlow
ee9064b762 Add debtcollector to lib/oslo and stackrc
Ensure that the debtcollector library is pulled in
like the other oslo libraries so that devstack can
use it where appropriate.

Also fixes 'test_libs_from_pypi.sh' to not have a huge
single line of libraries; and splits it into multiple
lines so the diffs and code can be easily looked at.

Change-Id: I35ab0ed0e20b6092a41ecb3b6f1aaf0a05f5180e
2015-02-24 12:55:13 -08:00
Attila Fazekas
b8cf38c05d Remove duplicated isset function
stackrc defines the isset function, but this function is already
declared in functions-common.

The stackrc sources the `functions` which sources the `functions-common`.

Change-Id: I0772c42d049833334107c2e6da3700e544ce094f
2015-02-24 13:02:39 +01:00
Jenkins
beeef93013 Merge "mysql: disable query logging by default" 2015-02-23 21:30:19 +00:00
Jenkins
4e17005359 Merge "Add oslo.policy to lib/oslo and stackrc" 2015-02-23 21:28:04 +00:00
Jenkins
37e03c906b Merge "Build wheel cache for venvs" 2015-02-19 17:20:45 +00:00
Steve Martinelli
20b027b79c Add oslo.policy to lib/oslo and stackrc
As per the graduation work items, any new libraries should be
added to lib/oslo and stackrc

partially implements bp graduate-policy

Change-Id: Ief8f28715ecff5a602d6d840d736ea07b5e7ff39
2015-02-18 23:21:20 -05:00
Jenkins
20585f5b23 Merge "Remove no longer used definitions for Ryu" 2015-02-19 01:08:48 +00:00
Daniel P. Berrange
20a3dbdfa1 mysql: disable query logging by default
Having DATABASE_QUERY_LOGGING enabled results in devstack turning
on verbose mysql query logging. This results in a log file
/var/log/mariadb/mariadb-slow.log that grows to 10's of GB in
size in very little time (few weeks if that). Developers never
seem to notice this exists until their host OS runs out of disk
space due to this logfile that is never truncated.

Very few people will ever look at this logged data, so a more
sensible default is False, to make the out of the box setup be
suitable for the majority. Those few people who want to debug
mysql query performance can enable it in local.conf, as will
the devstack gate setup scripts.

Depends-On: I6970d61474528f554134d0aa333cd52b7b20f309
Change-Id: Ia4a366c839ac51623bc1fbee3560dc4d848cce14
2015-02-18 22:17:20 +00:00
Dean Troyer
b1d8e8e274 Build wheel cache for venvs
Building a bunch of virtual envs later is going to be tedious if we do not
pre-cache certain annoying-to-build packages.

* tools/build_wheels.sh: pre-build some wheels for annoying package installs
* list distro package dependencies in files/*/venv
* list packages to pre-build as wheels in files/venv-requirements.txt
* install database Python modules when setting up the database

Change-Id: Idff1ea69a5ca12ba56098e664dbf6924fe6a2e47
2015-02-18 15:13:00 -06:00