575 Commits

Author SHA1 Message Date
Yalei Wang
2443c37c1d Add n-cauth into defalut services
n-cauth work with n-novnc to provide the vnc service for VMs.

Change-Id: Ia5c53aaaf7fe4f881d525a31b097b167fdb8e5c8
Closes-Bug: #1447774
2015-04-24 10:58:52 +08:00
Thiago Paiva
73af846ca0 Fixing n-crt removal from stackrc
The commit 279cfe75198c723519f1fb361b2bff3c641c6cef removed the n-crt
service from the default devstack setup. As such, the stack.sh script
begun to thrown the following error when trying to "nova x509-create-cert":

  ERROR (ClientException): The server has either erred or is incapable of
  performing the requested operation. (HTTP 500)

This patches reintroduces the n-crt as a default service.

Change-Id: Id9695a37e1c6df567f2c86baa4475225adcfb0ee
Closes-bug: #1441007
2015-04-14 20:22:03 +00:00
Sushil Kumar
72a3312904 Fixes devstack stackrc
One of the earlier patchset while updating stackrc
missed on adding "+=" while adding multiple services.

Closes-Bug: #1439983
Change-Id: I74f788e15b7da05a93fc8d99c562e51386b65053
2015-04-03 09:33:22 +00:00
Sean Dague
279cfe7519 minimize the default services
This changes the default service list in devstack to minimize what is
running out of the box, so that it's likelihood of working in a 4G vm
is much higher.

This removes heat from the default enabled service list.

It drops the ec2 only needed n-obj and n-crt services.

It drops all the alternative consoles (xvnc, consoleauth). novnc is
fine for libvirt which is the default.

It adds dstat, because that's turned out to be so useful in debugging
things.

Change-Id: I84457260dff6f42a5c6ebcc2c60fb6e01aec9567
2015-04-01 07:33:55 -04:00
Dean Troyer
dc97cb71e8 Mostly docs cleanups
Fix documentation build errors and RST formatting

Change-Id: Id93153400c5b069dd9d772381558c7085f64c207
2015-03-28 14:35:12 -05:00
Jenkins
c392fd3b5f Merge "Add global venv enable/disable knob" 2015-03-26 20:32:31 +00:00
Jenkins
82145dcd51 Merge "Do not download Fedora cloud image for heat" 2015-03-26 03:18:08 +00:00
Sean Dague
eeb7bda510 eliminate TEST_ONLY differentiation
devstack is a development and test environment, but by default we were
only installing the runtime dependencies. We should install all the
testing required packages as well.

Change-Id: I7c95927b9daad15766aac9d1276b10ca62efb24c
2015-03-25 11:55:32 -04:00
Steve Baker
89983b6dfe Do not download Fedora cloud image for heat
Tempest can now do all heat tests with cirros, and heat functional
tests now load a custom test image from tarballs.o.o, so devstack
no longer needs to register the fedora cloud image.

Depends-On: I6041b8d6e7e9422f6e220d7aef0ca38857085e4b
Change-Id: I9b3ea2c157b96dee139a24f0fa6f68f6764a7d67
2015-03-25 00:11:44 +00:00
Dean Troyer
5686dbc45d Add global venv enable/disable knob
Adds USE_VENV to globally enable/disable use of virtual environments.

ADDITIONAL_VENV_PACKAGES is used to manually add packages that do not
appear in requirements.txt or test-requirements.txt to be installed
into each venv.  Database Python bindings are handled this way when
a dataabse service is enabled.

Change-Id: I9cf298b936fd10c95e2ce5f51aab0d49d4b7f37f
2015-03-20 09:48:43 -05:00
Steve Baker
1681995103 Install missing heat agent projects
This change adds the dib-utils repo, and adds git_clone calls for the
required os-*-config projects.

Change-Id: I2641feb0c462d2940f2698515ff62a2ff06c0e70
2015-03-19 09:50:13 +13:00
Jenkins
bf8881e6c2 Merge "Add support for oslo.versionedobjects" 2015-03-06 16:04:59 +00:00
Steve Baker
249e36dec6 Remove lib/dib
diskimage-builder is a utility rather than a service, and is already
installed in devstack via pip when required.

lib/dib was created to allow an image to be created during a devstack
run for the heat functional tests, however this approach is no longer
being taken and there are no other known uses for lib/dib.

This change removes lib/dib and moves the pip mirror building to
lib/heat so that snapshot pip packages of the heat agent projects can
be made available to servers which the heat functional tests boot.

This also removes tripleo-image-elements, which has never
been utilised, and since images won't be created
during heat functional test runs it is no longer required.

Change-Id: Ic77f841437ea23c0645d3a34d9dd6bfd1ee28714
2015-03-06 10:57:52 +13:00
Doug Wiegley
93e682c558 Revert change to remove lbaas from devstack; it breaks grenade.
Change-Id: Ie2adaeb7f27d6d646ca2e6e575fb430b9b74b276
2015-03-03 10:31:30 -07:00
Dan Smith
aca8a7fd99 Add support for oslo.versionedobjects
Change-Id: I01dba39259a3b264d4ec2b21db8429d340751979
2015-03-03 08:50:27 -08:00
Al Miller
b124f4d595 Remove LBaaS support from devstack
Devstack support for LBaaS is being migrated to an external
plugin in the neutron-lbaas repository.  The only LBaaS-
specific code that remains in devstack is a hook to support
existing configs that enable q-lbaas.  In that case, load
the external plugin if necessary.

Change-Id: I592f64407ccf1e722b8d9788917879d0236acf0b
Depends-On: I64a94aeeabe6357b5ea7796e34c9306c55c9ae67
2015-02-27 16:36:51 +00:00
Jenkins
7cffc6c992 Merge "Remove duplicated isset function" 2015-02-25 01:33:31 +00:00
Joshua Harlow
ee9064b762 Add debtcollector to lib/oslo and stackrc
Ensure that the debtcollector library is pulled in
like the other oslo libraries so that devstack can
use it where appropriate.

Also fixes 'test_libs_from_pypi.sh' to not have a huge
single line of libraries; and splits it into multiple
lines so the diffs and code can be easily looked at.

Change-Id: I35ab0ed0e20b6092a41ecb3b6f1aaf0a05f5180e
2015-02-24 12:55:13 -08:00
Attila Fazekas
b8cf38c05d Remove duplicated isset function
stackrc defines the isset function, but this function is already
declared in functions-common.

The stackrc sources the `functions` which sources the `functions-common`.

Change-Id: I0772c42d049833334107c2e6da3700e544ce094f
2015-02-24 13:02:39 +01:00
Jenkins
beeef93013 Merge "mysql: disable query logging by default" 2015-02-23 21:30:19 +00:00
Jenkins
4e17005359 Merge "Add oslo.policy to lib/oslo and stackrc" 2015-02-23 21:28:04 +00:00
Jenkins
37e03c906b Merge "Build wheel cache for venvs" 2015-02-19 17:20:45 +00:00
Steve Martinelli
20b027b79c Add oslo.policy to lib/oslo and stackrc
As per the graduation work items, any new libraries should be
added to lib/oslo and stackrc

partially implements bp graduate-policy

Change-Id: Ief8f28715ecff5a602d6d840d736ea07b5e7ff39
2015-02-18 23:21:20 -05:00
Jenkins
20585f5b23 Merge "Remove no longer used definitions for Ryu" 2015-02-19 01:08:48 +00:00
Daniel P. Berrange
20a3dbdfa1 mysql: disable query logging by default
Having DATABASE_QUERY_LOGGING enabled results in devstack turning
on verbose mysql query logging. This results in a log file
/var/log/mariadb/mariadb-slow.log that grows to 10's of GB in
size in very little time (few weeks if that). Developers never
seem to notice this exists until their host OS runs out of disk
space due to this logfile that is never truncated.

Very few people will ever look at this logged data, so a more
sensible default is False, to make the out of the box setup be
suitable for the majority. Those few people who want to debug
mysql query performance can enable it in local.conf, as will
the devstack gate setup scripts.

Depends-On: I6970d61474528f554134d0aa333cd52b7b20f309
Change-Id: Ia4a366c839ac51623bc1fbee3560dc4d848cce14
2015-02-18 22:17:20 +00:00
Dean Troyer
b1d8e8e274 Build wheel cache for venvs
Building a bunch of virtual envs later is going to be tedious if we do not
pre-cache certain annoying-to-build packages.

* tools/build_wheels.sh: pre-build some wheels for annoying package installs
* list distro package dependencies in files/*/venv
* list packages to pre-build as wheels in files/venv-requirements.txt
* install database Python modules when setting up the database

Change-Id: Idff1ea69a5ca12ba56098e664dbf6924fe6a2e47
2015-02-18 15:13:00 -06:00
Jenkins
a804c071b7 Merge "add ceilometermiddleware lib" 2015-02-18 11:32:51 +00:00
YAMAMOTO Takashi
606f3478b1 Remove no longer used definitions for Ryu
Change-Id: Ie6dcf1569aacfa8d20e905d694847594b136fed1
2015-02-18 13:56:35 +09:00
Jenkins
bae736e1e0 Merge "Revert "Remove NoVNC from the default enabled services"" 2015-02-16 18:12:14 +00:00
gordon chung
ad61e7f9dd add ceilometermiddleware lib
middleware in ceilometer has been broken into it's own lib. this
first patch adds the package.

Change-Id: I63795787b909effcc4fcdee7f262207bb59fd8c2
2015-02-12 18:07:02 -05:00
Sean Dague
b9f2e25fa8 Revert "Remove NoVNC from the default enabled services"
Reverting this is probably appropriate because until we can
get Debian/Ubuntu to fix their underlying dependencies. 
It's confusing a lot of people that this is no longer
available

This reverts commit 2bfb9af0c952f59287be4ce684b78cfb710a6105.

Change-Id: Id352db9dcd40bfb5eb771dad42cdf04e0ce72313
2015-02-12 20:31:58 +00:00
Sean Dague
117c6c2048 remove lib/stackforge
Now that we have a working external plugin mechanism stackforge
projects definitely don't need to be directly in devstack. These were
largely unused previously anyway.

Change-Id: I300686b2ac976d9b454404842b3f210fd7c239d9
2015-02-10 07:53:36 -05:00
Jenkins
3f80eb59a4 Merge "Revert "Make neutron the default in devstack"" 2015-02-05 15:31:00 +00:00
Sean Dague
e3e9b226d0 Revert "Make neutron the default in devstack"
The simple case of a single interface doesn't work
out of the box, and this is now failing for lots of 
people. We need to back up and get that working.

This reverts commit c906bb38851037880f557b15ad30c9b0bb7fa295.

Change-Id: If20df670e06cda2d65028bceb46d257d011cf917
2015-02-05 12:34:12 +00:00
Jenkins
393acc0a24 Merge "Make neutron the default in devstack" 2015-02-02 20:09:54 +00:00
Kyle Mestery
c906bb3885 Make neutron the default in devstack
This changes the default devstack configuration to use Neutron instead of
nova-network.

Change-Id: Ia161695a8414cad751c3e66b985a78384a76890d
2015-01-27 10:32:10 +00:00
Dean Troyer
dde41d0797 Deprecate SCREEN_LOGDIR in favor of LOGDIR
This is the first step in the log file cleanup.  If SCREEN_LOGDIR
is still set, symlinks will be created in the old screen log directory
so things like the devstack-gate log collector continues to work.

bp:logging-and-service-names
Change-Id: I3ac796e322a18dbd0b8b2310a08310ca159d7613
2015-01-20 16:08:22 -06:00
Kevin Benton
59d52f307b Disable shallow cloning with GIT_DEPTH=0
The recent patch to enable shallow cloning added a method to skip
it by checking if GIT_DEPTH was null. However, this could never
be triggered because if the user specified it as null, the default
setting code would take over and set it to 1.

This patch allows the user to specify GIT_DEPTH=0 to skip the
shallow clone.

Change-Id: I00ea7ab54ed51dc3ede9ceb9ff0f11575a035d1c
2015-01-20 09:35:34 -05:00
Sean Dague
537532931d Make changes such that -o nounset runs
This makes a bunch of variable cleanups that will let -o nounset
function, for the time being we hide nounset behind another setting
variable so that it's not on by default.

Because this is bash, and things are only executed on demand, this
probably only works in the config it was run in. Expect cleaning up
all the paths to be something that takes quite a while.

This also includes a new set of unit tests around the trueorfalse
function, because my change in how it worked, didn't. Tests are good
m'kay.

Change-Id: I71a896623ea9e1f042a73dc0678ce85acf0dc87d
2015-01-15 13:06:14 -05:00
Shuichiro MAKIGAKI
b968b0c36b Fix comments to use 'local.conf' instead of 'localrc'
Instead of 'localrc', 'local.conf' should be used.
Example codes to enable neutron also should follow local.conf syntax.

Change-Id: I4f4c03fdbf0f612e5b518177b29669fb202d9f7a
Closes-Bug: #1407391
2015-01-08 19:12:04 +09:00
Jenkins
affcf87181 Merge "Remove NoVNC from the default enabled services" 2014-12-14 14:42:47 +00:00
Jenkins
f344758fb4 Merge "Revert "Update used Fedora images to version 21"" 2014-12-12 02:35:52 +00:00
Steve Baker
6d012cf16f Revert "Update used Fedora images to version 21"
This breaks check-heat-dsvm-functional-mysql which assumes the previous glance image name.

This reverts commit 21dbe993348b794a1b77c4f9db0081d1cc32138c.

Change-Id: I77749f3f9f1a64719447ddd25ee95bc6d3afa5b3
2014-12-12 00:52:59 +00:00
Christian Berendt
21dbe99334 Update used Fedora images to version 21
Change-Id: I26a3d7d0842f9d4c5fc33350992a19f597f39b2e
2014-12-11 11:53:24 +11:00
Dean Troyer
2bfb9af0c9 Remove NoVNC from the default enabled services
Preparing to remove all non-stackforge git repos

Change-Id: I91f628f09fcdfd1aefbc40c9e26be0509eee484d
2014-12-10 16:59:14 -06:00
Jenkins
fa2193823d Merge "Update used Fedora images to version 21" 2014-12-11 15:28:45 +00:00
Jenkins
5f953dd1fe Merge "Allow use of dnf instead of yum on Fedora" 2014-12-11 14:26:10 +00:00
Jenkins
d7af0fe7a6 Merge "Update devstack to work with new split neutron services repos" 2014-12-10 23:01:40 +00:00
Daniel P. Berrange
63d25d978b Allow use of dnf instead of yum on Fedora
Since Fedora 20 it has been possible to use 'dnf' as a drop-in
replacement for 'yum', and it is targetted to become the default
in Fedora 22

   http://fedoraproject.org/wiki/Changes/ReplaceYumWithDNF

There are many benefits of 'dnf' over 'yum' but the biggest
from the POV of an openstack developer is its speed.

Assuming an existing running devstack install ie all required
RPMs already installed on the system. Now look at how long it
takes to run stack.sh, during which yum does not have to
actually install anything

 # ./unstack.sh
 # time ./stack.sh
 real 11m12.193s
 user 10m17.129s
 sys  0m15.275s

Now, with 'export YUM=dnf' set in local.conf, run the same
test again

 # ./unstack.sh
 # time ./stack.sh
 real 0m48.610s
 user 0m28.939s
 sys  0m7.801s

So, this is showing that devstack is wasting 10 minutes just
for yum to figure out that everything is already installed.
The overhead of yum vs dnf is even worse when yum has to
acutally depsolve to install new packages.

Change-Id: Ia01a5f330a47b32207586902a861bedfc8a0f6e2
2014-12-11 09:37:55 +11:00
Jenkins
d09a1db5a4 Merge "add shebang lines to all lib files" 2014-12-10 20:32:15 +00:00