408 Commits

Author SHA1 Message Date
Ihar Hrachyshka
1a791cbc44 Remove vpnaas code from devstack
This service is now configured by devstack plugin in master.

Change-Id: Ie5fc0d2a45c1b564f98c69ec9ea6fbdeeb465d32
2016-04-28 12:39:26 -07:00
zhiyuan_cai
6f1781f968 Fix DevStack failure in multi-region setting
In stack.sh, REGION_NAME is used to set environment variable
OS_REGION_NAME before using OpenStack client to configure accounts
for services. OpenStack client will try to find Keystone endpoint
in REGION_NAME to send the requests.

However, in the case of deploying multiple DevStack instances in
different regions with shared Keystone, Keystone is only running
in one the of region. When installing DevStack for the region that
does not host Keystone, OpenStack client will fail to find the
Keystone endpoint and thus DevStack fails to start.

This patch fixes this bug by introducing KEYSTONE_REGION_NAME for
user to specify which region Keystone is running in. Document of
multi-region setup is also updated.

Change-Id: I3e82c7ff69326d4171623299ffecea103d40c80d
Closes-Bug: #1540802
2016-04-12 14:54:11 +08:00
Jenkins
547c393b93 Merge "Allow install os-vif library used by Nova" 2016-03-24 15:22:31 +00:00
Sean Dague
646085d701 Add colorful PS4
PS4 can include functions, so when running in the LOG_COLORS=True mode
provide a grey function line so that it's easier to visually
distinguish the content from the location.

Also make it so the main prompt chunks off all the common path, which
means we can printf to 40 characters and have a pretty reasonable and
readable PS4.

Change-Id: I4a10a49db97d413349bcfceeb8c4164936fbcc40
2016-03-23 07:37:44 -04:00
Sergey Belous
1258da6408 Allow install os-vif library used by Nova
In future Nova will use os-vif library for some communication with Neutron.
This patch add ability to install os-vif library that requires for run
tempest-jobs for new patches, that used os-vif.

Change-Id: I28e48afd3c740b1aa50c994d99f660f095e7deda
2016-03-21 12:40:50 +03:00
Dean Troyer
d014002d03 Remove n-crt from default services
Depends-on: I8a07320b59ea6cd7d1fe8bce61af84b5a28fb39e
Change-Id: I3441317911c8e940ef038c79f97554c1c669e120
2016-03-16 08:43:14 -05:00
Jenkins
ca5104b0b1 Merge "Add some notes on trove image" 2016-03-10 15:11:45 +00:00
Ian Wienand
c21194875e Add some notes on trove image
The trove image is one of the larger ones we cache, and after
double-checking it is still used as part of the
gate-tempest-dsvm-trove tests (although integration tests seem use
their own dib-built version)

Add some notes to clarify the situation with this image.

Change-Id: I2319dd5811d6bd215d1e8778eca5b4c9399f0efb
2016-03-07 10:25:41 +11:00
Lucas Alvares Gomes
f85a7e90f0 Ironic: Set DEFAULT_IMAGE_NAME to full disk image for agent
The agent_* drivers in Ironic are not yet capable of deploying partition
images. The code in DevStack was aware of that but it was looking at the
agent_ssh driver specifically.

This patch is fixing this assumption and extending that conditional for
all agent drivers.

Change-Id: I416faa9ef6fba9621cd664d5a0747b1e80e281d1
2016-03-03 10:33:17 +00:00
Doug Wiegley
86561c347d Enable neutron-lib for LIBS_FROM_GIT for backwards compat jobs
Change-Id: I8dd84c59d2ec3a7c01ff4f1aaf7fa61d7466cfd5
2016-02-11 11:01:01 -07:00
Jenkins
dab2f8b5ab Merge "Add diskimage-builder to the list of libraries" 2016-02-11 02:33:14 +00:00
John L. Villalovos
6f013631a2 Handle case where FUNCNAME[0] is undefined
If FUNCNAME[0] is undefined and 'set -u' has been used it will cause the
devstack run to fail.

Handle undefined values in PS4.

Closes-Bug: #1543749
Change-Id: I06a013a5e7683e3a3461ff06361d867f61d48e6a
2016-02-09 13:32:24 -08:00
Sean Dague
e73f88e70b tweak ps4 for readability
After staring at a bunch of logs, try to crisp up the ps4 output for
maximum readability.

This also adds PS4 to all calling scripts by having a common PS4 in
stackrc. It should make understanding when clean fails a bit more
straight forward.

Change-Id: Ia1f8dff5c1102c32c146a020a9f033c65d2c50de
2016-02-04 07:47:45 -05:00
Sean Dague
74b91c3eaf Revert "Move default Keystone API version to v3"
It seems like the fallout from this was not well sorted.
A lot of things aren't working, and there is still vestigial
v2 bits left behind.

This should have come with a much greater warning and some
spot checking of additional services working with this.

This reverts commit b162a1d58cdecfb32847b59bd341e06c26efb1ed.

Change-Id: Ia792b23119c00089542ba08879dca1c29dc80945
2016-02-01 14:58:20 +00:00
Paulo Ewerton
b162a1d58c Move default Keystone API version to v3
This patch sets Keystone v3 as default in services
configuration files and in the openrc and stackrc scripts.

Change-Id: I24546f02067ea23d088d383b85e3a78d7b43f165
Partially-Implements: bp keystonev3
2016-01-26 14:27:02 +00:00
Jenkins
973fb21de6 Merge "Add subunit output for total elapsed time" 2016-01-23 08:20:37 +00:00
Matthew Treinish
4af2afcd52
Add subunit output for total elapsed time
This commit adds a success output for the entire devstack run to the
subunit output. Ideally we wouldn't need this, but because we don't
have timing data for every single operation performed by devstack we
need to do this to track the total duration of the devstack run.

To capture failures this commit adds saving a devstack event when we
trip the exit_trap. This will save a similar result to the stream in
the successful case, but instead mark it as a failure.

Depends-On: Icc7df33e4d73ba6322af38fbdf3aea230f2fcf4d
Change-Id: I07112dde996c3e2c73f5aafc9b73d33d26374633
2016-01-19 17:22:55 -05:00
Boris Pavlovic
ba0a659c76 Make OSprofiler repo and branch configurable
OSprofiler is now under Oslo:
https://review.openstack.org/#/c/103825/

And we really need this patch to make proper dsvm job for
OSprofiler

Change-Id: I20f59c52c147303de01544dc975a82b4a741a1b9
2016-01-14 18:38:30 -08:00
Lucas Alvares Gomes
3919d4c822 Add diskimage-builder to the list of libraries
Add diskimage-builder to the list of libraries so it can be installed
from source to be tested in gate.

Change-Id: I6cefac1eb4ebf0196a6b4d4bfc038c00921f0d70
2016-01-11 19:10:18 +00:00
Jenkins
1195a5b739 Merge "Remove ironic code from tree" 2015-12-28 17:06:48 +00:00
Jenkins
d21747952e Merge "Remove a stale comment about SQLALCHEMY_DATABASE_DRIVER" 2015-12-22 06:04:46 +00:00
Jim Rollenhagen
47367071cd Remove ironic code from tree
This removes all of the ironic code from the devstack tree, in favor of
the devstack plugin in Ironic's tree.

Depends-On: I659e3de5c64df798441798ff48ba5c9c0506585a
Depends-On: I2c52bc014f1b0dbc6b0ae22a4deb4132b4c28621
Change-Id: I5125fce295c79600781469c2f48bea80e7600081
2015-12-18 17:26:02 +02:00
Davanum Srinivas
168be83597 Nuke EC2 API service in defaults
Tempest does not test EC2 by default anymore:
Ib5e24e19bcba9808a9f49fe7f328668df77fe4f9

So we don't need to run nova ec2 API service by default.

Change-Id: Ieec0ca1361baf0978d96e69e1134f699c1af3bb9
2015-12-18 07:49:27 -05:00
YAMAMOTO Takashi
239a9788b3 Remove a stale comment about SQLALCHEMY_DATABASE_DRIVER
SQLALCHEMY_DATABASE_DRIVER is no longer used
after If6d8d08e5b7b7c48ca012677b536d71058def6fd .

Also, remove mysql connector packages from the install list.

Closes-Bug: #1523377
Related-Bug: #1493304
Change-Id: I5ecbc3b0bac989faa5c46d3c2866558a505414d8
2015-12-14 21:32:33 +09:00
Doug Hellmann
ddc3839bdc Enable optional Python 3 support
Add USE_PYTHON3 and PYTHON3_VERSION variables to allow services to use
python 3 if they indicate support in their python package metadata.

Tested in Heat here -> I837c2fba682ab430d50e9f43913f2fed20325a7a.
Project config change to add a dedicated job to Heat is here -> I0837e62d6ccc66397a5e409f0961edd4be31f467

Change-Id: I079e18b58b214bf8362945c253d6d894ca8b1a6b
2015-12-01 14:52:35 -05:00
Jenkins
4300f83acf Merge "Config graceful_shutdown_timeout option for services" 2015-12-01 16:01:30 +00:00
vsaienko
be3e553556 Add discussion of LIBS_FROM_GIT
Add a pointer to installing clients via LIBS_FROM_GIT to local.conf
sample.  Mention in the git tree setup that the projects within are
usually installed via released pip versions.

Change-Id: I245094e51ea4a8ce983f6a1e48b6ab7ca5d309d0
2015-11-27 12:05:36 +11:00
Jenkins
0b6a40bcab Merge "install ebtables locking workaround" 2015-11-18 23:20:36 +00:00
Sean Dague
7860f2ba31 install ebtables locking workaround
ebtables is racing with itself when nova and libvirt attempt to create
rules at the same time in the nat table. ebtables now has an explicit
--concurrent flag, that all tools must opt into to prevent ebtables
from inherently being unsafe to run.

libvirt gained this support in 1.2.11, which is too new for our ubuntu
primary testing environment. Nova still hasn't added this support,
though even if it did, we'd run into the issue with libvirt.

We can do the most ghetto thing possible and create a wrapper for
ebtables that does explicit locking on it's own. It's pretty terrible,
but it should work. And it is the kind of work around that people
unable to upgrade libvirt will probably need to do.

This is an opt in value which we should set in the gate to True.

Related-Bug: #1501558

Change-Id: Ic6fa847eba34c21593b9df86a1c2c179534d0ba5
2015-11-18 10:59:50 -05:00
Jenkins
a3517c198b Merge "refactor zookeeper into a slightly more generic dlm module" 2015-11-13 15:41:24 +00:00
Tony Breeds
34a5aa5110 Remove unused compat variable SCREEN_DEV
Currently we set USE_SCREEN to SCREEN_DEV if it's set.  There is a
comment to remove it once it's eracticated from CI.

AFAICT this pre-condition has been met.

Change-Id: I1423c8b9c18d1b3e34dbfe1c03be735c646a12b4
2015-11-12 09:56:21 +11:00
Tony Breeds
9329290183 Update comments to reflect current USE_SCREEN usage
In a couple of places the tracking of USE_SCREEN has drifted from the
comments.

Correct that.

Change-Id: I63bdd5ca4de49bf653f5bc8f8e0e5efe67ef605c
2015-11-12 09:56:21 +11:00
Sean Dague
5cad4d3fe9 refactor zookeeper into a slightly more generic dlm module
This attempts to make the zookeeper installation a bit more modular
(assuming that other folks will want to add other dlms as plugins),
and addresses the service start issues with zookeeper under
ubuntu/upstart.

Zookeeper is not going to be installed by default. Services need to
ask for it with use_dlm.

Change-Id: I33525e2b83a4497a57ec95f62880e0308c88b34f
2015-11-11 14:30:12 -05:00
Tony Breeds
536b8c1d2c Allow screen without logging to disk
In some niche setups it is desirable to run OpenStack services under
screen, but undesirable to automatically keep a persistent log from
each service.

Add a new variable SCREEN_IS_LOGGING that controls if screen logs each
window to disk automatically.

Ideally screen itself would be configured to log but just not activate.
This isn't possible with the screerc syntax.  Temporary logging can still
be used by a developer with:
    C-a : logfile foo
    C-a : log on

Change-Id: I2a3abf15dea95ae99ddbdfe1309382df601b7d93
2015-11-11 06:21:45 +11:00
Jenkins
988389a45a Merge "Zookeeper for DLM scenarios" 2015-11-05 22:21:18 +00:00
Sean Dague
9013bb0c24 remove wheel cache code
Thanks to lifeless, pip now implicitly has a wheel cache so that it
builds a wheel before every install, and uses that cache. All our
clever attempts at manually doing wheelhouse things is actually
bypassing the existing cache and making things take longer.

We should remove all of this code and just let pip do this thing,
which is does very well, and get out of the way.

Change-Id: Ia140dc34638d893b92f66d1ba20efd9522c5923b
2015-11-04 12:31:39 -05:00
Davanum Srinivas
33a96ffc26 Zookeeper for DLM scenarios
In Tokyo, there was a cross project session on distributed
key locking:
https://etherpad.openstack.org/p/mitaka-cross-project-dlm

In support of the discussion there, we'll need support for
a zookeeper service in Devstack and ability to use libraries
like Tooz for DLM functionality.

In this review, we pick up some configuration files from
monasca-api and copy the lib/template to implement the
zookeeper lifecycle. Those services that need zookeeper
need to add "zookeeper" in ENABLED_SERVICES.

Change-Id: Icef26e5cdaa930a581e27d330e47706776a7f98f
2015-11-03 12:13:50 -05:00
Marian Horban
7159b4ba59 Config graceful_shutdown_timeout option for services
To avoid hanging services during gracefull shutdown option
graceful_shutdown_timeout should be configured.

Closes-Bug: #1446583

Change-Id: I2b7f0df831d65c55ae8cae241478f49c9641d99f
2015-10-29 11:44:12 -04:00
Tony Breeds
7792bc39d4 Add new oslo.privsep library to oslo repos
A new project olos.privsep has been created but failes sdvm testing as
even though the library is added ro PROJECTS and LIBS_FROM_GIT it isn't
installed by devstack.

Add oslo.privsep to the install_oslo function

Change-Id: Ia4d56747d56dcfe50889ebbdf9d553df13e1b950
2015-10-25 17:39:37 +11:00
Einst Crazy
cc481740a0 modify stackforge/swift3 to openstack/swift3
As swift3.git has move from stackforge/swift3 to openstack/swift3,
so modify it.

Change-Id: Ieaff4c93889c46c7d4b8ecada1a5d7cf3c775965
2015-10-20 01:19:18 +08:00
Ian Wienand
975f4209d0 Save interactive passwords to separate file
The interactive password prompt currently saves to .localrc.auto

However, this is removed when you re-run stack; that is required as it
is how we source the localrc bits of local.conf, and we want the
users' changes to be picked up.

The passwords, however, should remain constant, because everything has
already been setup with them.  So write them to a separate file.  Note
we source before localrc so it can still overwrite them.

Some minor flow-changes too

Change-Id: I9871c8b8c7569626faf552628de69b811ba4dac0
Closes-Bug: #1505872
2015-10-15 10:51:05 +11:00
Matt Riedemann
c35eee5dbb use nproc/2 workers for large ops job
Commit 1ce19ab76d67a89b04f907f1d292d013a3b699e0 dropped API_WORKERS from
nproc/2 to nproc/4 and also started using API_WORKERS for the number of
conductor workers, so in gate runs that dropped conductor workers from 8
to 2.  We're now seeing instance build timeouts in the large ops job.

This change goes back to nproc/2 for the large ops job (VIRT_DRIVER=='fake').

Closes-Bug: #1500615

Change-Id: Ie6ef855fce0a99c930d479b7459c15b69e8de499
2015-09-29 06:45:29 -07:00
Jenkins
b27ab6fb25 Merge "stackrc set the LC_ALL to C" 2015-09-28 20:19:43 +00:00
Jenkins
f845b22a45 Merge "Remove ceilometer in favor of plugin" 2015-09-28 17:49:32 +00:00
Einst Crazy
f327b1e119 stackrc set the LC_ALL to C
It will report 'unknown locale: UTF-8', when the env is UTF-8.
Default set the LC_ALL to C in the stackrc, instead. And delete
the duplicate option in stack.sh.

Closes-Bug: 1499296

Change-Id: I14121b25ac314a1a93e6dd6811e196ce2a7c0eb5
2015-09-28 11:23:03 +08:00
Jenkins
9f6b7eb3e5 Merge "attempt to cut api workers in half" 2015-09-24 19:31:52 +00:00
Sean Dague
1ce19ab76d attempt to cut api workers in half
One of the key reasons for the large number of API_WORKERS was that
mysql would block API workers, so would start rejecting work. Now with
the python mysql driver we should be eventlet aware, and life should
be good.

Let's see if this works.

Change-Id: Iaf8730a4dcdc30ef390795bfb5fb73ec3cd665fe
2015-09-24 07:52:48 -04:00
Jenkins
c00e39901b Merge "Fix typos in stackrc and unstack.sh" 2015-09-15 03:17:15 +00:00
Wei Jiangang
be65c6f88d Fix typos in stackrc and unstack.sh
Componets => Components
pluggins => plugins

Change-Id: I82634a55fd5895599099c94817af7d8d2f602859
2015-09-14 18:55:07 +08:00
Chris Dent
e9a4750fe1 Remove ceilometer in favor of plugin
The ceilometer project is moving to using a devstack plugin rather
than having ceilometer in the base devstack. This is to allow
greater control and flexibility.

Change-Id: I413ab159474b7d7231ad66d3a482201f74efe8a8
2015-09-09 16:44:29 +00:00