575 Commits

Author SHA1 Message Date
Monty Taylor
236250f1c3
Rename python-openstacksdk to openstacksdk
Change-Id: Ia77163f330f674146b369dfebea56bd97820057e
Depends-On: https://review.openstack.org/554662
2018-03-23 08:27:57 -05:00
Matt Riedemann
23df4da0d4 Use Queens UCA
This updates the UCA usage from Pike to Queens. As a result,
the various volume multiattach checks can also be removed
because the Queens UCA has libvirt 4.0.0.

Change-Id: Icb971831c8d4fe5f940d9e7993d53f1c3765e30f
2018-03-19 14:27:01 -04:00
Stephen Finucane
c81947a37d Remove remnants of SCREEN_LOGDIR
These appear to have been missed in commit 'cdba1b371'.

Change-Id: Ibb7fd7a0d54750c16360dfceb8e6b024ed8f504e
2018-03-12 15:21:13 +00:00
Jens Harbott
dc7b429463 Fix running with SERVICE_IP_VERSION=6
- There are some locations where we need the raw IPv6 address instead of the
  url-quoted version enclosed in brackets.
- Make nova-api-metadata service listen on IPv6 when we need that.
- Use SERVICE_HOST instead of HOST_IP for TLS_IP.

Change-Id: Id074be38ee95754e88b7219de7d9beb06f796fad
Partial-Bug: 1656329
2018-03-11 08:53:41 +00:00
Zuul
a6a36d11d8 Merge "Allow overrides for ETCD ports" 2018-03-11 05:43:44 +00:00
Dirk Mueller
3360ffb5f2 devstack master is rocky now
See #snowpenstack!

Change-Id: I2df485c2acf1bec0d0f7ddc6538bff2c2ec141e3
2018-03-02 21:08:58 +01:00
Jens Harbott
730ce45466 Create NOVA_READY_TIMEOUT in is_nova_ready function
The function was introduced in [0] using a hardcoded timeout of 60
seconds which turns out to be too small on slow machines. Create a new
global variable NOVA_READY_TIMEOUT instead so that users can
override the timeout if necessary.

[0] I32eb59b9d6c225a3e93992be3a3b9f4b251d7189

Co-Authored-By: Mohammed Naser <mnaser@vexxhost.com>
Change-Id: I0cd7f193589a1a0776ae76dc30cecefe7ba9e5db
2018-02-23 16:52:23 -05:00
Sean McGinnis
a492206700 Centralize setting default branch for stable branching
One of the steps when we create a new stable branch is to
branch devstack, then update the default branch for most
repos to use the new stable branch for each repo.

This requires making multiple updates throughout stackrc,
and to further complicate things, there are some repo
branch variables for branchless repos that should not be
updated along with the others.

This can be error prone if not fully aware of these
exceptions. To simplify this process a little, this
patch adds two common variables - one that can be set to
the new stable branch name for all of the repos that
should be branched, and one that can be used for all of
the branchless repos to make it explicit that those
values should be left alone. The cycle-trailing repos
have until two weeks after final release to branch, so
also adding another variable for those to make it easy
to update them at a later time, separately from the
other repos.

Change-Id: I82aa19e739eeda3721bac1cb5153ad0bf2d1125a
2018-02-15 11:21:15 -06:00
Zuul
fbdefacc1d Merge "Drop django_openstack_auth related code" 2018-02-05 03:42:45 +00:00
Zuul
55e461b11c Merge "tempest: set compute-feature-enabled.volume_multiattach" 2018-02-02 03:41:17 +00:00
Zuul
5fb35b4f2b Merge "Added the ability to specify checksum for etcd" 2018-01-26 12:47:48 +00:00
Matt Riedemann
ffe691ecd5 tempest: set compute-feature-enabled.volume_multiattach
This adds the ENABLE_VOLUME_MULTIATTACH flag and if True
configures Tempest to run volume multiattach tests.

Note that due to https://bugzilla.redhat.com/show_bug.cgi?id=1378242
we can't run multiattach tests with the Pike UCA packages since
those include qemu 2.10 and libvirt 3.6, and the valid versions for
multiattach support with libvirt is qemu<2.10 or libvirt>=3.10.

Depends-On: I80c20914c03d7371e798ca3567c37307a0d54aaa
Depends-On: I158c6f20e3e6a24bd2e5299abbeb3fc5208e5885

Part of nova blueprint multi-attach-volume

Change-Id: I46b7eabf6a28f230666f6933a087f73cb4408348
2018-01-18 18:00:04 +01:00
Peter Penchev
6bcd8cad16 Bump the Cinder LVM backing file size to 24Gb.
This follows a change made to devstack-gate in commit 841ebc3 to allow
tempest to succeed even if it happens to run several volume tests in
parallel.  Right now it's possible for a tempest-full test (run without
devstack-gate) to fail with an "Insufficient free virtual space" error in
the cinder-scheduler log.

Suggested by: Clark Boylan <clark.boylan@gmail.com>
Closes-Bug: 1743597
Change-Id: I16ccb9976d1bc7c9f56a6a4d73e35042a5867ef9
2018-01-16 18:05:06 +02:00
Shachar Snapiri
fabaa991ca Added the ability to specify checksum for etcd
It is possibe for the user to override te etcd version, thus download a
different etcd file, but the checksum is constant, so the checksum
verification will fail in that case.
Added the ability to specify a different checksum, so the user would be
able to specify the new version checksum

Change-Id: I85af3af841ae957964f18d4e37a86ab0703882bc
Closes-Bug: #1736718
2018-01-08 12:25:18 +00:00
Akihiro Motoki
f8dc558486 Drop django_openstack_auth related code
In Queens cycle, the code of django_openstack_auth was merged into
the horizon repository. The master branch of django_openstack_auth
will be retired. (horizon blueprint merge-openstack-auth)
This commit drops django_openstack_auth related code from DevStack.

_prepare_message_catalog_compilation in lib/horizon was used only
in install_django_openstack_auth, so it is dropped too.

Change-Id: If9467c520a1e07d1968b29e485df0097330356bc
2017-12-24 08:21:15 +09:00
Monty Taylor
9ef3e84485
Add python-openstacksdk to python3 enabled list
It's perfectly with with python3, add it to the list.

Change-Id: Ieb9f563a2f95e78a994cef388e56a6d5a84c8935
2017-12-03 10:11:12 -06:00
Davanum Srinivas
27367bea48 Allow overrides for ETCD ports
This will enable us to run one etcd for devstack and another
for kubernetes in the same box if necessary

Change-Id: Ib71ded24727b80afd4d98eb68bade0f8c0f72311
2017-11-30 20:04:05 +00:00
Jenkins
3286198f0e Merge "Switch DEVSTACK_SERIES to queens" 2017-10-04 07:20:35 +00:00
Zuul
3f97e71063 Merge "Update default etcd version" 2017-10-03 07:07:52 +00:00
Matt Riedemann
ba4830b84e Download default image when using VIRT_DRIVER=fake
Change f119121d21fa0446197b26378091677daac1606a removed
the default image to download which meant if you were using
the fake virt driver, no image would get downloaded and
tempest setup would fail.

This adds it back in but doesn't use a wildcard.

The default image is the same as before, but uses the
variables that are also used for the default libvirt image
case.

Change-Id: I80eddd0d3a99572ed494b5cd36fed8ceb4d05d77
Closes-Bug: #1720003
2017-09-27 16:45:25 -04:00
Dirk Mueller
721f7c2cd0 Switch DEVSTACK_SERIES to queens
pike is handled in stable/pike branch for some time
already.

Change-Id: I47dc5bf661c50b3b05c19ad665c2671f807233ae
2017-09-25 13:53:45 +02:00
Jens Harbott
07a8823d4f Update default etcd version
There have been a couple of new stable releases in the meantime, update
to using v3.1.10 which is the currently latest stable version.

Change-Id: Ifa1421c9f12af9753052f992929deb7ebd45e804
2017-09-25 11:36:20 +00:00
Matthew Treinish
c4b0059c6b
Disable the v2.0 identity API by default
The v2.0 identity API is being removed in the Queens release, but in
order to do so we need to stop some v2.0 tempests tests from being
run. This commit switches the default to disable the keystone v2 api.
In a future commit after the removal of the api from keystone the bits
to deploy the v2 api will be removed.

Change-Id: I5afcba6321f496b8170be27789bee7c9ad8eacce
2017-09-22 15:07:36 -04:00
Jenkins
cd06b2ee81 Merge "Enable graceful shutdown for services" 2017-09-19 01:49:24 +00:00
Sean Dague
4324f4ecd9 Fix devstack python detection if python3 is missing
On platforms without python3 installed devstack fails the python
version check. This does it more gracefully.

Change-Id: I4d79a41eb2d66852ab1a1aa8bd383f8e3e89cdc0
2017-09-14 13:13:15 -06:00
Andreas Scheuring
941940a92c Add etcd3 support for s390x
Since [1] devstack is failing on s390x with "Distro not supported".
The reason for this is the missing etcd3 support. It worked before
[1] as we were able to disable etcd3 via local.conf. But as etcd3 is
a base service, we might not be able to rely on this workarond in
the future anymore.

As there is no etcd3 binary hosted on github like it is for other
architectures, the user needs to specify an alternative download
URL via local.conf. Otherwise devstack will exit with an appropriate
error message.

  ETCD_DOWNLOAD_URL=<custom-download-url>

[1] d8bb220606

Change-Id: I1c378a0456dcf2e94d79a02de9d3e16753d946d6
Partial-Bug: #1693192
2017-09-13 00:52:41 +02:00
Jenkins
87943ab88e Merge "Make list_images.sh emit the etcd3 tarball" 2017-09-10 17:13:15 +00:00
Jenkins
5b42dcef5d Merge "Get default python versions from interpreter" 2017-09-10 16:59:05 +00:00
Jenkins
1ad91a7d4b Merge "Remove screen support from devstack completely" 2017-09-07 13:38:03 +00:00
Roman Podoliaka
a066abedac placement: install osc-placement
This makes sure that the openstack client placement plugin gets
installed when either LIBS_FROM_GIT includes osc-placement or
placement is used, which is always now if you've enabled nova,
which is enabled by default.

Co-Authored-By: Matt Riedemann <mriedem.os@gmail.com>

Depends-On: Ica83e29780722dd1555904e46b9ff1d1fdf72516

Change-Id: I7c5a5c10288b356302bb3027837d4ed4f0fbad8c
2017-09-06 12:56:00 +00:00
Matthew Treinish
477a962861 Enable graceful shutdown for services
1] Process using uwsgi:
   uwsgi services doesn't support for graceful shutting down [1].
   It requires some changes in unit files [2] including adding below
   graceful shutdown hook and changing KillSignal:
      --hook-master-start "unix_signal:15 gracefully_kill_them_all
   All the steps and changes required are specified in etherpad [1].

2] Non uwsgi services needs below changes:
   In [service] section:
   a. Add KillMode = process
   b. Add TimeoutStopSec = infinity

NOTE:
Creating unit file for services other than uwsgi is handled by the
'write_user_unit_file' function [3]. This function is common for all
the services so this patch adds the above mentioned parameters for
services using ServiceLauncher also though they don't require.

Added a new stackrc variable WORKER_TIMEOUT which is required to add
graceful shutdown support to uwsgi services. It will be set as a value
to 'worker-reload-mercy' [4] in uwsgi file of service. The default
value set to this variable is 90.

[1] https://etherpad.openstack.org/p/uwsgi-issues
[2] https://www.freedesktop.org/software/systemd/man/systemd.kill.html
[3] 2967ca3dfd/functions-common (L1439-L1461)
[4] http://uwsgi-docs.readthedocs.io/en/latest/Options.html#worker-reload-mercy

Co-Authored-By: Dinesh Bhor <dinesh.bhor@nttdata.com>
Change-Id: Ia95291325ce4858b47102dd49504250183f339ab
2017-09-06 11:55:04 +05:30
Jenkins
52b8e976a9 Merge "modify the default url of noVNC" 2017-09-06 02:37:27 +00:00
Monty Taylor
d8bb220606 Make list_images.sh emit the etcd3 tarball
We need this for every devstack run now, so downloading it from github
every time isn't the most awesome thing in the world.

Add an extra variable EXTRA_CACHE_URLS which will be appended to the
output of tools/image_list.sh.  This way, these files will be
downloaded during the daily nodepool build, but they will not be in
the IMAGE_LIST and hence be considered as images to upload.

Add a function get_extra_file which echos the path to a file given the
URL.  It will first check the cache at $FILES, and if not present
download it.

Update the documentation in image_list.sh to reflect what's happening.

Move the defaults for etcd variables into stackrc, since it is a base
service now.

Change-Id: I86104824a29d973a6288df1f24b7891feb86267c
2017-09-05 09:40:40 +10:00
Sean Dague
cdba1b3716 Remove screen support from devstack completely
This tears out the alternative path of using screen, so that we only
use systemd enabled paths. This simplifies the number of ways that
devstack can be run, and provides a much more reliable process
launcher than the screen based approach.

Change-Id: I8c27182f60b0f5310b3a8bf5feb02beb7ffbb26a
2017-09-01 15:08:17 -04:00
Ian Wienand
6d213dfda7 Get default python versions from interpreter
Query the python2/python3 interpreter for it's version to fill in
PYTHON3_VERSION and PYTHON2_VERSION defaults.  This means on a
python3.6 platform such as Fedora 26, we don't need to override the
default.

Change-Id: Id826f275b99b9f397b95e817941019fc503daa1d
2017-08-25 11:26:37 +10:00
Jenkins
371e6e1055 Merge "Don't special case Grenade + systemd" 2017-08-16 02:33:00 +00:00
Clark Boylan
6b354a9095 Don't special case Grenade + systemd
Now that the pike branch exists we don't want to special case grenade +
system on the target side. We should use systemd for both sides of the
pike -> master upgrade. Note this change should not be backported so
that we do not attempt to use systemd on the ocata -> pike upgrade path.

Depends-On: Iedf824a1772115e0dff287a898636f8e58471269
Change-Id: I6198bf1842a44773fce80672c81eee3afc3c6f38
2017-08-14 15:07:05 -07:00
linxuhua
a6c7827223 modify the default url of noVNC
i had sync the all repos of devstack for installing in intranet
environment, and found the url of noVNC had changed to
https://github.com/novnc/noVNC. This module upgrade from individual to
an organization. the old url had redirect to the new one.

Change-Id: I19fc1e2ad30dcd97cad232c9ad58f53a523616b4
2017-08-10 19:09:38 +08:00
zhangbailin
32608da2c4 Modify some spelling mistakes
There are some comment errors, it's modify 'Captial' to 'Capital' in
keystone file, and modify 'possition' to 'position' in openrc file, and
modify 'comming' to 'coming' in stack file, and
modify 'prefered' to 'preferred' in stackrc file.

Change-Id: I0fdd539cbfff842a4ba7fca9100b881443300f9a
2017-08-10 03:03:47 -07:00
Sean Dague
5adfef0a53 Introduce CELLSV2_SETUP variable
Some environments, like grenade and ironic, need a way to revert to
the non fleet version of the conductor setup. This really comes down
to a global topology for CELLSV2_SETUP. The prefered is with a
superconductor, but allow a downgrade to singleconductor.

Depends-On: I5390ec14c41da0237c898852935aba3569e7acae

Change-Id: I10fb048ef2175909019461e585d117b4284448c6
2017-07-26 13:51:29 -07:00
Dirk Mueller
46a54c9089 Switch to cirrors 0.3.5 also for the xen case
This image is available on the download site since Feb 2016,
so let's use it.

Change-Id: I3b89211f6e57f2c35056d7e9c57d08651a3a314f
2017-07-24 11:03:48 +02:00
Paul Belanger
254116305c
Remove mysql.qcow2 from stackrc
We no longer host this on tarballs.o.o, additionally it is no longer
used my trove.

Change-Id: I2034e8ebc530704d6e63a231056f92e14a8654e4
Signed-off-by: Paul Belanger <pabelanger@redhat.com>
2017-07-11 11:40:24 -04:00
Jenkins
02d8a0cd21 Merge "Use uwsgi for nova when NOVA_USE_MOD_WSGI is not False" 2017-06-29 18:02:31 +00:00
Sean Dague
2c0faca038 Add devstack-version script
This will help in collecting information about the devstack version
being used.

Change-Id: I23a8ca023bda6d097051cd57ae45401806451ad5
2017-06-28 13:53:37 -04:00
Chris Dent
b90bb1a461 Use uwsgi for nova when NOVA_USE_MOD_WSGI is not False
Unless NOVA_USE_MOD_WSGI is False, run nova-api and nova-metadata
using uwsgi.

Because the metadata server is always expected to run on a port and
without a prefix, we have it configured to use uwsgi but not to
proxy from apache: uwsgi listens on the configured port itself.

uwsgi process that listen themselve do not need a socket or to
chmod-socket, so those config lines have been moved to the block
that is also writing proxy configuration for apache.

Because this change only uses uwsgi for nova-api and nova-api-meta,
nova-api-meta is set to default to enabled in stackrc because the
nova-api wsgi application used by wsgi only presents the one service
(osapi_compute).

If NOVA_USE_MOD_WSGI is False and tls_proxy service is enabled,
nova-api is run on an internal port reached via the tls_proxy.

Depends-On: I8ff08d61520ccf04e32dcd02f4cecc39dae823cb
Change-Id: If2d7e363a6541854f2e30c03171bef7a41aff745
2017-06-28 17:46:22 +00:00
Kaitlin Farr
ed7dbe5754 Add python-barbicanclient to LIBS_FROM_GIT
Allow python-barbicanclient to be installed from git instead of pip.

Change-Id: I99cd72724e11bab362bcaaeb773f33b2abfe815c
2017-06-22 09:45:28 -04:00
Jenkins
660f4ae3ca Merge "Support installing os-traits from git" 2017-06-14 06:19:11 +00:00
Jenkins
9234316794 Merge "Make use of Ubuntu Cloud Archive switchable" 2017-06-09 01:55:36 +00:00
Matt Riedemann
aefc926cd4 Support installing os-traits from git
This will be used in a src job for running os-traits changes
in a dsvm/tempest setup.

Change-Id: I3c4433fb1ca2787e96b577a15d584b625c364ef3
2017-06-05 20:45:43 +00:00
Jenkins
899616290c Merge "Change version of noVNC to stable" 2017-05-26 21:21:19 +00:00