8599 Commits

Author SHA1 Message Date
Jenkins
805304f2ce Merge "Add a function to get an available random port" 2017-06-20 09:11:25 +00:00
Jenkins
d9d10df6cd Merge "etcd3: Allow for multi-host deployments" 2017-06-19 13:38:21 +00:00
Jenkins
b9f00f4539 Merge "docs: add "kvm on s390x" specific configuration in local.conf" 2017-06-19 13:25:03 +00:00
OpenStack Proposal Bot
41da1a9feb Updated from generate-devstack-plugins-list
Change-Id: Ida1d6d012e1e05f35ba45670436acd6f920c9575
2017-06-19 08:55:47 +00:00
Antoni Segura Puimedon
19279b0f87
etcd3: Allow for multi-host deployments
In Multi host deployments, it is possible to run ETCD in a different
host than the SERVICE_HOST (where all the controllers run). This patch
brings that distinction.

Change-Id: I15fe6f25eedf1efebaab81cce26b080577b856cc
Signed-off-by: Antoni Segura Puimedon <antonisp@celebdor.com>
2017-06-16 16:04:59 +02:00
Jenkins
418bbddc81 Merge "Provide timings for OSC during devstack run" 2017-06-15 19:36:32 +00:00
Jenkins
b24bfac43d Merge "Track db sync command time useage" 2017-06-15 19:36:25 +00:00
Sean Dague
85cf2933cc Provide timings for OSC during devstack run
The OSC number remain high, and it's useful to understand how much
time we spend making OSC calls, especially to surface it relative to
other items. The way we embed this in our code makes it hard to
instrument.

This patch creates a wrapper function for OSC which collects the timings
then aliases `openstack` to that function. This means any invocations of
the openstack utility goes through our function while devstack is
running. Because this is an alias it only affects the stack.sh shell and
any subshells.

This also moves the time tracking infrastructure to count in ms,
instead of s, because some of these operations are close enough to a
second that rounding early is losing way to many significant
digits. We divide by 1000 before reporting to the user.

Change-Id: Ic5f1844ce732d447ee980b3c9fdc417f72482609
2017-06-14 16:43:49 -07:00
Clark Boylan
633dbc3d8e Track db sync command time useage
We are trying to keep better track of what pieces of devstack consume
the most time. Add the db sync commands to the time tracking as they run
the database migrations which can take more time than expected.

Change-Id: Ib92f2b8304ccf703712d45fd7207444de3599e2d
2017-06-14 12:09:21 -07:00
Jenkins
a4c21ff9b2 Merge "Support unicode via en_US.utf8" 2017-06-14 18:35:31 +00:00
Jenkins
7b3968b382 Merge "Increase KEYSTONE_LOCKOUT_DURATION to 10" 2017-06-14 16:10:35 +00:00
Jenkins
2b76a75ff4 Merge "Improve OpenStack performance by redcuing bcrypt hasing rounds number" 2017-06-14 16:10:29 +00:00
Jenkins
3350542a44 Merge "Set swift functest config when using tls" 2017-06-14 16:09:11 +00:00
Clark Boylan
d095e97624 Support unicode via en_US.utf8
Because C.utf8 is not everywhere and is sometimes called C.UTF-8 (just
to confuse people) use en_US.utf8 which is in most places. This isn't
language/region agnostic but gives a consistent unicode aware locale to
devstack.

Change-Id: I67a8c77a5041e9cee740adf0e02fdc9b183c5bc4
fixes-bug: 1697733
2017-06-14 10:13:14 -04:00
Jenkins
29215d95c7 Merge "systemd: Always create the systemd unit files" 2017-06-14 07:50:37 +00:00
Jenkins
660f4ae3ca Merge "Support installing os-traits from git" 2017-06-14 06:19:11 +00:00
Jenkins
f1da3fbf75 Merge "Install test-requirements with main install" 2017-06-14 06:19:04 +00:00
Jenkins
2c0692c2c7 Merge "Remove temporary openSUSE-42.2 workaround" 2017-06-14 06:18:58 +00:00
Jenkins
f500d6a29d Merge "Use systemd-tmpfiles to create /var/run/uwsgi" 2017-06-14 06:18:12 +00:00
Markus Zoeller
15b0a5f1eb systemd: Always create the systemd unit files
Commit 5edae54 introduced the usage of systemd in Devstack. This allowed
the transition away from 'screen'. Systemd needs "user unit files" to
describe the services. Currently, those unit files get only created when
an openstack service (n-cpu, c-sch, g-api, ...) is in the list of enabled
services (`ENABLED_SERVICES`). This means, when Devstack is fully stacked,
there is no way to start the systemd unit of an openstack service which
is *not* in that list.

This commit changes that behavior, and creates the systemd unit files
independently of the list ENABLED_SERVICES. This means, when Devstack
is fully stacked, I can start a systemd unit of an openstack service which
wasn't in the ENABLED_SERVICES list. This allows more flexible lifecycle
management of openstack services in the gate, which is useful for tests
which test components which are not in the "default configuration" (e.g.
the "nova-serialproxy" service).

The `clean.sh` script purges all traces of systemd user unit files created
by devstack.

Change-Id: I0f7e1ee8723f4de47cbc56b727182f90a2b32bfb
2017-06-14 14:29:39 +10:00
Boris Pavlovic
2b6e9ac471 Improve OpenStack performance by redcuing bcrypt hasing rounds number
Reduce bcrypt hashing rounds from 12 to 4 (minimal possilbe).

This is going to imporve a lot of perforamcne of OpenStack.

Bcrypt is hashing algorithm that is designed to use a lot of resources and
in that way stops brutforce attacks. It's exponential algorithm that depends
on amount of rounds. By default they use 12 rounds which is quite high value,
good enough for real secure production enviorments.

In case of DevStack it's going to slow down all authentication by many times.
Rally shows about 5 times slownest (adding 2-5 seconds to every authenticate)
DevStack is meant for developemnt & CI so performance is way more important than
security.

Change-Id: Id8c763d63cb91f37a774f9400f35c309f37d6f12
2017-06-13 18:33:28 +00:00
Jenkins
f4b4a79979 Merge "XenAPI: Move dom0 related operations to os-xenapi devstack plugin" 2017-06-13 13:56:12 +00:00
Jenkins
e403cd3c00 Merge "nova: fix usage of scheduler_driver config option" 2017-06-13 08:40:58 +00:00
Clark Boylan
f266a2dc81 Install test-requirements with main install
To reduce the total number of invocations necessary for pip which isn't
the quickest thing ever (due to needing to evaluate constraints and deps
lists and what is currently installed) combine the main installation of
software with its test-requirements.txt file which should roughly halve
our pip invocations.

Change-Id: Ibcc3264136e66d34a879ad1c90a62e1bb6a84243
2017-06-12 14:57:59 -07:00
Lance Bragstad
dcd4b64c99 Increase KEYSTONE_LOCKOUT_DURATION to 10
Transient failures were being reported because the current lockout
period for users was too short. While this does increase the
run time IdentityV3UsersTest.test_user_account_lockout, it
allows for more flexibility if there is network latency or some
other factor that cause the lockout to expired before the
next authentication.

Change-Id: I61bc39bbc35ac414b4a72929a90845956c99eb1a
Closes-Bug: 1693917
2017-06-12 14:41:42 +00:00
Jenkins
9234316794 Merge "Make use of Ubuntu Cloud Archive switchable" 2017-06-09 01:55:36 +00:00
Huan Xie
f15fd26943 XenAPI: Move dom0 related operations to os-xenapi devstack plugin
When installing OpenStack via DevStack on XenServer, we need to
some preparation operations in dom0 which will refer the function
in devstack/tools/xen/functions file, but we are planning to move
the whole folder of tools/xen from devstack to os-xenapi, so it
this patch is to moving the dom0 related operation to os-xenapi
repo first.

Change-Id: Ib59d802a7a4eab4ccce0e29d80f29efa4655bc0b
Depends-On: I712ee74ce945859ba5118e09b7d9436ca2686cb7
2017-06-07 22:02:56 -07:00
Jenkins
1ca22d50b0 Merge "Don't treat service as enabled if in disabled list" 2017-06-07 22:02:53 +00:00
Jenkins
986da6428d Merge "Updated from generate-devstack-plugins-list" 2017-06-07 18:43:12 +00:00
Clark Boylan
902158bb8f Don't treat service as enabled if in disabled list
The old implementation for is_$service_enabled simply checked if any of
the subservices were enabled and if so the service was considered to be
enabled. This makes disabling services complicated as it means you have
to list every single subservice which can and do change over time.

Instead also check if the generic service name is in the disabled
services list and if so don't treat the service as enabled.

Change-Id: I7fe4dfca2cd9c15069d50a04161a29c5638291cb
2017-06-07 17:23:38 +00:00
Matt Riedemann
886d7dbe12 nova: fix usage of scheduler_driver config option
The scheduler_driver option has been moved and deprecated. This
change uses the new group and name for the option.

Change-Id: I27aeff5911510c9f47191acaa0c0b5b71f977cd7
2017-06-07 10:52:20 -04:00
Jenkins
3742b14622 Merge "Change "files" directory in etcd project" 2017-06-07 13:33:58 +00:00
OpenStack Proposal Bot
a40e036d80 Updated from generate-devstack-plugins-list
Change-Id: I5980980fe5071a781b5b95efd69f479359f8ee6e
2017-06-07 08:24:31 +00:00
Dirk Mueller
bbf14db3a7 Remove temporary openSUSE-42.2 workaround
We required initially 42.2 test updates to be enabled as the
liberasurecode-devel update wasn't released. It is now released
so we can stop pulling that part in.

Change-Id: I4e514e317da8a95809593a49c6dce619bc4c021f
2017-06-06 23:29:41 +02:00
Jenkins
4bca739576 Merge "Use correct argument order in truorfalse for USE_JOURNAL" 2017-06-06 13:24:32 +00:00
Jenkins
bc8d7ef89e Merge "Start placement before services that might like to use it" 2017-06-06 00:01:06 +00:00
Jenkins
64d20857ed Merge "Enable opensuse-42.2 as a tested distro" 2017-06-05 23:56:45 +00:00
Jenkins
c639fc4302 Merge "Fix configuration link syntax error" 2017-06-05 22:01:24 +00:00
Matt Riedemann
aefc926cd4 Support installing os-traits from git
This will be used in a src job for running os-traits changes
in a dsvm/tempest setup.

Change-Id: I3c4433fb1ca2787e96b577a15d584b625c364ef3
2017-06-05 20:45:43 +00:00
Jenkins
adabee29f6 Merge "Don't run and check c-api if it is disabled" 2017-06-05 20:22:10 +00:00
Jenkins
e1a2448970 Merge "Expose etcd port as a variable" 2017-06-05 18:28:11 +00:00
Dirk Mueller
e61e19ee82 Enable opensuse-42.2 as a tested distro
openSUSE 42.2 passes testing on the experimental gate and
in order to add it as continuosly tested target we need to
add it to the positive list of tested distributions.

Change-Id: I46f94cfad828534f324994c3d21bddff40e8f9a2
2017-06-05 19:28:30 +02:00
Clark Boylan
e28db4c2f2 Set swift functest config when using tls
Because the swift functests (which use test.conf) run out of a
virtualenv they don't get access to the system wide trust of the
devstack CA. Handle this by explicitly configuring the cafile to trust
in the test.conf file.

We also set the web_front_end to apache2 as that is what is terminating
TLS for us. The tests handle different web server behaviors using this
flag.

Swift's functests will need to read these values in and properly
configure things on its end.

Change-Id: I4cdba36ccab6acd76205184882ee29e4f1e12333
2017-06-05 09:21:46 -07:00
Chris Dent
7a74c2ab24 Start placement before services that might like to use it
Otherwise those services, notably n-cpu, will try to register
resource providers before placement is ready.

Change-Id: I89fd4fa42baf3d19ee209c59cd85b97adb97c58b
Closes-Bug: #1695634
2017-06-05 16:18:46 +00:00
Matt Riedemann
1ade00da55 Fix scheduler_default_filters usage
The scheduler_default_filters config option moved out of the
DEFAULT option group into a more specific group, and the old
option is deprecated as a result so we need to update our usage.

Change-Id: I5d6574d19c3f16abadddb19f34cb645dcdcc07f4
2017-06-05 11:01:45 -04:00
Jenkins
dc9ef55fc6 Merge "Make stack.sh work on SUSE" 2017-05-31 20:48:10 +00:00
Jenkins
a718b5ea92 Merge "Use proper python when configuring certs" 2017-05-31 19:59:59 +00:00
Rodolfo Alonso Hernandez
6f962a2ee5 Change "files" directory in etcd project
Function "_install_etcd" is trying to use "files" directory
to download a file. Instead of this, this directory should be
$FILES, which is defined previously in parent script.

TrivialFix
Change-Id: I643ce3b9aba1f65f03524430c748bf120d071509
2017-05-31 13:36:22 +01:00
Jenkins
86f9bc7b0b Merge "Add global_request_id to systemd logs" 2017-05-31 12:29:52 +00:00
Jenkins
b3ced44e37 Merge "Configure volume_clear setting per backend" 2017-05-31 05:14:58 +00:00