309 Commits

Author SHA1 Message Date
Jenkins
9a69a1abfc Merge "If plugin is enabled multiple times fail" 2016-11-29 23:45:09 +00:00
Jenkins
f5e78b6fb6 Merge "Allow provider network to be used for ssh validation" 2016-11-28 10:28:47 +00:00
Jenkins
4d61ed5c77 Merge "Pass branch parameter to git clone" 2016-11-28 10:06:24 +00:00
Attila Fazekas
bcaadd63d8 Apache reload issue when it is stopped
Since 4b49e409f853104dae021dfca1a9342ec9ac4709 devstack
started to use reload instead of restart.

Using reload in devstack for a fresh install,
does not makes too much sense unless multiple service
plugin touches the same service configs.

Systemd rejects to reload something,
which was not loaded before.

 $ sudo /bin/systemctl reload httpd
 httpd.service is not active, cannot reload.

We will switch to `reload-or-restart` action instead of `reload`,
it is more likely the action what the previous patch wanted.

Change-Id: I70d597fbe4a8923d937ba8432e29edefb27d1058
2016-11-23 13:20:33 +01:00
Jakub Wachowski
90742fc1be Pass branch parameter to git clone
Without this parameter, when we set GIT_DEPTH,
it may happen that we clone only master and
then cannot checkout branch

Change-Id: I39376914f8bfc286a308c99db6bc92cddab195b5
2016-11-21 07:42:50 +00:00
Michael Turek
7938d83d3b Allow provider network to be used for ssh validation
Currently devstack assumes that the network used for ssh
validation is the private network. This patch adds a hook that
sets the network used for ssh validation based on whether or not
provider networking is being used. It also moves the function
'is_provider_network' into functions-common as it will now be
used by both tempest and neutron.

Change-Id: I265c9e26c9bfb18b7e201f27d8912b8bec235872
2016-11-17 13:40:01 -05:00
Gary W. Smith
56b3912685 Use -y on zypper remove to avoid hanging
When using zypper remove, include the -y option to avoid stack.sh from
hanging waiting for user confirmation.  Due to output buffering, the
script could hang before giving the user the prompt to enter Y to
continue, making it unclear why the script was hanging.

Change-Id: I5ea761e5ae0829439953c385f8e7d0546acba886
Closes-Bug: 1642736
2016-11-16 22:10:37 -08:00
John L. Villalovos
21d84c29b2 If plugin is enabled multiple times fail
When using the enable_plugin command and grenade jobs it can be
easy to enable the same plugin twice, as the grenade job has a
registration section and the configuration in project-config can also
enable it due to code-reuse in project-config.

If a plugin is enabled twice it will likely fail, though it won't be
obvious that it was due to the plugin being enabled multiple times.

This change makes it so if it sees the same plugin name is enabled
more than once it will die and an error message outputted.

Change-Id: I9f1d7e58b861b04473b6a57c9ad404203fb7277a
2016-11-16 08:55:40 -08:00
Jenkins
ac65a5cac0 Merge "yum_install: fix awk return code" 2016-11-15 01:35:44 +00:00
Mike Perez
c271b3ea1f Update OpenStackClient role list commands
This command is deprecated. The new command is role assignment list.

Change-Id: I8dba0be21d5af6751bea13d8ff29cd4b7589ab3e
2016-10-03 16:50:27 -07:00
Ian Cordasco
69e3c0aac9 Update certificate creation for urllib3
urllib3 1.18 was released today and contains new more correct hostname
matching that takes into account the ipAddress portion of a certificate
and disallows matching an IP Address against a DNS hostname.

Change-Id: I37d247b68911dc85f55adec6a7952ed321c1b1d8
2016-09-26 12:21:41 -07:00
Ian Wienand
a4705403aa yum_install: fix awk return code
TIL:

  Similarly, all the END rules are merged, and executed when all the
  input is exhausted (or when an exit statement is executed).

i.e. matching YUM_FAILED calls "exit", which falls through to the END
rules which calls "exit result" ... which is zero.  i.e. if the return
code is 1 then we actually hide that and return with zero.

This is rather annoying because errors that should halt to alert us of
a package install failure pass through, only for you to have to debug
much later on seemingly unrelated problems.

This always sets "result" and thus should be returning the right
thing.  I've updated the documentation to hopefully make it clearer
what's going on.

Change-Id: Ia15b7dc55efb8d3e3e945241b67a468b8a914672
2016-09-23 15:44:57 +10:00
Gregory Haynes
4b49e409f8 Use apache for tls-proxy ssl termination
Stud is now abandonware (see https://github.com/bumptech/stud) and is
not packaged in xenial. Lets use Apache for SSL termination since its
there already.

Change-Id: Ifcba410f5969521e8b3d30f02795541c1661f83a
2016-09-20 08:14:11 -07:00
Jenkins
a270f5e242 Merge "Remove lib/ceph" 2016-08-31 20:14:49 +00:00
Sean Dague
a25ae6c03d convert apache logs to color for screen
If we left the ansi color codes in apache logs, we can run a sed
script to convert the escaped escapes back to ansi escapes which make
the logs colorized again.

There are 8 \ because we need to end up with 2 in the final sed, and
we get interopolated twice. How much fun is escape interpolation? All
the fun.

Change-Id: Id8531cf03ba80f0df62f20add02e757bd63d4f2d
2016-08-31 08:56:37 -04:00
Matt Riedemann
c9f6327844 Remove lib/ceph
All jobs using ceph as a storage backend have been moved over
to using the devstack-plugin-ceph repo in project-config so we
should be safe to remove the now unused lib/ceph file.

The files are left in place because the devstack plugin does not
install xfsprogs but it's used by the create_disk function.

And the ceph cinder backend file is left in place since the
devstack-plugin-ceph repo uses that by setting
CINDER_ENABLED_BACKENDS=${CINDER_ENABLED_BACKENDS:-ceph}.

Change-Id: I3fb09fc92bc6ab614e86d701ea46d5741a76b7a8
2016-08-30 17:21:30 -04:00
Rob Crittenden
38245da0b8 Fix typo in local variable name in time_stop
This didn't break functionality but it would use a global instead
of a local variable so nested calls to time_* might have issues.

Change-Id: If61ef07c4ce15f1a356975a0b0611fdf5e49109a
2016-05-26 17:55:14 -04:00
Kashyap Chamarthy
247e44625c functions-common: Use systemctl when applicable
We live in a new systemd world, use the native commands to talk to it
if available.

Change-Id: Iccdc35f0c9da2997f9e672bc1d24ca15d3403d98
2016-05-24 11:21:01 -04:00
Jenkins
1df67b9dd8 Merge "Added RHEL rebuild ScientificLinux to supported distributions" 2016-05-20 13:46:35 +00:00
John Kasperski
7b3ae53328 Update is_service_enabled
The nova check in is_service_enabled() is loading the nova repo
when ENABLED_SERVICES=ovn-northd.  Add a comma before each of the
checks to prevent this error with any of the other services.

Change-Id: I9deee735812cde44ea5140b1ad76848f02576609
Closes-Bug: #1574431
2016-04-27 12:13:16 -05:00
Mike Trimm
1da4e790eb Added RHEL rebuild ScientificLinux to supported distributions
Change-Id: I8b3844bf28b11254e7cc9a96126bd66efbd1212e
2016-04-27 11:40:25 -05:00
Matt Riedemann
ae4578bed9 Revert "Don't check for existing endpoints"
This reverts commit 7d1ec430046256ac3f536f4920a43936e28ef0c4.

This broke the sahara and layer4 dsvm jobs. The layer4 job
is voting on tempest changes so tempest is also broken.

Change-Id: Ide69f10cd85bf7ff0d86bc8cba56dedd26850362
Partial-Bug: #1573868
2016-04-23 01:45:40 +00:00
Sean Dague
7d1ec43004 Don't check for existing endpoints
We really should only have code that create endpoints once, making all
osc calls get_or_set adds 3 seconds per call for no really good
reason.

This also stops creating the internal endpoints in the service
catalog. It's a pattern that we're trying not to propogate, so lets
not have it in devstack any more.

Change-Id: Ia8cefe43753900d62117beae330db46deb6a9fc9
2016-04-22 10:44:10 -04:00
Jenkins
54f331969f Merge "remove clouds.yaml in clean.sh" 2016-04-21 20:01:54 +00:00
Jamie Lennox
cbcbd8f33c Allow putting service users in a seperate domain
Make it possible to construct the service users in their own seperate
domain. Changing this away from Default will not work for everyone yet,
though it does work for basic service interaction however enabling it
will allow us to start testing and hopefully gating that services aren't
relying on v2 only concepts.

Change-Id: I7e73df5dd1caabf355783da2bc0f3007ade92fba
2016-04-18 09:59:52 +10:00
ZhiQiang Fan
0b4a009e56 remove clouds.yaml in clean.sh
devstack failed to install because glance:
Could not determine a suitable URL for the plugin

patch I618ea8e27b49af360c905df85af06d9b1eef8407 tries
to fix this problem, but with a wrong way because path is not
correct, the clouds.yaml is not under /path/to/devstack/~/.config/openstack/
but ~/.config/openstack.

patch I8af6bd465f74099c560dddba6b5221dd79cbc965 tries to
fix this problem, but with a worng way to specify the path,
~$STACK_USER/.config/openstack/clouds.yaml will not expand with
a variable, only const string can.

$ whoami
zqfan
$ touch ~/.config/openstack/clouds.yaml
$ export STACK_USER=zqfan
$ rm -rf ~$STACK_USER/.config/openstack/clouds.yaml
$ ls ~/.config/openstack/
clouds.yaml

Change-Id: I549817d2f4638be615991c1726b39d270ba71357
ref: I618ea8e27b49af360c905df85af06d9b1eef8407
2016-04-15 02:27:35 +08:00
Fernando Ribeiro
4e6f8ca670 Add installation support for Oracle Linux 7
This removes Oracle Linux 6 support ("OracleLinux") which, like RHEL6,
is now unsupported.  "OracleServer" matches Oracle Linux 7.

Change-Id: I35b1c7d0b103c509283dba0f6551453e7d8ac4cc
Closes-Bug: #1568634
2016-04-14 07:14:04 +10:00
Ian Wienand
908a3a9523 Add total timings
Printing the total makes it easier to compare runs at a glance.  Clean
up the output a little, and use some consistent, name-spaced globals
while we're there.

Note the total runtime is at the top to avoid giving the impression
that it is the sum of the components below, since you can nest/overlap
timers (I made that mistake in a prior change :).  It might be a fun
exercise in tree building to one day track the overlaps and present a
nice nested breakdown.

Change-Id: I878ce03813d21138df493b82bceff3aaa7f83064
2016-03-30 19:49:13 +00:00
Jenkins
467dbf7703 Merge "Fix RHEL7 vendor detection" 2016-03-18 20:23:53 +00:00
Jenkins
a4d67cd033 Merge "yum_install_package: fix errexit and retry" 2016-03-18 20:22:59 +00:00
tengqm
78d3739dbe Fix RHEL7 vendor detection
When detecting os_VENDOR, the lsb_release output may be different
from what is expected today. This patch fixes the detection.

Change-Id: I850ad1acbc2397c73e7cc85c1765cba6ba2f98d4
2016-03-15 23:08:00 -04:00
Jenkins
082399ef18 Merge "Remove rejoin-stack.sh" 2016-03-14 18:55:23 +00:00
Jenkins
fa3cc77aee Merge "Use "command -v" instead of "which" to find path" 2016-03-11 00:55:25 +00:00
Jenkins
73af0de40c Merge "Ignore errors when uninstalling a pkg with zypper" 2016-03-11 00:55:17 +00:00
Jenkins
b57ec243c9 Merge "Also detected failed packages in dnf/yum wrapper" 2016-03-11 00:55:08 +00:00
Dean Troyer
9ba49cd826 Remove rejoin-stack.sh
This command has never completely worked to restart DevStack.
It periodically prompts attempts to work around this brokenness
in ways that harm other functions.  Let's finally remove it.

Requiring a complete re-run of DevStack after a reboot has always
been intentional.

TODO: follow-up cleaning all of the screen hackage if this merges.

Change-Id: I2f61bb69cc110468a91dcaa4ee7653ede7048467
2016-03-10 15:48:13 -06:00
Jenkins
61ba1b3353 Merge "Add some notes on DISTRO setting" 2016-03-07 14:30:31 +00:00
Jenkins
c72f8d318f Merge "Introduce Virtuozzo distribution" 2016-03-07 14:09:03 +00:00
Thomas Bechtold
c15d59157c Ignore errors when uninstalling a pkg with zypper
I.e. when trying to uninstall python-pip and it's not installed,
don't exit.

Change-Id: I21ac715a0090ad01811af47f23c61823dfa65629
2016-03-04 16:06:24 +01:00
Thomas Bechtold
dab3901d9a Use "command -v" instead of "which" to find path
If /usr/bin/which is not available, the current code
doesn't detect i.e. /usr/bin/zypper . Using "command -v" solved
the problem.

Change-Id: I1c281c3184d69cd9dc2418295b6a392d8e5693e0
2016-03-04 09:14:04 +01:00
Jenkins
ba71f0ead7 Merge "Fix is_suse() check for openSUSE distros" 2016-03-04 01:48:10 +00:00
Evgeny Antyshev
718512c4d2 Introduce Virtuozzo distribution
Virtuozzo is a RHEL-based distribution serving as a platform OS
to host proprietary container virtualization
(formerly, Parallels Cloud Server).

We moved away from CloudLinux distribution, which has actually
no support in Devstack (no such clause in is_fedora).
As it was us who introduced CloudLinux, by this patch
we replace it with Virtuozzo distribution.

More info on Virtuozzo company here: http://virtuozzo.com

Change-Id: Ib8a77e4611ebc05bc0aa50bb83ab79c412e21c74
2016-03-03 14:56:59 +00:00
Thomas Bechtold
899dfeef46 Fix lsb installation for SUSE
zypper has a "-n" (non-interactive) switch. "-y" is not known
as a global option.

Change-Id: I6537529e91c12c5f0d15a9faa2cca8aedaf7d956
2016-03-03 11:27:53 +01:00
Ralf Haferkamp
37dddb73fd Fix is_suse() check for openSUSE distros
We need to do a substring match on the vendor here. As most releases return
"openSUSE project" for the vendor.

Change-Id: Ia05db8d93b5e3f42cb6a9c8d77616ca9f7c32039
2016-03-02 15:34:06 +01:00
Ian Wienand
1b1cc8c1d4 yum_install_package: fix errexit and retry
Since I93e9f312a94aeb086925e069a83ec1d3d3419423 yum_install isn't safe
under errexit.  This means it really only works when called by
tools/install_prereqs.sh because for some reason, we don't set that
there.

However, there is a problem with the retry logic when detecting failed
installs.  A failed package install should stop further progress, but
with the current retry logic it just goes ahead and retries the
installation, which then incorrectly passes.  You can see this
happening in a test like [1].

In our detection scripts, make a failed package or missing packages
exit with error-code 2, and "die" when we see this to correctly stop.

[1] http://logs.openstack.org/81/285881/1/check/gate-tempest-dsvm-platform-fedora23-nv/a83be30/logs/devstacklog.txt.gz

Change-Id: I4ea5515fa8e82a66aefa3ec3a48b823b645274f7
2016-03-01 13:14:39 +11:00
Ian Wienand
3c60168532 Also detected failed packages in dnf/yum wrapper
As seen in [1]; dnf can output a "Failed:" section when installation
issues with a package are detected.  This does not, however, trigger
an exit failure code when running with "-y".  So add this to our
checking wrapper.

[1] http://logs.openstack.org/49/280449/1/check/gate-tempest-dsvm-platform-fedora23-nv/dc70ca8/logs/devstacklog.txt.gz#_2016-02-28_22_42_45_145

Change-Id: I12f7b3bc9e9cf5a97114082d3a634a42742843d5
2016-02-29 15:15:39 +11:00
Jenkins
c3c91c4267 Merge "Minor fixes for bashate trunk" 2016-02-24 20:04:55 +00:00
Jenkins
a91d7d8d05 Merge "Ironic: Update is_ironic_hardware function" 2016-02-24 19:40:46 +00:00
Ian Wienand
1ff75ff87f Always strip package comments
In the "I can't believe I missed this" category -- the existing strip
method removes shortest match (%); which fails when you put another #
in the comment (like "refer to bug#1234").  Change to the longest
match which should strip everything from the first "#" to the end
(since that's going to be the longest).

Change-Id: I47f5e710ebd87b0f54549732e7d64cf42c7a6b65
2016-02-19 14:39:45 +11:00
Lucas Alvares Gomes
8a4dea24fa Ironic: Update is_ironic_hardware function
The DevStack module of Ironic added a new configuration variable called
IRONIC_IS_HARDWARE that can be set to True/False to indicate that we are
setting up devstack to deploy physical or virtual machines (see the
depends flag). Prior to that, the devstack code assumed that if the
driver name loaded is != *_ssh then it's a physical hardware but now we
need to kill this assumption because we have means (see the virtualbmc
utility) to test drivers such as pxe_ipmitool and agent_ipmitool using
virtual machines.

Depends-On: I5edc51c7fc8b6f0bb7fe4ca129596709a32eb93e
Related-Bug: #1544642
Change-Id: I8b6363bbe280ddd2720c570851bc40e2804a40e2
2016-02-18 15:58:32 +00:00