1108 Commits

Author SHA1 Message Date
Jenkins
3f52e5ef74 Merge "Default RABBIT_HOST to be the SERVICE_HOST." 2014-04-09 10:32:31 +00:00
Jenkins
995e10cbf7 Merge "Makes error message easier to understand." 2014-04-03 13:02:43 +00:00
Bob Ball
e309e5a9f8 Default RABBIT_HOST to be the SERVICE_HOST.
Using localhost for RABBIT_HOST can cause problems - particularly
on systems where IPv6 is partially broken and localhost resolves
to an IPv6 address.

The service should logically be running on SERVICE_HOST unless
otherwise overridden.

Change-Id: I6efb71b8b95174770066f38403d5d428ec88c3b6
2014-04-01 16:28:36 +01:00
James E. Blair
e8d840668e Add memory usage to dstat output
Adds used, buffers, cache, free values next to the CPU usage.

Change-Id: Ia873e6a5e78413b724464985b253149bc7e9e2d8
2014-03-26 08:19:37 -07:00
James E. Blair
7ee8f11588 Add iops to dstat output
The "-r" option adds io request counts.  They are placed next to
the currently present io throughput columns.

Change-Id: I7b4c6f3608afb3714bc997bb4ba005c00eeab61e
2014-03-26 07:56:56 -07:00
Dean Troyer
a3935fb0ad Skip child process kills in stack.sh exit trap
Logs are still being cut off in certain circumstances, almost certainly
because the awk process handling the output for verbose logging to a file
dies/is killed early.

Don't kill child processes in the EXIT trap function in this specific case.

Change-Id: I89600b61d59f87e93ff959710d0169e49d2c9845
2014-03-21 13:02:26 -05:00
Jenkins
26e57cbb4c Merge "Allow sudo access without a controlling terminal" 2014-03-21 14:54:21 +00:00
Jenkins
871b1e4709 Merge "Update stack.sh to use openstackclient commands" 2014-03-18 14:32:49 +00:00
Jenkins
5d4406c56d Merge "Complete moving Keystone setup out of keystone_data.sh" 2014-03-18 05:46:48 +00:00
Adam Gandelman
ea2fcb5538 Allow sudo access without a controlling terminal
Ironic setup uses some external scripts that use sudo but they
are not called with a TTY.  This patch allows STACK_USER sudo
access without a controlling terminal.

Change-Id: I0c60fcd5d8418738405d4dd9d08fdf5c8f766829
2014-03-17 16:37:56 -07:00
Steve Martinelli
df6793a86e Update stack.sh to use openstackclient commands
There were a few instances of keystoneclient still being used,
these were replaced with their openstackclient equivalent.

Change-Id: I47fb7cf949b9ab054b97ae387ecbc6d7070fa9c3
2014-03-17 12:56:53 -05:00
Sean Dague
7afffa6447 change the order of the print/flush
It seems that we get a different behavior whether stdout is closed
in the parent process or not when it comes to buffering. If it's
closed we don't get the last line flushed out to the file, if it's
not closed we do. This was seen in the trove pg fail.

A complete shot in the dark, but I'd like to see if this is fixed
with being explicit with printing to the log before stdout.

Change-Id: Ie37299dbc88d549d34d85731e571a5b7ef181311
2014-03-15 13:50:36 -04:00
Jenkins
f10d8feca0 Merge "Clarify deprecation of EXTRA_xxx_OPTS" 2014-03-15 12:37:17 +00:00
Dean Troyer
1a0c090057 Additional attempts to flosh stdout/stderr
The logfile output is piped through awk to apply a timestamp
and filter out all of the xtrace commands in the xtrace output.

A while back we added fflush("") which is supposed to flush all
open output files and pipes. It appears that gawk in precise
is old enough that it may only flush stdout, so explicitly
flush the logfile handle.

Change-Id: If5198c2da2a3278eed8ae3d50c7ca5c15eac6d94
2014-03-12 14:59:53 -05:00
Newell Jensen
ccb3d10e04 Makes error message easier to understand.
If the host ip address is indeterminate while executing
stack.sh, an error message is displayed.  This error message
could be a source of confusion since it references localrc,
which is depreciated.

This patch makes the error message clearer and easier to
understand.  It does this by taking out the reference to
localrc.  It also points the user towards local.conf where there
are suggestions on how to set HOST_IP.

Change-Id: I41f14a2de85449d2a08ab7eb2849844a1087b147
Closes-Bug: #1290556
2014-03-10 18:59:07 -07:00
Dean Troyer
42a59c2bfa Complete moving Keystone setup out of keystone_data.sh
* Move remaining role creation to create_keystone_accounts()
* Move glance creation to create_glance_accounts()
* Move nova/ec2/s3 creation to create_nova_accounts()
* Move ceilometer creation to create_ceilometer_accounts()
* Move tempest creation to create_tempest_accounts()
* Convert moved code to use OpenStackClient for setup
* files/keystone_data.sh is removed

Note that the SERVICE_TENANT and ADMIN_ROLE lookups in the other service
implementations are not necessary with OSC, all operations can be done
using names rather than requiring IDs.

Change-Id: I4283ca0036ae39fd44ed2eed834b69d78e4f8257
2014-03-10 15:17:30 -05:00
Sean Dague
d9259ea466 remove distros that are out of support by their upstream
raring EOL was - 27 Jan 2014
f18 EOL was - 14 Jan 2014
opensuse 12.2 was - 15 Jan 2014

if their upstream isn't going to support them, we shouldn't be
in devstack.

this additionally leaves us in an interesting situation that there
is no longer *any* opensuse version listed as supported. if the
opensuse community doesn't step up here we should probably look
at removing it.

Change-Id: Ibb883930b430477dfd3b5126c5db04f95a50d3a7
2014-03-10 08:39:15 -04:00
Jenkins
0dfbf9b4b9 Merge "Close all logging file descriptors" 2014-03-08 19:09:50 +00:00
Jenkins
82660c6914 Merge "Move heat keystone setup into lib/heat" 2014-03-06 20:54:19 +00:00
Dean Troyer
8068455a02 Close all logging file descriptors
This has lingered for a long time, finally do something about it...

Change-Id: Ib90408187698d5d4c23ffb0e527011446efc3c7e
2014-03-05 11:51:04 -06:00
Jenkins
6751ed504c Merge "Remove bm_poseur, unmaintained and obsolete" 2014-03-04 00:57:01 +00:00
Steven Hardy
57d478d874 Move heat keystone setup into lib/heat
Move the heat setup which currently happens in files/keystone_data.sh
to lib/heat, where we have create_heat_accounts.

Move the user, role, service and endpoint creation as that is consistent
with what other services, e.g lib/nova are doing.

Change-Id: Iaa2c822cad581d6b2b4f22f8863daf81e25f8485
2014-03-03 18:18:28 +00:00
Dean Troyer
91baef3e26 Clarify deprecation of EXTRA_xxx_OPTS
The various EXTRA_xxx_OPTS variables will be removed in the Juno
development cycle, change the README to reflect the new way for
the Neutron variables.

Change-Id: Ic84da4a9b5a83e66cf0b57d643a87691f15517f0
2014-03-03 10:46:42 -06:00
Jenkins
9bd5b9399a Merge "Preinstall yum-utils; move sudo check before install" 2014-02-28 23:12:47 +00:00
Eric Windisch
e994f5708d Remove bm_poseur, unmaintained and obsolete
The bm_poseur git repository link has been broken
for over 11 months. The virtualized/fake baremetal
environment is not working and has not worked in a
long time. Now, on the tail of enabling 'enable -o errexit',
this functionality now has a hard break.

Change-Id: I3cbd8db58c422bc5273d2433278aaa5e449ecfd9
Closes-Bug: 1285954
2014-02-28 15:21:38 -05:00
Jenkins
dad6e4114d Merge "Enforce function declaration format in bash8" 2014-02-28 06:32:20 +00:00
Jenkins
5caa58459d Merge "Fix exit_trap() error if no child processes" 2014-02-28 01:50:06 +00:00
Jenkins
5f9d3980fc Merge "Set umask" 2014-02-28 01:43:31 +00:00
Ian Wienand
531aeb7900 Preinstall yum-utils; move sudo check before install
Some cloud images don't have yum-utils installed, so the call to
yum-config-manager fails.  Pre-install it (I still think it's easier
than fiddling config files).

Also, these repo setup steps are using sudo, but the root/sudo checks
happen after this.  Move them up before we start trying to do
repo/package installs.

Change-Id: I875e1f0663c9badc00278b2cc1a3b04ca3dde9fc
2014-02-28 11:24:29 +11:00
Ian Wienand
aee18c749b Enforce function declaration format in bash8
Check that function calls look like ^function foo {$ in bash8, and fix
all existing failures of that check.  Add a note to HACKING.rst

Change-Id: Ic19eecb39e0b20273d1bcd551a42fe400d54e938
2014-02-28 07:59:03 +11:00
Dean Troyer
94b9e82039 Fix exit_trap() error if no child processes
Bug-Id: 1285776
Change-Id: Iad7a9f2c03cc39159beda55345f232cefed10520
2014-02-27 11:14:05 -06:00
Jenkins
0ed4af02da Merge "enable -o errexit" 2014-02-27 14:57:43 +00:00
Sean Dague
09bd7c8fd5 enable -o errexit
devstack should run under -o errexit to ensure that we fail early
when something has gone wrong, otherwise determination of the root
failure location is often quite challenging.

this clears all the normal use cases for devstack, there could be
tests which now die early, which we're going to have to check for
later.

Change-Id: Ibd828c4f4fd95a60d3918d3d7ae90e10649479ab
2014-02-27 06:30:37 -05:00
Jenkins
df43b5c828 Merge "Run yum repolist commands as root" 2014-02-27 04:31:24 +00:00
Jenkins
db5a80171f Merge "Unbuffer log output" 2014-02-27 00:39:32 +00:00
Dean Troyer
a25a6f6d80 Unbuffer log output
* Force-flush log output so we don't lose log output in certain error cases.
* Slow down exit paths: add sleep to die(), wait until last moment to
  kill child processes (including the awk log output filter)

Change-Id: I1620fd33b89b237d9c2bb6206f3de2c81719f676
2014-02-26 13:17:36 -06:00
Jenkins
1c10bb3737 Merge "Move enablement of rhel6-optional repo earlier" 2014-02-26 19:04:11 +00:00
Jenkins
339ec17731 Merge "remove sysstat & pidstat" 2014-02-26 02:38:30 +00:00
Ian Wienand
3e37326a35 Move enablement of rhel6-optional repo earlier
Change 4f1fee6eae300a3384900df06ebc857e95854eb0 added the RHEL6
optional repo in fixup_stuff.sh, but it turns out that doesn't get run
until after the package prerequisites phase.  Move this into stack.sh
with the RDO repo setup.

Change-Id: Iae0df85fa94c6c1b6f497dd29fda90d03b903a41
2014-02-26 13:34:18 +11:00
Ian Wienand
2a6f1bd99b Run yum repolist commands as root
Otherwise you get yum errors like [1] when you run stack.sh as !root.
The solution is to run yum commands as root so it can access the right
certs

[1] https://access.redhat.com/site/solutions/312413

Change-Id: I54b0df13508c50aba67e23da11953c536933917a
2014-02-26 11:16:09 +11:00
Jenkins
b17fecf7d8 Merge "xtrace less" 2014-02-25 16:51:40 +00:00
Sean Dague
78096b5073 remove sysstat & pidstat
dstat is far cleaner for getting results out of the environment,
and covers the bulk of our use cases for sysstat and pidstat with
a much better ui.

devstack is allowed to be opinionated, so become opinionated here.

Change-Id: I21ec96339dcd704098512fdafd896738f352962d
2014-02-25 10:30:31 -05:00
Sean Dague
45917cc4d9 xtrace less
we are xtrace happy, however that's just generating bulk in log
files that are mostly ignorable. For the basically bullet proof
functions we should not xtrace.

Change-Id: Iab4e6d270c1546e0db2a06395cefcdf7f7929c3c
2014-02-25 06:25:14 -05:00
Jenkins
7648e9c615 Merge "match devstack-gate format" 2014-02-24 23:20:35 +00:00
Sean Dague
80313b2440 match devstack-gate format
support millisecond resolution and the | separator for ts vs.
content.

everything else in openstack is running at millisecond resolution,
and some times it's actually useful to see that when debugging
gate failures.

Change-Id: I2227ab0b4965cd1a24b579bdf2ba8c1f9a432f70
2014-02-24 14:41:20 -05:00
Sean Dague
f1eb0475d9 don't check for service enabled
service enabled is something that's not required for sysstat and
friends, because instead we actually can do this with screen_it.

Change-Id: I4aa5787101cb0def46690f38a7f82effbb85f502
2014-02-24 12:23:22 +00:00
Brett Campbell
27f29440d1 Set umask
Ensure we have a known-good umask.  Otherwise files such as
/etc/polkit-1/rules.d/50-libvirt-$STACK_USER.rules may not be readable
by non-root users afterwards.

Also reworded some comments to be more clear.

Change-Id: I7653d4eee062cf32df22aa158da6269b1aa9a558
Closes-Bug: #1265195
2014-02-19 18:23:16 -08:00
Jenkins
cf3203b6ae Merge "Add support for creating heat stack domain" 2014-02-18 12:08:37 +00:00
Steven Hardy
33d1f86a49 Add support for creating heat stack domain
The Heat instance-users blueprint requires an additional domain
where heat creates projects and users related to stack resources
so add support for creating this domain when configured to install
Heat.  Note a workaround is currently required to make the
openstack command work with the v3 keystone API.

Change-Id: I36157372d85b577952b55481ca5cc42146011a54
2014-02-15 07:45:55 +00:00
Steve Martinelli
19685428e3 Change most keystoneclient commands to openstacklient in libs
migrated most keystoneclient commands from the following libs:
 ceilometer
 cinder
 ironic
 keystone
 marconi
 neutron
 nova
 savanna
 swift
 trove

Also need to set and unset openstackclient specific environment
variables from stack.sh

Change-Id: I725f30bc08e1df5a4c5770576c19ad1ddaeb843a
2014-02-14 21:30:57 -06:00