1101 Commits

Author SHA1 Message Date
Jenkins
26e57cbb4c Merge "Allow sudo access without a controlling terminal" 2014-03-21 14:54:21 +00:00
Jenkins
871b1e4709 Merge "Update stack.sh to use openstackclient commands" 2014-03-18 14:32:49 +00:00
Jenkins
5d4406c56d Merge "Complete moving Keystone setup out of keystone_data.sh" 2014-03-18 05:46:48 +00:00
Adam Gandelman
ea2fcb5538 Allow sudo access without a controlling terminal
Ironic setup uses some external scripts that use sudo but they
are not called with a TTY.  This patch allows STACK_USER sudo
access without a controlling terminal.

Change-Id: I0c60fcd5d8418738405d4dd9d08fdf5c8f766829
2014-03-17 16:37:56 -07:00
Steve Martinelli
df6793a86e Update stack.sh to use openstackclient commands
There were a few instances of keystoneclient still being used,
these were replaced with their openstackclient equivalent.

Change-Id: I47fb7cf949b9ab054b97ae387ecbc6d7070fa9c3
2014-03-17 12:56:53 -05:00
Sean Dague
7afffa6447 change the order of the print/flush
It seems that we get a different behavior whether stdout is closed
in the parent process or not when it comes to buffering. If it's
closed we don't get the last line flushed out to the file, if it's
not closed we do. This was seen in the trove pg fail.

A complete shot in the dark, but I'd like to see if this is fixed
with being explicit with printing to the log before stdout.

Change-Id: Ie37299dbc88d549d34d85731e571a5b7ef181311
2014-03-15 13:50:36 -04:00
Jenkins
f10d8feca0 Merge "Clarify deprecation of EXTRA_xxx_OPTS" 2014-03-15 12:37:17 +00:00
Dean Troyer
1a0c090057 Additional attempts to flosh stdout/stderr
The logfile output is piped through awk to apply a timestamp
and filter out all of the xtrace commands in the xtrace output.

A while back we added fflush("") which is supposed to flush all
open output files and pipes. It appears that gawk in precise
is old enough that it may only flush stdout, so explicitly
flush the logfile handle.

Change-Id: If5198c2da2a3278eed8ae3d50c7ca5c15eac6d94
2014-03-12 14:59:53 -05:00
Dean Troyer
42a59c2bfa Complete moving Keystone setup out of keystone_data.sh
* Move remaining role creation to create_keystone_accounts()
* Move glance creation to create_glance_accounts()
* Move nova/ec2/s3 creation to create_nova_accounts()
* Move ceilometer creation to create_ceilometer_accounts()
* Move tempest creation to create_tempest_accounts()
* Convert moved code to use OpenStackClient for setup
* files/keystone_data.sh is removed

Note that the SERVICE_TENANT and ADMIN_ROLE lookups in the other service
implementations are not necessary with OSC, all operations can be done
using names rather than requiring IDs.

Change-Id: I4283ca0036ae39fd44ed2eed834b69d78e4f8257
2014-03-10 15:17:30 -05:00
Sean Dague
d9259ea466 remove distros that are out of support by their upstream
raring EOL was - 27 Jan 2014
f18 EOL was - 14 Jan 2014
opensuse 12.2 was - 15 Jan 2014

if their upstream isn't going to support them, we shouldn't be
in devstack.

this additionally leaves us in an interesting situation that there
is no longer *any* opensuse version listed as supported. if the
opensuse community doesn't step up here we should probably look
at removing it.

Change-Id: Ibb883930b430477dfd3b5126c5db04f95a50d3a7
2014-03-10 08:39:15 -04:00
Jenkins
0dfbf9b4b9 Merge "Close all logging file descriptors" 2014-03-08 19:09:50 +00:00
Jenkins
82660c6914 Merge "Move heat keystone setup into lib/heat" 2014-03-06 20:54:19 +00:00
Dean Troyer
8068455a02 Close all logging file descriptors
This has lingered for a long time, finally do something about it...

Change-Id: Ib90408187698d5d4c23ffb0e527011446efc3c7e
2014-03-05 11:51:04 -06:00
Jenkins
6751ed504c Merge "Remove bm_poseur, unmaintained and obsolete" 2014-03-04 00:57:01 +00:00
Steven Hardy
57d478d874 Move heat keystone setup into lib/heat
Move the heat setup which currently happens in files/keystone_data.sh
to lib/heat, where we have create_heat_accounts.

Move the user, role, service and endpoint creation as that is consistent
with what other services, e.g lib/nova are doing.

Change-Id: Iaa2c822cad581d6b2b4f22f8863daf81e25f8485
2014-03-03 18:18:28 +00:00
Dean Troyer
91baef3e26 Clarify deprecation of EXTRA_xxx_OPTS
The various EXTRA_xxx_OPTS variables will be removed in the Juno
development cycle, change the README to reflect the new way for
the Neutron variables.

Change-Id: Ic84da4a9b5a83e66cf0b57d643a87691f15517f0
2014-03-03 10:46:42 -06:00
Jenkins
9bd5b9399a Merge "Preinstall yum-utils; move sudo check before install" 2014-02-28 23:12:47 +00:00
Eric Windisch
e994f5708d Remove bm_poseur, unmaintained and obsolete
The bm_poseur git repository link has been broken
for over 11 months. The virtualized/fake baremetal
environment is not working and has not worked in a
long time. Now, on the tail of enabling 'enable -o errexit',
this functionality now has a hard break.

Change-Id: I3cbd8db58c422bc5273d2433278aaa5e449ecfd9
Closes-Bug: 1285954
2014-02-28 15:21:38 -05:00
Jenkins
dad6e4114d Merge "Enforce function declaration format in bash8" 2014-02-28 06:32:20 +00:00
Jenkins
5caa58459d Merge "Fix exit_trap() error if no child processes" 2014-02-28 01:50:06 +00:00
Jenkins
5f9d3980fc Merge "Set umask" 2014-02-28 01:43:31 +00:00
Ian Wienand
531aeb7900 Preinstall yum-utils; move sudo check before install
Some cloud images don't have yum-utils installed, so the call to
yum-config-manager fails.  Pre-install it (I still think it's easier
than fiddling config files).

Also, these repo setup steps are using sudo, but the root/sudo checks
happen after this.  Move them up before we start trying to do
repo/package installs.

Change-Id: I875e1f0663c9badc00278b2cc1a3b04ca3dde9fc
2014-02-28 11:24:29 +11:00
Ian Wienand
aee18c749b Enforce function declaration format in bash8
Check that function calls look like ^function foo {$ in bash8, and fix
all existing failures of that check.  Add a note to HACKING.rst

Change-Id: Ic19eecb39e0b20273d1bcd551a42fe400d54e938
2014-02-28 07:59:03 +11:00
Dean Troyer
94b9e82039 Fix exit_trap() error if no child processes
Bug-Id: 1285776
Change-Id: Iad7a9f2c03cc39159beda55345f232cefed10520
2014-02-27 11:14:05 -06:00
Jenkins
0ed4af02da Merge "enable -o errexit" 2014-02-27 14:57:43 +00:00
Sean Dague
09bd7c8fd5 enable -o errexit
devstack should run under -o errexit to ensure that we fail early
when something has gone wrong, otherwise determination of the root
failure location is often quite challenging.

this clears all the normal use cases for devstack, there could be
tests which now die early, which we're going to have to check for
later.

Change-Id: Ibd828c4f4fd95a60d3918d3d7ae90e10649479ab
2014-02-27 06:30:37 -05:00
Jenkins
df43b5c828 Merge "Run yum repolist commands as root" 2014-02-27 04:31:24 +00:00
Jenkins
db5a80171f Merge "Unbuffer log output" 2014-02-27 00:39:32 +00:00
Dean Troyer
a25a6f6d80 Unbuffer log output
* Force-flush log output so we don't lose log output in certain error cases.
* Slow down exit paths: add sleep to die(), wait until last moment to
  kill child processes (including the awk log output filter)

Change-Id: I1620fd33b89b237d9c2bb6206f3de2c81719f676
2014-02-26 13:17:36 -06:00
Jenkins
1c10bb3737 Merge "Move enablement of rhel6-optional repo earlier" 2014-02-26 19:04:11 +00:00
Jenkins
339ec17731 Merge "remove sysstat & pidstat" 2014-02-26 02:38:30 +00:00
Ian Wienand
3e37326a35 Move enablement of rhel6-optional repo earlier
Change 4f1fee6eae300a3384900df06ebc857e95854eb0 added the RHEL6
optional repo in fixup_stuff.sh, but it turns out that doesn't get run
until after the package prerequisites phase.  Move this into stack.sh
with the RDO repo setup.

Change-Id: Iae0df85fa94c6c1b6f497dd29fda90d03b903a41
2014-02-26 13:34:18 +11:00
Ian Wienand
2a6f1bd99b Run yum repolist commands as root
Otherwise you get yum errors like [1] when you run stack.sh as !root.
The solution is to run yum commands as root so it can access the right
certs

[1] https://access.redhat.com/site/solutions/312413

Change-Id: I54b0df13508c50aba67e23da11953c536933917a
2014-02-26 11:16:09 +11:00
Jenkins
b17fecf7d8 Merge "xtrace less" 2014-02-25 16:51:40 +00:00
Sean Dague
78096b5073 remove sysstat & pidstat
dstat is far cleaner for getting results out of the environment,
and covers the bulk of our use cases for sysstat and pidstat with
a much better ui.

devstack is allowed to be opinionated, so become opinionated here.

Change-Id: I21ec96339dcd704098512fdafd896738f352962d
2014-02-25 10:30:31 -05:00
Sean Dague
45917cc4d9 xtrace less
we are xtrace happy, however that's just generating bulk in log
files that are mostly ignorable. For the basically bullet proof
functions we should not xtrace.

Change-Id: Iab4e6d270c1546e0db2a06395cefcdf7f7929c3c
2014-02-25 06:25:14 -05:00
Jenkins
7648e9c615 Merge "match devstack-gate format" 2014-02-24 23:20:35 +00:00
Sean Dague
80313b2440 match devstack-gate format
support millisecond resolution and the | separator for ts vs.
content.

everything else in openstack is running at millisecond resolution,
and some times it's actually useful to see that when debugging
gate failures.

Change-Id: I2227ab0b4965cd1a24b579bdf2ba8c1f9a432f70
2014-02-24 14:41:20 -05:00
Sean Dague
f1eb0475d9 don't check for service enabled
service enabled is something that's not required for sysstat and
friends, because instead we actually can do this with screen_it.

Change-Id: I4aa5787101cb0def46690f38a7f82effbb85f502
2014-02-24 12:23:22 +00:00
Brett Campbell
27f29440d1 Set umask
Ensure we have a known-good umask.  Otherwise files such as
/etc/polkit-1/rules.d/50-libvirt-$STACK_USER.rules may not be readable
by non-root users afterwards.

Also reworded some comments to be more clear.

Change-Id: I7653d4eee062cf32df22aa158da6269b1aa9a558
Closes-Bug: #1265195
2014-02-19 18:23:16 -08:00
Jenkins
cf3203b6ae Merge "Add support for creating heat stack domain" 2014-02-18 12:08:37 +00:00
Steven Hardy
33d1f86a49 Add support for creating heat stack domain
The Heat instance-users blueprint requires an additional domain
where heat creates projects and users related to stack resources
so add support for creating this domain when configured to install
Heat.  Note a workaround is currently required to make the
openstack command work with the v3 keystone API.

Change-Id: I36157372d85b577952b55481ca5cc42146011a54
2014-02-15 07:45:55 +00:00
Steve Martinelli
19685428e3 Change most keystoneclient commands to openstacklient in libs
migrated most keystoneclient commands from the following libs:
 ceilometer
 cinder
 ironic
 keystone
 marconi
 neutron
 nova
 savanna
 swift
 trove

Also need to set and unset openstackclient specific environment
variables from stack.sh

Change-Id: I725f30bc08e1df5a4c5770576c19ad1ddaeb843a
2014-02-14 21:30:57 -06:00
Jenkins
ea76eb727a Merge "Install glance images before starting Nova" 2014-02-15 02:21:29 +00:00
Steven Hardy
1bcd280027 Don't warn about heat modifying flavors
Since de0898a Heat no longer modifies flavors, so the comment
and output related to modified flavors is no longer needed.

Change-Id: I1007d2ab3387f28b8d7487f450cab4592f2824aa
2014-02-13 15:27:06 +00:00
Jenkins
cc3fcc8c8e Merge "add dstat to see top process info" 2014-02-12 17:27:12 +00:00
Jenkins
7719d4aca8 Merge "Begin is_service_enabled() cleanup" 2014-02-12 07:19:11 +00:00
Sean Dague
062cdaf84c add dstat to see top process info
pidstat data isn't exceptionally useful, it's lots of lines, and
seems to be missing some of the most critical one.

dstat is kind of like sysstat, except the formatting is much better.
It also supports advanced features like the top CPU using process
at every interval.

put this behind the sysstat variable, as we'll probably want to
replace sysstat & pidstat with this if it works

Change-Id: I48dc22a0a7e63fe3abb527646cc70525998a7d85
2014-02-11 17:53:03 -05:00
Eric Windisch
0b9776d2f3 Install glance images before starting Nova
The docker driver for Nova needs a registry service to be running.
It is being run inside a container using an image -- that image must
be downloaded. The registry service must be started via
nova_plugins/hypervisor-docker, but this is presently called
before Glance's image download.

The reordering is being done such that Glance may download the
registry image, but prior to starting Nova such that "hypervisor-docker"
may have an image downloaded and available to launch the registry.

This change should cause no negative effects on other hypervisors.

Change-Id: I7bccb42517e4c6187f2a90c64f39cda4577f89a3
blueprint: docker-glance-uploads
2014-02-11 11:12:54 -07:00
Sahid Orentino Ferdjaoui
9e032c2d37 read_password needs to store in .localrc.auto if local.conf is used.
when running stack.sh with no passwords in local.conf
read_password() creates localrc and local.conf is ignored

Change-Id: I25ad07569d2b42b190449591d5a01ade8022392c
2014-02-10 18:35:36 +01:00