1236 Commits

Author SHA1 Message Date
Dean Troyer
91baef3e26 Clarify deprecation of EXTRA_xxx_OPTS
The various EXTRA_xxx_OPTS variables will be removed in the Juno
development cycle, change the README to reflect the new way for
the Neutron variables.

Change-Id: Ic84da4a9b5a83e66cf0b57d643a87691f15517f0
2014-03-03 10:46:42 -06:00
Jenkins
9bd5b9399a Merge "Preinstall yum-utils; move sudo check before install" 2014-02-28 23:12:47 +00:00
Eric Windisch
e994f5708d Remove bm_poseur, unmaintained and obsolete
The bm_poseur git repository link has been broken
for over 11 months. The virtualized/fake baremetal
environment is not working and has not worked in a
long time. Now, on the tail of enabling 'enable -o errexit',
this functionality now has a hard break.

Change-Id: I3cbd8db58c422bc5273d2433278aaa5e449ecfd9
Closes-Bug: 1285954
2014-02-28 15:21:38 -05:00
Jenkins
dad6e4114d Merge "Enforce function declaration format in bash8" 2014-02-28 06:32:20 +00:00
Jenkins
5caa58459d Merge "Fix exit_trap() error if no child processes" 2014-02-28 01:50:06 +00:00
Jenkins
5f9d3980fc Merge "Set umask" 2014-02-28 01:43:31 +00:00
Ian Wienand
531aeb7900 Preinstall yum-utils; move sudo check before install
Some cloud images don't have yum-utils installed, so the call to
yum-config-manager fails.  Pre-install it (I still think it's easier
than fiddling config files).

Also, these repo setup steps are using sudo, but the root/sudo checks
happen after this.  Move them up before we start trying to do
repo/package installs.

Change-Id: I875e1f0663c9badc00278b2cc1a3b04ca3dde9fc
2014-02-28 11:24:29 +11:00
Ian Wienand
aee18c749b Enforce function declaration format in bash8
Check that function calls look like ^function foo {$ in bash8, and fix
all existing failures of that check.  Add a note to HACKING.rst

Change-Id: Ic19eecb39e0b20273d1bcd551a42fe400d54e938
2014-02-28 07:59:03 +11:00
Dean Troyer
94b9e82039 Fix exit_trap() error if no child processes
Bug-Id: 1285776
Change-Id: Iad7a9f2c03cc39159beda55345f232cefed10520
2014-02-27 11:14:05 -06:00
Jenkins
0ed4af02da Merge "enable -o errexit" 2014-02-27 14:57:43 +00:00
Sean Dague
09bd7c8fd5 enable -o errexit
devstack should run under -o errexit to ensure that we fail early
when something has gone wrong, otherwise determination of the root
failure location is often quite challenging.

this clears all the normal use cases for devstack, there could be
tests which now die early, which we're going to have to check for
later.

Change-Id: Ibd828c4f4fd95a60d3918d3d7ae90e10649479ab
2014-02-27 06:30:37 -05:00
Jenkins
df43b5c828 Merge "Run yum repolist commands as root" 2014-02-27 04:31:24 +00:00
Jenkins
db5a80171f Merge "Unbuffer log output" 2014-02-27 00:39:32 +00:00
Dean Troyer
a25a6f6d80 Unbuffer log output
* Force-flush log output so we don't lose log output in certain error cases.
* Slow down exit paths: add sleep to die(), wait until last moment to
  kill child processes (including the awk log output filter)

Change-Id: I1620fd33b89b237d9c2bb6206f3de2c81719f676
2014-02-26 13:17:36 -06:00
Jenkins
1c10bb3737 Merge "Move enablement of rhel6-optional repo earlier" 2014-02-26 19:04:11 +00:00
Jenkins
339ec17731 Merge "remove sysstat & pidstat" 2014-02-26 02:38:30 +00:00
Ian Wienand
3e37326a35 Move enablement of rhel6-optional repo earlier
Change 4f1fee6eae300a3384900df06ebc857e95854eb0 added the RHEL6
optional repo in fixup_stuff.sh, but it turns out that doesn't get run
until after the package prerequisites phase.  Move this into stack.sh
with the RDO repo setup.

Change-Id: Iae0df85fa94c6c1b6f497dd29fda90d03b903a41
2014-02-26 13:34:18 +11:00
Ian Wienand
2a6f1bd99b Run yum repolist commands as root
Otherwise you get yum errors like [1] when you run stack.sh as !root.
The solution is to run yum commands as root so it can access the right
certs

[1] https://access.redhat.com/site/solutions/312413

Change-Id: I54b0df13508c50aba67e23da11953c536933917a
2014-02-26 11:16:09 +11:00
Jenkins
b17fecf7d8 Merge "xtrace less" 2014-02-25 16:51:40 +00:00
Sean Dague
78096b5073 remove sysstat & pidstat
dstat is far cleaner for getting results out of the environment,
and covers the bulk of our use cases for sysstat and pidstat with
a much better ui.

devstack is allowed to be opinionated, so become opinionated here.

Change-Id: I21ec96339dcd704098512fdafd896738f352962d
2014-02-25 10:30:31 -05:00
Sean Dague
45917cc4d9 xtrace less
we are xtrace happy, however that's just generating bulk in log
files that are mostly ignorable. For the basically bullet proof
functions we should not xtrace.

Change-Id: Iab4e6d270c1546e0db2a06395cefcdf7f7929c3c
2014-02-25 06:25:14 -05:00
Jenkins
7648e9c615 Merge "match devstack-gate format" 2014-02-24 23:20:35 +00:00
Sean Dague
80313b2440 match devstack-gate format
support millisecond resolution and the | separator for ts vs.
content.

everything else in openstack is running at millisecond resolution,
and some times it's actually useful to see that when debugging
gate failures.

Change-Id: I2227ab0b4965cd1a24b579bdf2ba8c1f9a432f70
2014-02-24 14:41:20 -05:00
Sean Dague
f1eb0475d9 don't check for service enabled
service enabled is something that's not required for sysstat and
friends, because instead we actually can do this with screen_it.

Change-Id: I4aa5787101cb0def46690f38a7f82effbb85f502
2014-02-24 12:23:22 +00:00
Brett Campbell
27f29440d1 Set umask
Ensure we have a known-good umask.  Otherwise files such as
/etc/polkit-1/rules.d/50-libvirt-$STACK_USER.rules may not be readable
by non-root users afterwards.

Also reworded some comments to be more clear.

Change-Id: I7653d4eee062cf32df22aa158da6269b1aa9a558
Closes-Bug: #1265195
2014-02-19 18:23:16 -08:00
Jenkins
cf3203b6ae Merge "Add support for creating heat stack domain" 2014-02-18 12:08:37 +00:00
Steven Hardy
33d1f86a49 Add support for creating heat stack domain
The Heat instance-users blueprint requires an additional domain
where heat creates projects and users related to stack resources
so add support for creating this domain when configured to install
Heat.  Note a workaround is currently required to make the
openstack command work with the v3 keystone API.

Change-Id: I36157372d85b577952b55481ca5cc42146011a54
2014-02-15 07:45:55 +00:00
Steve Martinelli
19685428e3 Change most keystoneclient commands to openstacklient in libs
migrated most keystoneclient commands from the following libs:
 ceilometer
 cinder
 ironic
 keystone
 marconi
 neutron
 nova
 savanna
 swift
 trove

Also need to set and unset openstackclient specific environment
variables from stack.sh

Change-Id: I725f30bc08e1df5a4c5770576c19ad1ddaeb843a
2014-02-14 21:30:57 -06:00
Jenkins
ea76eb727a Merge "Install glance images before starting Nova" 2014-02-15 02:21:29 +00:00
Steven Hardy
1bcd280027 Don't warn about heat modifying flavors
Since de0898a Heat no longer modifies flavors, so the comment
and output related to modified flavors is no longer needed.

Change-Id: I1007d2ab3387f28b8d7487f450cab4592f2824aa
2014-02-13 15:27:06 +00:00
Jenkins
cc3fcc8c8e Merge "add dstat to see top process info" 2014-02-12 17:27:12 +00:00
Jenkins
7719d4aca8 Merge "Begin is_service_enabled() cleanup" 2014-02-12 07:19:11 +00:00
Sean Dague
062cdaf84c add dstat to see top process info
pidstat data isn't exceptionally useful, it's lots of lines, and
seems to be missing some of the most critical one.

dstat is kind of like sysstat, except the formatting is much better.
It also supports advanced features like the top CPU using process
at every interval.

put this behind the sysstat variable, as we'll probably want to
replace sysstat & pidstat with this if it works

Change-Id: I48dc22a0a7e63fe3abb527646cc70525998a7d85
2014-02-11 17:53:03 -05:00
Eric Windisch
0b9776d2f3 Install glance images before starting Nova
The docker driver for Nova needs a registry service to be running.
It is being run inside a container using an image -- that image must
be downloaded. The registry service must be started via
nova_plugins/hypervisor-docker, but this is presently called
before Glance's image download.

The reordering is being done such that Glance may download the
registry image, but prior to starting Nova such that "hypervisor-docker"
may have an image downloaded and available to launch the registry.

This change should cause no negative effects on other hypervisors.

Change-Id: I7bccb42517e4c6187f2a90c64f39cda4577f89a3
blueprint: docker-glance-uploads
2014-02-11 11:12:54 -07:00
Sahid Orentino Ferdjaoui
9e032c2d37 read_password needs to store in .localrc.auto if local.conf is used.
when running stack.sh with no passwords in local.conf
read_password() creates localrc and local.conf is ignored

Change-Id: I25ad07569d2b42b190449591d5a01ade8022392c
2014-02-10 18:35:36 +01:00
Jenkins
28a29a3527 Merge "Move ironic to plugin" 2014-02-08 14:08:04 +00:00
Dean Troyer
e4fa721322 Begin is_service_enabled() cleanup
This converts the special cases in the is_service_enabled() function to call
individual functions declared by the projects.  This allows projects that
are not in the DevStack repo and called via the extras.d plugin to handle
an equivalent service alias.

* Ceilometer
* Cinder
* Glance
* Neutron
* Nova
* Swift

TODO: remove the tests from is_service_enabled() after a transition period

Patch Set 2: Rebased

Change-Id: Ic78be433f93a9dd5f46be548bdbd4c984e0da6e7
2014-02-07 10:06:21 -06:00
Sean Dague
16dd8b3ed9 introduce if/then & for/do rules
we mostly have a consistent style on if/then & for/do in devstack,
except when we don't. This attempts to build a set of rules to
enforce this.

Because there are times when lines are legitimately long, and there
is a continuation, this starts off ignoring if and for loops with
continuations. But for short versions, we should enforce this.

Changes to make devstack pass are included. The fact that the
cleanup patch was so small is pretty solid reason that this is
actually the style we've all agreed to.

Part of a git stash from hong kong that I finally cleaned up.

Change-Id: I6376d7afd59cc5ebba9ed69e5ee784a3d5934a10
2014-02-05 07:52:54 +01:00
Dean Troyer
1023ff7c3a Move ironic to plugin
Also adds an is_ironic_enabled() function to prepare for an upcoming
change in is_service_enabled().

Change-Id: I6e6e0e8b70221e231785ab27e9b5d4836933ac4c
2014-02-04 15:51:38 -06:00
Dean Troyer
fc744f9713 Convert trove to plugin
Also adds an is_trove_enabled() function to match
https://review.openstack.org/69497 changes for is_service_enabled().

Change-Id: Ic0408ff6d9816aec8a3506931470470342a5dcd7
2014-01-27 17:16:33 -06:00
Jenkins
2fcc8735e2 Merge "Adds default value for fixed_key" 2014-01-26 02:44:35 +00:00
Jenkins
22d985f9d9 Merge "Add pidstat support" 2014-01-25 21:06:14 +00:00
Jenkins
3c89fbacc1 Merge "Make unstack.sh more like stack.sh" 2014-01-25 18:38:03 +00:00
Jenkins
4cd482ccd9 Merge "Sanitize language settings" 2014-01-25 17:16:18 +00:00
Russell Bryant
bdeadf59d4 Add pidstat support
pidstat is a script that comes from sysstat, but will give us
per-process information.  Allow enabling "pidstat" that will run pidstat
to give info every 5 seconds by default.

Change-Id: I5ec7d5abce81125b55985bba3ccaf8073ccdfa2a
2014-01-23 22:30:00 +00:00
Jenkins
6d323f43b4 Merge "updated sar options to collect more data" 2014-01-21 10:07:52 +00:00
Brant Knudson
0049c0c434 Make unstack.sh more like stack.sh
unstack.sh and stack.sh both have to "configure projects", but the
code was different. This change makes it so the 2 sections of the
files are the same.

Change-Id: Ia06f8bbfbe2a6e87fb406e34e13a39bd7fa9e5af
2014-01-16 18:16:48 -06:00
Sean Dague
a0a23311c3 updated sar options to collect more data
in order to have better data on the load state of the test nodes
we should track things beyond just cpu time. Add in load time,
process creation rates, and io rates during the tests.

also add a sar filter that makes it report on one line

reading sar input with multiple flags is somewhat problematic,
because it's tons of interspersed headers. So build something with
does a pivot filter to make it possible to get this all on one
line.

Change-Id: I8f085cedda65dfc37ad530eb97ba1fc5577314c3
2014-01-16 17:17:07 -05:00
YAMAMOTO Takashi
b4a215cce2 Sanitize language settings
To avoid commands bailing out with "unsupported locale setting" errors.

Change-Id: I54ae4cd84a0a4b4875533181b1d96563a1604775
2014-01-15 12:17:53 +09:00
armando-migliaccio
ef1e08022b Add sanity check framework to verify neutron server/backend integration
Some Neutron plugins require controllers and multiple backend services
to operate correctly. This patch adds the framework for third party
plugins to run sanity checks after Neutron Server has started.

This simple addition may reveal potential configuration pitfalls
much earlier in the dev/test cycle, thus speeding up the build
churn process.

The first plugin that uses this framework is the VMware NSX one.

Closes-bug: #1265671

Change-Id: I17f9c5c8e828316ff03f0eff42ae4ae6c6c58733
2014-01-14 08:14:25 -08:00