790 Commits

Author SHA1 Message Date
Jenkins
469215d374 Merge "Check for nova-compute before running kill" 2015-07-16 23:49:21 +00:00
Jenkins
19533886ff Merge "Wait for command in worlddump" 2015-07-16 16:08:00 +00:00
Jenkins
67011910d2 Merge "Include domain variables in accrc" 2015-07-10 19:43:46 +00:00
Jenkins
45f0e3d057 Merge "Use project instead of tenant in create_userrc" 2015-07-10 03:10:42 +00:00
John Hua
6e121ff53e Remove unused files from tools/xen.
Most of unused files were used with build_domU_multi.sh which has been 
replaced by build_xva.sh. Besides tools/xen/scripts/templatedelete.sh 
was created for convenience purposes and now not in use.

Change-Id: I4282c779629e3413ee3cd3ff134c3b7b19eee487
Closes-Bug: #1470535
2015-07-08 05:59:26 +00:00
Jamie Lennox
c54d4ab910 Include domain variables in accrc
Include the user and project domain parameters in the generated user rc files.
This is fairly simplistic, if we were to follow the existing attitudes we
should iterate over the domains and add a new level of folders however this
would change the output location for files that may be depended upon.

Change-Id: I5e9e78406b11382751a591d91f711161bb98f47a
2015-07-07 19:33:18 +00:00
Jamie Lennox
9d6d8f8015 Use project instead of tenant in create_userrc
The create_userrc file is littered with references to a tenant. The tenant
concept has been deprecated long enough that we should use project instead.

I have not attempted to maintain compatibility with the --os-tenant-X flags
because I have not found reference to anyone using this script outside of
devstack.

Change-Id: I613f1bdc6673f0c4bfe29aaab7b514348a617a8c
2015-07-07 19:21:06 +00:00
Jenkins
05e32fb51e Merge "Support identity API v3 when generate clouds.yaml" 2015-07-06 16:01:49 +00:00
Ian Wienand
3a9df1dab7 Check for nova-compute before running kill
Unconditionally running this can lead to confusing failure output from
kill as the pgrep matches nothing when nova-compute isn't yet running.

Change-Id: I37cb84fe8e0b393f49b8907af16a3e44f82c46a6
2015-07-01 06:18:47 +10:00
Ian Wienand
99440f9d59 Wait for command in worlddump
Wait for the command to complete and catch errors when running
commands.

Change-Id: I2c93b3bdd930ed8564e33bd2d45fe4e3f08f03f5
2015-07-01 06:14:01 +10:00
Amey Bhide
432268b17b Fix NameError in worlddump.py
Change-Id: Ie87e5b5ead777c0153ed7fa5d1db5cc1ae444261
2015-06-30 11:41:13 -07:00
Anandprakash Dnyaneshwar Tandale
bde24cb7c2 Fixing the deprecated library function
os.popen() is deprecated since version 2.6. Resolved with use of
    subprocess module.

Change-Id: Ib6a91ee525e2e57d3901d2c0c1b2d1305bc4566f
2015-06-29 15:04:30 +05:30
Brant Knudson
68e6ae60e7 Support identity API v3 when generate clouds.yaml
When using IDENTITY_API_VERSION=3, the clouds.yaml must also set
auth/user_domain_id and project_domain_id.

Change-Id: If028f2935ea729276f40039a4003c07c08e91672
2015-06-26 19:59:41 +00:00
Brant Knudson
e1fa0701b3 Update clouds.yaml
If the user already has a clouds.yaml, update it with the "devstack"
entry.

Change-Id: Id02378b6f3a86f9fee201d91688205705202c0a8
2015-06-21 10:16:23 -05:00
Jenkins
128d113418 Merge "Make sure iptables-services is installed" 2015-06-19 05:10:48 +00:00
Jenkins
7a6f0b6bff Merge "guru meditation report for nova-compute in worlddump" 2015-06-12 07:50:17 +00:00
Jenkins
dae868fcb0 Merge "Revert "Replace pip-installed requests CA bundle with link"" 2015-06-10 12:51:52 +00:00
Sean Dague
7272afdf8b Revert "Replace pip-installed requests CA bundle with link"
This does not gracefully handle the situation where requests
is not there at the beginning. Needs to be rethought.

This reverts commit 7d350720fe5d25fece68c5d1625a33a6cad431ef.

Change-Id: I101fac0dc6fdc97b7fb0b2955cffc6b4905152e5
2015-06-10 10:26:57 +00:00
Jenkins
6108092d30 Merge "XenAPI: Increase OpenStack DomU usage again" 2015-06-09 23:00:16 +00:00
Jenkins
1bbe71c856 Merge "Replace pip-installed requests CA bundle with link" 2015-06-09 23:00:07 +00:00
Ben Nemec
64b2ebca15 Make sure iptables-services is installed
The iptables service files are no longer included by default on
Fedora.  This causes the systemctl calls in fixup_stuff.sh to fail
when disabling firewalld in favor of iptables.

Change-Id: If37691d03e3d07ca8b53c541717081beeb184c16
Closes-Bug: #1462347
2015-06-09 15:22:37 +00:00
Joe Gordon
2ebe993b25 guru meditation report for nova-compute in worlddump
Nova-compute is hanging in the multinode test, and its difficult to
figure out why. So trigger a guru meditation report for nova-compute in
worlddump so we can see what nova-compute is doing when it is hung.

Having a hung nova-compute causes tempest to fail and
I035fe8e3333034e44b403ed0f986220ab5b0e57a runs worlddump whenever
tempest fails.

Bug 1462305 is one of the last issues left before the multinode job is
stable enough to gate on, and this patch should make it much easier to
debug.

Change-Id: I87d7536b5992c47b8082684cc662f953113fd1a8
Related-Bug: #1462305
2015-06-07 17:01:52 +09:00
Rob Crittenden
7d350720fe Replace pip-installed requests CA bundle with link
If the version of python-requests required is higher than
that provided by the operating system, pip will install
it from upstream.

The upstream version provides its own CA certificate bundle
based on the Mozilla bundle, and defaults to that in case
a CA certificate file is not specified for a request.

The distribution-specific packages point to the system-wide
CA bundle that can be managed by tools such as
update-ca-trust (Fedora/RHEL) and update-ca-certificates
(Debian/Ubuntu).

When installing in SSL/TLS mode, either with SSL=True or by
adding tls-proxy to ENABLED_SERVICES, if a non-systemwide
CA bundle is used, then the CA generated by devstack will
not be used causing the installation to fail.

Replace the upstream-provided bundle with a link to the
system bundle when possible.

Change-Id: I349662ff8f851b4a7f879f89b8975a068f2d73dc
Closes-Bug: #1459789
2015-06-02 18:35:33 -04:00
Tony Breeds
6d50d95cae Skip the .tox dir when building docs
When running tools/build_docs.sh in a devstack dir that has also run tox
build_docs needlessly runs shocco on the .tox files.

Just skip them.

Change-Id: Ia561e49ea2214ac75bd55964f1b86872118b2031
2015-05-29 12:26:31 +10:00
Bob Ball
40c5ea67d3 XenAPI: Increase OpenStack DomU usage again
Devstack has continued to grow in memory requirements and now we cannot
reliably fit in 4GB, with several services being unable to start.  Increase
the minimum for DomU to 6GB to leave room for virtual machines

Change-Id: Idbdfa1f36015b6af347d1ce27eb28baa360af5ef
2015-05-28 06:42:03 +01:00
Ian Wienand
3380a16974 Disable firewalld always
We've bike-sheded over this before
(I5252a12223a35f7fb7a4ac3c58aa4a3cd1bc4799) but I have just traced
down further issues to firewalld with neutron+ipv6 (see the bug).

In fact, as mentioned in the comments, RDO disables firewalld and the
neutron guide says to disable it [1].  The force flag is left if
anyone really wants this; but nobody is testing (or, as far as I can
tell, working on) this so bring devstack back into line and disable it
always.  Note we do not remove the package; as has been found in the
puppet scripts this can lead to dependency issues.

[1] http://docs.openstack.org/developer/devstack/guides/neutron.html

Change-Id: Ief7cb33d926a9538f4eb39c74d906ee0c879de35
Partial-Bug: 1455303
2015-05-15 19:14:19 +10:00
Sean Dague
737e94202f dump compute consoles on fail as well
This provides a dump of the compute consoles as well on failure.

Change-Id: Ib253537a54a1b9d83a930bbefa4512e039575fd1
2015-05-13 05:58:41 -04:00
Sean Dague
60a140571e add network info to the worlddump
This adds potentially helpful networking info to the world dump.

It also refactors some of the output mechanisms into reusable
functions for cleanliness in the code.

Change-Id: I39f95bd487c152925f8fadd1799149db35cffd52
2015-05-11 14:56:49 -04:00
Jenkins
db8898c495 Merge "Update default cirros version" 2015-05-08 18:43:38 +00:00
Jenkins
55f063a106 Merge "create a more generic work around for cffi & wheels" 2015-05-08 01:44:57 +00:00
Jens Rosenboom
9fd75f57fd Update default cirros version
Update the default CIRROS_VERSION to 0.3.4, which has better support
for IPv6 and some other bugfixes.

Co-Authored-By: Scott Moser <smoser@ubuntu.com>
Change-Id: I03ee6e1403680fb6c421225a7cadaf8a82edf702
Depends-On: Iac9f108d947ff4a51f99c6e8ad9d1ac5b32c000a
2015-05-07 16:06:02 +02:00
Sean Dague
168b7c226c dump iptables in the worlddump
If we fail during devstack / grenade runs, it would be nice to have
the map of iptables that are currently active as well. This makes it
handy to start figuring out what's going on when test servers don't
ping.

Change-Id: Ia31736ef2cb0221586d30c089473dfdc1db90e23
2015-05-07 08:57:28 -04:00
Sean Dague
5a59ac7d43 create a more generic work around for cffi & wheels
This is an attempt to fix the cffi vs. wheels bug in a more generic
way by just ensuring that pip has installed cffi with a pip understood
version into the venv before we try to do any builds.

Related-Bug: #1451992

Change-Id: Ibc58668c53933033405b40f79b0e9ffc73a01a6f
2015-05-06 15:58:24 +00:00
Jenkins
14d1cf90ed Merge "Add a peak memory tracker to dstat" 2015-04-20 19:16:58 +00:00
Ian Wienand
72a8be60cd Add a peak memory tracker to dstat
We can see at-a-glance memory usage during the run with dstat but we
have no way to break that down into an overview of where memory is
going.

This adds a peer-service to dstat that records snapshots of the system
during peak memory usage.  It checks periodically if there is less
memory available than before and, if so, records the running processes
and vm overview.

The intent is to add logic into the verify-pipeline jobs to use this
report and send statistics on peak memory usage to statsd [1].  We can
then build a picture of memory-usage growth over time.  This type of
report would have allowed better insight into issues such as
introduced by Idf3a3a914b54779172776822710b3e52e751b1d1 where
memory-usage jumped dramatically after switching to pip versions of
libraries.  Tracking details of memory usage is going to be an
important part of future development.

[1] http://graphite.openstack.org/

Change-Id: I4b0a8f382dcaa09331987ab84a68546ec29cbc18
2015-04-20 12:27:32 -04:00
Jenkins
9aad1b99fd Merge "refactor ping_check" 2015-04-20 13:39:33 +00:00
Jenkins
abfa858f79 Merge "Revert "List all CIRROS ARCH images in image_list.sh"" 2015-04-17 15:47:27 +00:00
Sean Dague
af9bf8663b refactor ping_check
Encapsulate all the neutron specific things you have to do ping a
neutron guest into a separate script. Refactor the main ping_check so
all logic is contained within it.

Change-Id: Ic79d8e3a2473b978551a5635a11dba07e1020bb2
2015-04-17 07:39:28 -04:00
Peter Stachowski
9a808922c1 Use openstack CLI instead of keystone
When running './stack.sh' messages are output stating that
the keystone CLI has been deprecated. These calls should be
replaced to ones utilizing the openstack CLI program instead.

Documentation examples were also updated to reflect the new syntax.

Change-Id: Ib20b8940e317d150e5f6febb618e20bd85d13f8b
Closes-Bug: #1441340
2015-04-13 10:09:13 -04:00
Joe Gordon
33ba738b05 Revert "List all CIRROS ARCH images in image_list.sh"
This reverts commit 71e82f52bde99b4bf791ea1558f1abf86019a384.

aioppcu now uses x86_64 so no need to list the i386 images for caching.

Change-Id: If500367c8bf3fdb4590c866e007ecd7de1ab5781
Depends-On: I839e1c724821ba2624beddb5233eda24b50c149f
2015-04-06 10:27:57 -07:00
Jenkins
0f173a4821 Merge "Update libvirt cpu map before starting nova" 2015-04-03 20:21:21 +00:00
Clark Boylan
edd6048168 Update libvirt cpu map before starting nova
We are trying to get a working 64bit qemu cpu model in the gate for nova
live migration testing. It appears that we need to make this change
prior to nova starting.

Make the change in configure_libvirt() to handle this along with the
other libvirt config updates. This allows us to restart the libvirt
service once. This function calls a python tool which parses and updates
the XML if necessary.

Change-Id: I00667713bfba67ab8cedbcb1660ff94d4f4bcc07
2015-03-31 15:06:30 -07:00
Jenkins
43479db910 Merge "Mostly docs cleanups" 2015-03-29 23:23:51 +00:00
Dean Troyer
dc97cb71e8 Mostly docs cleanups
Fix documentation build errors and RST formatting

Change-Id: Id93153400c5b069dd9d772381558c7085f64c207
2015-03-28 14:35:12 -05:00
Dean Troyer
bba4742e8c Add parent id to worlddump output
Helpful in tracking down some process-doesn't-die problems.

Change-Id: I146910403879c9a85d644bd07a53830ea17ca77d
2015-03-28 13:37:41 -05:00
Jenkins
d9a7ae8056 Merge "Allow devstack plugins to specify prereq packages" 2015-03-19 00:35:34 +00:00
Jenkins
a055557705 Merge "Move configuration functions into inc/*" 2015-03-12 15:22:47 +00:00
Adam Gandelman
7ca90cded3 Allow devstack plugins to specify prereq packages
We offer main devstack components the ability to install their own
system package preqreqs via files/{debs, rpms}/$service.  This adds
similar functionality for plugins, who can now do the same in their
own tree at ./devstack/files/{debs, rpms}/$plugin.

Change-Id: I63af8dc54c75a6e80ca4b2a96c76233a0795aabb
2015-03-11 14:46:35 -07:00
Ian Wienand
7c4ce9edba Check for new versions of get-pip.py
People can leave their devstack installs around for a long time, and
in the mean time new versions of pip can be released.

The current check does not download a new version if an old one
exists.  We want to check for new versions, but we also don't want the
gate jobs trying this sometimes unreliable fetch.

So add a flag-file that tells devstack if it downloaded get-pip.py
originally.  If so, on each run check for a new version using curl's
"-z" flag to request only files modified since the file's timestamp.

Change-Id: I91734528f02deafabf3d18d968c3abd749751199
Closes-Bug: #1429943
2015-03-11 09:40:13 +11:00
Dean Troyer
bf2ad7015d Move configuration functions into inc/*
* config/INI functions from functions-common to to inc/ini-config
* local.conf meta-config functions from lib/config to inc/meta-config

Change-Id: I00fab724075a693529273878875cfd292d00b18a
2015-03-09 22:52:19 -05:00