1935 Commits

Author SHA1 Message Date
Jenkins
1d113cbf24 Merge "Add nodepool script to preseed testrepository from subunit2sql" 2015-01-12 14:14:45 +00:00
Matthew Treinish
8fdd1ce943 Add nodepool script to preseed testrepository from subunit2sql
This commit adds a new nodepool script to use subunit2sql to preseed
testrepository with timing data to use for scheduler optimization.
This uses aggregate data from all the tests stored in the subunit2sql
db from all the test runs to generate a subunit stream with test
execute times which equal the rolling average stored in the tests
table.

This also adds a call out to the new prepare_tempest_testrepository
script in order to pre-seed tempest's testrepository with data from
the subunit2sql DB. This will enable the testr scheduler to perform
some worker balance optimization based on the average run_times from
all the previous gate runs.

Change-Id: I04404a55baf4da2745760246b8606ed3db52c03a
2015-01-07 12:25:06 -05:00
Joshua Hesketh
8bc108140e Set up venv for zuul-swift-logs
Set up a venv for zuul-swift-logs and install its dependencies
(python-magic) there instead of as system packages.

For DIB use 90 as uploading logs may be considered more important
than installing zuul.

Change-Id: Id0fc01729853e65c81cdd50e4ffa4d0d6de00ae9
2015-01-07 10:38:59 +11:00
Jenkins
46ea9288c5 Merge "Move to using package-installs.yaml" 2015-01-05 16:08:45 +00:00
Jenkins
b4f8a55a78 Merge "Only guard yum update against epel if enabled" 2015-01-05 15:58:05 +00:00
Monty Taylor
9001f4a399 Edit global pip.conf instead of per-user pip.conf
Now that there is a global pip.conf, just make the setting there.

Change-Id: I0af9d1cc6907e3977f4e7052070c72821bc1bf3a
2014-12-26 10:42:12 -06:00
James Polley
aeadb73010 Always use sudo -H when pip installing
Recent versions of pip will create ~/.cache if it doesn't already exist.

If this happens while running "sudo pip" the resulting dir will be owned
by root and 700 - which breaks anything else on the system that wants to
use ~/.cache

I *think* this finds all instances of "sudo pip" in this repo and fixes
them to use -H. This should mean they always run in the right ~

Change-Id: I47ddb3b591df6ac2100f09b38c9b8a03cb1ba1ff
closes-bug: #1405732
2014-12-26 10:41:58 +01:00
Mate Lakat
c7c3d68468 XenServer: Enable injection of XVA and ISO urls
This will enable the flexible configuration of the XVA and the URL
through nodepool, thus it's not needed to push an infra change for
changing those values. Also if you do not have those values configured,
sensible defaults are provided.

Change-Id: Ie2be50f842b4220d4e7f9d8e830d3df3262a6353
2014-12-18 18:05:58 +01:00
Colleen Murphy
1f111c6e71 Only guard yum update against epel if enabled
The --disablerepo flag for yum will fail if the repo being disabled is
not already enabled. While this is not a problem for HP cloud images
that already have epel enabled, it makes it hard for users to use the
script on non-HP cloud nodes. This commit detects whether epel is
enabled and uses the disable flag appropriately.

Change-Id: I26b6fbdc390b99b0e289ac0e35a5e616d5d3682a
2014-12-12 13:14:44 -08:00
Jenkins
40da88df75 Merge "Stop defaulting node builds to Puppet 2" 2014-12-12 20:23:21 +00:00
Jeremy Stanley
83a1658a04 Stop defaulting node builds to Puppet 2
We're done with the Puppet 2-to-3 migration, so we no longer need to
explicitly override the puppet version to 2 when bootstrapping.

Change-Id: Ib04e8dda5050ae0138fba248ff28f35819fdf254
2014-12-12 15:24:01 +00:00
Monty Taylor
96bd27f324 Move to using package-installs.yaml
dib has a new declarative package installation syntax which allows
specifying the packages to install and the phase in which to do it.

Change-Id: Iae1ca4a112443860cd6ca8ce43378dd97c793338
2014-12-11 13:48:13 -08:00
Monty Taylor
e89225e978 Support name change in devstack to debs
A short time ago, devstack change the name of its lists of debian
packages from apts to debs. In order to properly pre-cache, we should
read these.

Change-Id: Id784e2876a2cbbede650b7e101ff90f7d74ec367
2014-12-11 13:46:47 -08:00
Jenkins
515dcc1633 Merge "Allow to use custom mirror" 2014-11-13 18:39:41 +00:00
Davanum Srinivas
359fd7bba9 Create repo for oslo.context
blueprint graduate-oslo-context

Change-Id: Id9913216397b9624c6f1ddd9d98f481c806ddc3f
2014-11-12 15:30:07 -05:00
Jenkins
52dccd21d5 Merge "XenServer: Fix initramfs scripts" 2014-11-10 15:16:19 +00:00
Attila Fazekas
50032b57c1 multinode_setup allow private ip
Allow all nodes to connect to each other on the fixed/private ips.

This change realated to:
  https://review.openstack.org/#/c/114840/

Change-Id: I4b70f9184591d4563ce7b0a1b163b4055604f334
2014-11-07 14:38:10 +01:00
Clark Boylan
f963882f99 Check DNS resolution in nodepool ready script
We see occasional name resolution failures on our tests slaves. Before
marking any of these nodes as ready in nodepool check that we can
resolve git.openstack.org and the local pypi mirror on that node.

This should help in preventing tests from failing with these errors by
catching them early and help in debugging by centralizing all occurences
of these failures in the nodepool logs.

Change-Id: I48ec87141687c1f6cd53eaada350fc5ce52cdef4
2014-10-31 08:13:09 -07:00
Attila Fazekas
457f4eeefe Allow to use custom mirror
The current configure_mirror.sh expects no-one
want to use other than openstack.org pypi mirrors.

Having the configure_mirror.sh to use a costum,
NODEPOOL_PYPI_MIRROR instead of NODEPOOL_REGION when defined.

It allows averyone to use his local pypi mirror, with his
nodepool.

Change-Id: I6f0bd3372be09ccf423caacff83e615038c96ec5
2014-10-29 22:32:50 +01:00
Ian Wienand
e2bf99eb12 Use full path to grub2-mkconfig
Current centos7 builds on hpcloud are failing calling grub2-mkconfig;
from the logs:

 + sudo grub2-mkconfig -o /boot/grub2/grub.cfg
 sudo: grub2-mkconfig: command not found

To be completely honest, I'm having a hard time explaining why this
works with rackspace images, but not hpcloud ones.  I can not
replicate this in my own setup, even using the same hpcloud images.
Possibly it's something to do with the nodepool host environment when
it starts the script on the remote host?  Without access to a failing
host I'm clutching at straws...

Change-Id: I9d9f759fac1a96cc785354ae5aa44398c908704d
2014-10-29 16:06:17 +11:00
Mate Lakat
76dd12c9a5 XenServer: Fix initramfs scripts
During bashate -ing some files with .sh extension has been modified,
which are interpreted with /bin/sh, which takes a different syntax.
Fixing the issue:
    - rename the files, so they are not picked up
    - use syntax that's understood by sh

Change-Id: I617b24813df86687ca33745d0c940b0c659f2e14
2014-10-28 14:56:49 +01:00
Jenkins
0a4ccbae0c Merge "Update ca-certificates for HP Cloud centos6 images" 2014-10-23 06:40:08 +00:00
Ian Wienand
f10152f4c6 Update ca-certificates for HP Cloud centos6 images
The current HP cloud official centos6 images ("CentOS 6.3 Server
64-bit 20130116" - c1f9f404-39c2-4e83-b4bb-90d5ead16a36) by default
can't connect to mirrors.fedoraproject.org over https

---
[root@test ~]# urlgrabber -d 1,debug.txt https://mirrors.fedoraproject.org/metalink?repo=epel-6
* About to connect() to mirrors.fedoraproject.org port 443 (#0)
*   Trying 140.211.169.197... * connected
* Connected to mirrors.fedoraproject.org (140.211.169.197) port 443 (#0)
* Initializing NSS with certpath: sql:/etc/pki/nssdb
*   CAfile: /etc/pki/tls/certs/ca-bundle.crt
  CApath: none
* NSS error -8092
* Closing connection #0
* SSL connect error
---

This requires an update of ca-certificates before it will work.

Change-Id: I9c5e595aa2b8e86188cb7db658ce4b630e6d0774
2014-10-23 11:58:28 +11:00
Jeremy Stanley
73627d226c Use Python 2 when installing zuul on workers
* nodepool/scripts/prepare_node.sh: The py3k-precise nodes use a
virtualenv which defaults to python3.3, and zuul has at least one
dependency which fails to install in this situation (python-daemon
tries to use a non-Py3K compliant print syntax in its
version_info.py module). By telling virtualenv to use python2
instead we sidestep this issue.

Change-Id: Idfa70dee91494da83380fa0c0a1f8427659f6ce2
2014-10-23 00:42:50 +00:00
Anita Kuno
1cefee6026 Rename config => system-config for nodepool
We are renaming openstack-infra/config to
openstack-infra/system-config. This patch edits paths for
nodepool.

Change-Id: I75de3128e9d179b700df465726ed057439e5401e
2014-10-17 21:28:44 +00:00
Mike Heald
11a1ee31ac Remove broken 70-generic kernel as well as 70-virtual
Some vendor specific images have both -virutal and
-generic kernel images, so we need to remove both versions
of the troublesome -70 kernel so that we can install -69
and let openvswitch build.

Change-Id: Id6bdbefbf6fd3b783a189c1cf2ca0923ac5c43df
2014-10-13 18:16:52 +01:00
Mike Heald
e4d576dc4c Insist on kernel 3.2.0-69 for precise
Kernel 3.2.0-70 breaks openvswitch compilation on precise,
this removes -70 and reinstalls -69 so that it continues
working. Ubuntu bug is at
https://bugs.launchpad.net/ubuntu/+source/openvswitch/+bug/1379201

Change-Id: I3f854cc662652606669920367b4ff4cc4d545f88
2014-10-10 15:45:00 +01:00
Jenkins
298f900411 Merge "Initial centos7 support for build-image.sh" 2014-10-08 21:41:19 +00:00
Andreas Jaeger
785f4595e2 Fix bashate failure
Fix:
E020: Function declaration not in format  "^function name {$": 'function
log_extlinux() {'
...scripts/convert_node_to_xenserver.sh: L421

Change-Id: Ice9431275feba9e45f11e64d911976e643baf3c0
2014-10-08 20:16:08 +02:00
Jenkins
bb7cc52cb2 Merge "XenServer: Add XenServer support" 2014-10-08 17:40:31 +00:00
Ian Wienand
f5c3bd5dad Initial centos7 support for build-image.sh
Add some filtering to 55-cache-devsatck-repos to handle centos7, which
actually gets setup with a DISTRO_NAME of rhel7 in devstack

Update the readme file to highlight the options for building other
images.

"DISTRO=centos7 ./tools/build-image.sh" creates a workable centos7
qcow image with this change and a d-i-b that includes
Ie24033468b78587ea87188ee1b843b26895798ff

Change-Id: Ida38cba0a303ab77432d5d354f1952e00ebfa00e
2014-10-07 10:21:00 -07:00
K Jonathan Harker
2f03cf35e5 Clean up bashate failures
Also create tools/run-bashate.sh to wrap a find command to search for
files to run bashate on, and use it in tox.

Change-Id: I5ab07425f566a556f158a4b76b00aa35f9fb4385
2014-09-30 12:39:48 -07:00
Mate Lakat
f941684439 XenServer: Add XenServer support
Upstreaming several changes from XenServer CI:
 - Use tty0 as console - thus the user can see what's happening during
   installation over VNC console.
 - Set the number of VCPUs to 6 for the DomU appliance
 - Add prepare_node_xenserver.sh script.
 - Use testing xva 1.1.4 which has trusty.

Change-Id: I56fc4e1af12f3f13fd1aa0b772bd8734b412d3d5
2014-09-30 10:50:45 +02:00
James E. Blair
5904df1e86 Update URL for projects.yaml
Update the URL of projects.yaml used by the git repo cache scripts
in nodepool image builds.

Change-Id: I9adce15a0a651b7cda0cef8ec7efec332774826b
2014-09-25 15:47:54 -07:00
Anita Kuno
1d21cd635f Reorganizes project-config
This repo was created from filter branching the openstack-infra/
config repo. This process brought a lot of cruft with it in the
form of directories that we no longer need. This patch removes
that cruft so we begin with a tidier repo.

Change-Id: Ibffad1b11c0c5f84eedfb0365369f60c4961a0f3
2014-09-25 11:41:04 -04:00