30 Commits

Author SHA1 Message Date
Paul Belanger
55dcb81a26
Don't configure deb mirrors for ubuntu-precise
Since this image is going to be short lived, we don't want to add
ubuntu-precise AFS mirrors for ubuntu packages.

Change-Id: I0dc0e6bbb9f695584945056528cfb7e02793bdcd
Signed-off-by: Paul Belanger <pabelanger@redhat.com>
2016-05-05 15:31:37 -04:00
Paul Belanger
3612aebc16
Add ceph-deb-hammer.list to both trusty and xenial
Since we mirror both repos now.

Change-Id: Ic2493197c53e9a3d7a52c6014c0e1b5fb19c9051
Signed-off-by: Paul Belanger <pabelanger@redhat.com>
2016-05-03 12:36:04 -04:00
Paul Belanger
926b0e62d6
Configure xenial-updates / xenial-backports on slaves now
Reprepro now as local repos for xenial-updates and xenial-backports on
our mirrors. Lets use them now.

Change-Id: Ic1dbb9cf7e041ecce1a872386e0e3ce15757e261
Signed-off-by: Paul Belanger <pabelanger@redhat.com>
2016-04-27 10:18:33 -05:00
Paul Belanger
5dab984ff7
Add ceph-deb-hammer mirror for ubuntu-trusty
Change-Id: I6b8c3576a99613799f6b851139c3f3e35802dbc4
Signed-off-by: Paul Belanger <pabelanger@redhat.com>
2016-04-16 08:22:25 -04:00
Paul Belanger
26490fad95
Add logic check for xenial APT mirrors
Because reprepro will not mirror repositories with 0 packages,
xenial-backports, xenial-updates, xenial-security are missing from
AFS.  Until we have them populated, we'll only configure APT to use
the xenial mirror.

Change-Id: Id4d788097ae4e1a5d0f13cb84a46fbb9ac9a839e
Signed-off-by: Paul Belanger <pabelanger@redhat.com>
2016-04-14 11:35:00 -04:00
Clark Boylan
e88dd66c8a Revert "Allow test slaves to talk to themselves"
This reverts commit 468f17c4f6afac507dba9d4783c7da6fde24f656.

This isn't working on fedora-23 or centos7 slaves for some reason making
it very difficult to get those nodes ready. Revert in order to do more
testing across the platforms.

Change-Id: I634e784b71a2d92a745f8d9c89532e953f48b9cf
2016-03-24 17:11:57 -07:00
Clark Boylan
468f17c4f6 Allow test slaves to talk to themselves
Update iptables rules to allow slaves to talk to themselves over their
known IP addresses. This should allow services to listen on public or
private addresses in addition to the loopback address and talk to those
services over these IPs.

Specifically this should address a problem with rabbitmq coming up on
the public IP but not being able to talk to it due to iptables.

Change-Id: If851eb8ce97ca0c0c113f0a924ec0916c993cf87
2016-03-23 12:14:10 -07:00
Thomas Goirand
45fe44f924 Add debian-jessie image to nodepool
This patch adds Debian Jessie diskimage-builder image to nodepool.
debian-packageinstall element is based on debian-minimal and provides
additional required packages, change is introduced in
I9486b1356eac74272e79655c9024d86ee486628c

Depends-On: Ic39ba2b5ceb5018efb75742547b2babf80827e56
Depends-On: I7a661c8b5d4bb632eb32b5018c55474c1c66a4e8
Depends-On: I4a5a8352388de46e9e7713fa11951fcde27eaad9
Change-Id: I851cb47e844a72a430b578dd63d8b230ee6e3ed9
Co-Authored-By: Igor Belikov <ibelikov@mirantis.com>
2016-03-16 00:50:37 +01:00
Monty Taylor
413fcf9275 Do not disable multi-arch on precise
Expressed the conditional as != precise to future-proof for when xenial
comes out.

Change-Id: Icdde40c638d2baf3b86eb58ff42f0132d1181b0b
2016-02-12 09:41:40 -06:00
Monty Taylor
7a8b9992c7 Update configure_mirror to use per-region APT mirrors
Now that we have per-region apt mirrors for ubuntu, we should use them.
As part of doing that we need to disable looking for i386 packages since
we do not mirror nor use those - and we need to tell APT to not check
the GPG signatures of our mirror archive since we're not signing it.

We don't need multiverse or restricted in the gate, and they also
contain non-free software. Remove them from our configuration.

Change-Id: I26f5fc5cec224cf4f4ea361e0f71cecbf320fbb0
2016-02-08 16:33:09 -06:00
Michael Krotscheck
10602b13d9 Add wheel mirror to configure_mirror.sh
This patch adds the wheel mirror location for this particular operating
system/region combo to pip.conf.

Change-Id: I700aaceda2b263c7b2e4ba167a52862d08598108
Depends-on: Ic9b069313c7a4e105cd086bdc4516c6c5826d53e
2016-02-03 09:34:08 -08:00
James E. Blair
981d5d2970 Lowercase mirror host
Pip performs a case-sensitive comparison on the trusted host.  Just
make sure all our hostnames are lower case.

Change-Id: I63a66978a599629cb713c2de99618455f40ed0cc
2016-01-29 13:16:22 -08:00
Michael Krotscheck
0c660e42da Corrected entry for pip's trusted-host
trusted-host should be the hostname, not the URL.

Change-Id: Ie8df441475cd83d0cdd665bcccef60310615671d
2016-01-29 10:01:09 -08:00
Michael Krotscheck
82c8262321 Added schema to pypi mirror
The HTTP schema was missed.

Change-Id: Id255713f942f90a6c6676fda3cfa03aa9804ebcb
2016-01-29 16:34:25 +01:00
James E. Blair
473f875a1f Fix permission error in ready script
The ready script runs as the jenkins user, so to write pip.conf
we need to use sudo.

Change-Id: I94b617f1778bad415d7fa9415c6fcb2cafcb8a5a
2016-01-28 15:56:21 -08:00
Michael Krotscheck
b6264d3d29 Point nodepool slaves at new pypi mirror location.
The configure_mirror script has been updated to point our nodepool
slaves at mirror.<region>.<cloud>.openstack.org/pypi rather than
pypi.<region>.openstack.org.

Change-Id: I895b419e7755f8ec0e5fa594eebc8f9d79d333ba
Depends-on: I3d7629d80fe1e8762344852fab4a942bc476b706
2016-01-28 16:25:29 +00:00
James E. Blair
0da79a780f Write complete pip.conf when nodes are ready
Rather than trying to sed pip.conf, just write the whole thing.
This means we don't have to wait for image updates anymore.  It's
not clear to me why we didn't just do this once we started seding
it.

Change-Id: Ie6743e2a8f95f95cea19a0dbe9fceaedbff8bf94
2016-01-28 08:12:30 -08:00
Andreas Jaeger
1db085d5ec Wrap some overly long lines
To cut down on noise when running bashate, wrap some overlong lines.

Change-Id: I23dcffbae2539d3d6b11e5527f3d4cbf08a18064
2015-12-23 13:56:53 +01:00
Jeremy Stanley
f954e8ccd4 Revert "Block installing of mock from wheels"
This reverts commit 71d10ea626f5a62d6b48133e19f469b19c9a7f14.

It was unnecessary once the offending wheel got removed from PyPI,
and this never worked anyway. It was preventing the ability to boot
new nodes, erroring thusly:

    ./configure_mirror.sh: line 25: /tmp/pip.conf: Permission denied

Deleting the images to which the change was applied returned
nodepool to being able to boot new nodes again.

Change-Id: I0841c6a5a26cf5be22e2d8fea861bdceb0393842
2015-07-12 01:54:12 +00:00
Monty Taylor
71d10ea626 Block installing of mock from wheels
This is needed until a new wheel of mock can be cut after the new pbr
release is cut.

Change-Id: I96a1794ee754f879514b34add3e36a4a42fd681b
2015-07-10 10:23:22 -04:00
James E. Blair
8e5c538e5a Add allow_hosts to pydistutils.cfg
This should cause easy_install to only contact our pypi mirrors
when fetching packages.

https://pythonhosted.org/setuptools/easy_install.html#restricting-downloads-with-allow-hosts

Change-Id: I7f7847721c2e8c6299c7fe5ab20045e8bdbc5bd7
2015-06-02 10:50:03 -07:00
Monty Taylor
974cf5dfb2 Revert "Configure to use gem mirrors"
This reverts commit efcda4394386182437feda101d783edb849509c0.

Change-Id: Ia9bf1603d50d8309351d2d7684cdb97c82157e64
2015-05-11 21:54:30 +00:00
Monty Taylor
efcda43943 Configure to use gem mirrors
We want our build nodes to be tied to the gem mirrors we define.

Change-Id: I587af92fbedbc935d460ed68852426af276d1321
2015-05-08 11:12:57 -04:00
Monty Taylor
8bc8d33f26 Avoid vendor supplied apt mirrors
They are nuking the world

Closes-Bug: #1286818
Change-Id: Id876c8a0dea500b90b3ede1502bc757bfb71c4d4
2015-04-28 08:29:33 -04:00
Clark Boylan
ad623a7e86 Use sudo when editing /etc/pip.conf
Unlike before where the jenkins user was editing files that it owns in
its homedir the /etc/pip.conf editing needs root permissions since that
file is owned by root.

Change-Id: I485a08cb243cc0abf4c848e6061606b4320a59cb
2015-02-12 16:47:05 -08:00
Monty Taylor
9001f4a399 Edit global pip.conf instead of per-user pip.conf
Now that there is a global pip.conf, just make the setting there.

Change-Id: I0af9d1cc6907e3977f4e7052070c72821bc1bf3a
2014-12-26 10:42:12 -06:00
Jenkins
515dcc1633 Merge "Allow to use custom mirror" 2014-11-13 18:39:41 +00:00
Clark Boylan
f963882f99 Check DNS resolution in nodepool ready script
We see occasional name resolution failures on our tests slaves. Before
marking any of these nodes as ready in nodepool check that we can
resolve git.openstack.org and the local pypi mirror on that node.

This should help in preventing tests from failing with these errors by
catching them early and help in debugging by centralizing all occurences
of these failures in the nodepool logs.

Change-Id: I48ec87141687c1f6cd53eaada350fc5ce52cdef4
2014-10-31 08:13:09 -07:00
Attila Fazekas
457f4eeefe Allow to use custom mirror
The current configure_mirror.sh expects no-one
want to use other than openstack.org pypi mirrors.

Having the configure_mirror.sh to use a costum,
NODEPOOL_PYPI_MIRROR instead of NODEPOOL_REGION when defined.

It allows averyone to use his local pypi mirror, with his
nodepool.

Change-Id: I6f0bd3372be09ccf423caacff83e615038c96ec5
2014-10-29 22:32:50 +01:00
Anita Kuno
1d21cd635f Reorganizes project-config
This repo was created from filter branching the openstack-infra/
config repo. This process brought a lot of cruft with it in the
form of directories that we no longer need. This patch removes
that cruft so we begin with a tidier repo.

Change-Id: Ibffad1b11c0c5f84eedfb0365369f60c4961a0f3
2014-09-25 11:41:04 -04:00