Rather than a sophisticated sed explicitely set the repository
mirros similarly like for all other distributions.
Change-Id: I846cd43b1f9c5949b656738959b74d60c21c98ef
The NPM mirror has unfortunately become unuseable as NPM itself has
grown to many terabytes in size and we haven't been able to keep up
downstream. Stop using the mirror by default as its current state is
causing some jobs to fail.
Change-Id: Iab9ece625ca71bb02c9c9b77ca7be9c89bcc47b9
It is possible for our APT lists on disk to be out-of-date. Be sure to
update them, so we don't leave jobs in a broken state.
Change-Id: I019c1832fcaa0a6f162f71e9a8168e2b202f9a79
Signed-off-by: Paul Belanger <pabelanger@redhat.com>
We'll we don't populate files on disk, give a way for projects to
source them first.
Change-Id: I58380647ad16cdffe5ced78c632caf2b05ddc5f3
Signed-off-by: Paul Belanger <pabelanger@redhat.com>
Provide a simple way for projects to source nodepool mirror
variables. We construct the new file in such a way that it doesn't
depend on nodepool, but existing nodepool scripts use it just as
downstream consumers would so that we are sure that everything lines up
without double accounting.
Change-Id: I2642659406e72090cffe5163783290e22d6ef3c2
Signed-off-by: Paul Belanger <pabelanger@redhat.com>
I think we want to go with: https://review.openstack.org/#/c/339261/
This reverts commit 5151d13338fc78f2a8ffde8abdd98d45dbc8d530.
Change-Id: I2e26ce98d82c18009e237c6ae9042411e43f8959
In various places we have wanted to have just the mirror host location
and not specific mirror config like for pip or apt or yum. For example
devstack-gate attempts to use this information to do simple networking
ping tests, dib tests construct yum repo locations on ubuntu and apt
repo locations on centos, and so on. Have a clear file that is set to
the root mirror location if a mirror is in use to make this simpler.
Change-Id: I306467f1870e5ee823b8b5c98d81917e607348ef
Until now, this wasn't an issue. However it seems fedora 25 started
looking for a drpm file today:
[MIRROR] pcre-8.40-5.fc25_8.40-6.fc25.x86_64.drpm: Status code: 404 for
http://mirror.iad.rax.openstack.org/fedora/updates/25/x86_64/drpms/pcre-8.40-5.fc25_8.40-6.fc25.x86_64.drpm
Because we don't mirror drpms (to save space) our fedora-25 nodes are
failing. So, just disable drpms for our mirrors.
Change-Id: I35b2f3f638f4551d5f169d1d6e081f29377ccb85
Signed-off-by: Paul Belanger <pabelanger@redhat.com>
Because we are using the 'zuul' user to SSH into our zuul workers, we
need to add it to configure_mirror.sh and still support the jenkins
user.
Change-Id: I79eff670f56d06c49a16e1330a73889e7b8482f1
Signed-off-by: Paul Belanger <pabelanger@redhat.com>
Now that we have migrated all our jobs to fedora-25, we can remove
fedora-24 from project-config.
Change-Id: I3a58c785c12f779060a6dca5cd40ddcc46429971
Signed-off-by: Paul Belanger <pabelanger@redhat.com>
Now that fedora-25 is online, we can start using the new AFS mirror for
fedora. Keep in mind, we didn't mirror fedora-24, since fedora-25 will
be replacing it.
Once fedora-24 has been removed from nodepool.yaml, we can remove our
conditional check.
Change-Id: I1bd510c6a568b71b604c27d6cae16d2654063d0c
Depends-On: I762e55fb7fe0c5ebfb7810545ddb4d5ccfedf2ff
Signed-off-by: Paul Belanger <pabelanger@redhat.com>
We incorrectly setup our mirrors for UCA. Now we support 3 openstack
releases.
Change-Id: Ie3a05398d9fdc7a7f7c0c74366a7c4dd70200a2b
Signed-off-by: Paul Belanger <pabelanger@redhat.com>
Update our script to provide additional debug information, such as the
builddate of our DIB images.
Change-Id: Ie399b1ac9cd6c6ea4372378ae7b7bf930fac16a3
Signed-off-by: Paul Belanger <pabelanger@redhat.com>
A cosmetic change to reduce the debug output on DNS failures. First
check for valid DNS, then proceed with configuration.
Change-Id: I3370a155bf6b49088c398dc9d4d572b6210b84b2
Signed-off-by: Paul Belanger <pabelanger@redhat.com>
After noticing ubuntu-xenial launch failures in osic-cloud1, it looks
like our unbound service is taking up to 1 minute to start properly.
So wait 30 seconds for host to timeout, and try 10 times. This gives
us a 300 second timeout window to configure DNS properly.
Change-Id: Id0432c91cc853fb4ecab43da991948c2e9d84b7d
Signed-off-by: Paul Belanger <pabelanger@redhat.com>
Because how often we run into nodes having DNS issues, a large amount
of debug info is dumped into nodepool logs when the ready-script
fails.
As such, move our dns checks soon so the ready-script failure output
is minimized.
Change-Id: I003f8ee816f279ef30075524c1b806e93c56e7f9
Signed-off-by: Paul Belanger <pabelanger@redhat.com>
Now that we have debian-openstack-newton-backports online, we need to
update our source.list file for debian.
Change-Id: I55ef64ff7f1ed0c3fbd01e9666d3adab76928f6d
Signed-off-by: Paul Belanger <pabelanger@redhat.com>
We now offer debian-openstack packages[1] for jessie-newton. Give a
way for users to enable them.
[1] http://mirror.dfw.rax.openstack.org/debian-openstack/
Change-Id: Ie3343608fb4c3af77680fb959c717785bc2567c6
Signed-off-by: Paul Belanger <pabelanger@redhat.com>
To make it easier to follow additions to configure_mirror.sh as we
grow more and more mirrors of things, separate the configuration
file contents into separate variable definitions so they don't make
the script logic as hard to follow.
Change-Id: I421da8eefeb040d9daded59b8d62158f0aa1610b
Signed-off-by: Paul Belanger <pabelanger@redhat.com>
We have successfully migrated the devstack-plugin-ceph repo over to
using the opt in apt sources list for ceph mirroring. They were the
consumer of this so we can remove having it installed by default now.
Change-Id: Ibb3f906e673aa86ad1222e52d3a1c96104b0a00c
Rather than enabling ceph and cloud archive repos by default when when
configuring test instances to use our apt repo mirrors write out
configures for them in another directory which can be optionally
enabled.
This prevents growing dependencies on these repositories except for
where explicitly desired.
To use a mirror either symlink to the sources.list.available.d/ files or
copy them into sources.list.d/ and rerun apt-get update.
Change-Id: I410f45064080e1bb93684899028e9af34bd555a1
* add NODEPOOL_CENTOS_MIRROR to set custom CentOS mirror in same manner
as for Ubuntu
* add NODEPOOL_EPEL_MIRROR to set custom EPEL mirror
* use $releasever for CentOS and EPEL repositories
Change-Id: I93c92aea60725bb9b172e6fed12655e4a94b265b
This patch loosens the timeout requirements for npm on our jenkins
nodes, in order to accomodate a cold AFS cache.
Change-Id: Icba1366aac3cb831b4b00441f691cfaca38ddb6e
This patch adds the npm mirror location to jenkins' .npmrc file,
which should supercede anything except an explicit declaration in
a similar file at a project root. All javascript jobs from this
point forward will use our npm mirrors rather than the public
registry.
Change-Id: I2b6463225ac86b83fa0c11ecdd390968b2209c4b
Since this image is going to be short lived, we don't want to add
ubuntu-precise AFS mirrors for ubuntu packages.
Change-Id: I0dc0e6bbb9f695584945056528cfb7e02793bdcd
Signed-off-by: Paul Belanger <pabelanger@redhat.com>
Reprepro now as local repos for xenial-updates and xenial-backports on
our mirrors. Lets use them now.
Change-Id: Ic1dbb9cf7e041ecce1a872386e0e3ce15757e261
Signed-off-by: Paul Belanger <pabelanger@redhat.com>
Because reprepro will not mirror repositories with 0 packages,
xenial-backports, xenial-updates, xenial-security are missing from
AFS. Until we have them populated, we'll only configure APT to use
the xenial mirror.
Change-Id: Id4d788097ae4e1a5d0f13cb84a46fbb9ac9a839e
Signed-off-by: Paul Belanger <pabelanger@redhat.com>
This reverts commit 468f17c4f6afac507dba9d4783c7da6fde24f656.
This isn't working on fedora-23 or centos7 slaves for some reason making
it very difficult to get those nodes ready. Revert in order to do more
testing across the platforms.
Change-Id: I634e784b71a2d92a745f8d9c89532e953f48b9cf
Update iptables rules to allow slaves to talk to themselves over their
known IP addresses. This should allow services to listen on public or
private addresses in addition to the loopback address and talk to those
services over these IPs.
Specifically this should address a problem with rabbitmq coming up on
the public IP but not being able to talk to it due to iptables.
Change-Id: If851eb8ce97ca0c0c113f0a924ec0916c993cf87
This patch adds Debian Jessie diskimage-builder image to nodepool.
debian-packageinstall element is based on debian-minimal and provides
additional required packages, change is introduced in
I9486b1356eac74272e79655c9024d86ee486628c
Depends-On: Ic39ba2b5ceb5018efb75742547b2babf80827e56
Depends-On: I7a661c8b5d4bb632eb32b5018c55474c1c66a4e8
Depends-On: I4a5a8352388de46e9e7713fa11951fcde27eaad9
Change-Id: I851cb47e844a72a430b578dd63d8b230ee6e3ed9
Co-Authored-By: Igor Belikov <ibelikov@mirantis.com>
Now that we have per-region apt mirrors for ubuntu, we should use them.
As part of doing that we need to disable looking for i386 packages since
we do not mirror nor use those - and we need to tell APT to not check
the GPG signatures of our mirror archive since we're not signing it.
We don't need multiverse or restricted in the gate, and they also
contain non-free software. Remove them from our configuration.
Change-Id: I26f5fc5cec224cf4f4ea361e0f71cecbf320fbb0
