14 Commits

Author SHA1 Message Date
Adam Gandelman
617919da41 Pre-cache UCA packages during nodepool img build
While caching packages required by devstack, temporarily enable
the Ubuntu Cloud Archive for specified pockets and do additional
deb package caching.  This will pre-cache UCA versions of devstack
dependencies alongside the standard 12.04 requirements. After they
have been cached, the repository access is removed.  This allows
standard devstack jobs to use the vanilla 12.04 packages as usual,
and jobs that require UCA can enable it and use it without hitting
the network for either the GPG key or the packages.

Change-Id: I1cad663a71a3129dc97347dd4d39a760e432aff2
Closes-bug: #1329430.
2014-06-12 15:56:19 -07:00
Monty Taylor
25a33f31c5 Update get-pip URL to the new location
The pypa team has made a new static location for get-pip.py. Instead
of downloading from github, we should use this.

Change-Id: Ifb7f00447d4a19f20f6413fa7fece5913de092f8
2014-05-28 10:16:16 -07:00
Jenkins
6972af3762 Merge "Replace raw.github.com with raw.githubusercontent.com" 2014-04-29 17:08:00 +00:00
Monty Taylor
21598c0dfa Fix minor non-important error in cache_devstack
Found this while porting to diskimage-builder - the basedir value
is passed but not used. It's ok, because we happen to be using the
same value- but it's an error waiting to happen.

Change-Id: Ic2f39a9ff54c7bcdf3fcd48c4c6b2f98f6a88cf0
2014-04-28 08:19:57 -07:00
Derek Higgins
3cb6018573 Replace raw.github.com with raw.githubusercontent.com
raw.github.com now redirects to raw.githubusercontent.com and various
curl commands are failing unless they include "-L".

Change-Id: I07d9c2f9caa2abc82ffd57435335875df5fbc96f
2014-04-28 15:41:42 +01:00
Clark Boylan
e4db5c77ac Use os.path.exists when caching devstack images
os.path.exist does not exist. Use os.path.exists instead.

Change-Id: Iad18569a07fd714733f9c3a13e2fcf53d012d516
2014-04-17 13:43:21 -07:00
Sean Dague
7a64db1832 cache get-pip.py
One of the few network interactions that we still have in devstack
gate is downloading get-pip.py from github (it's not even in the
pypi cdn). This fails a few times a day on average.

This is avoidable by adding get-pip.py to the devstack cache during
node prep.

Closes-Bug: #1299176

Change-Id: I72a75f27a416e9a4cc98b42c2702293676ca0e2d
2014-04-17 07:11:47 -04:00
Sean Dague
746f1d3325 support the new devstack image finder
if the new devstack image_list.sh tool is found, use that are our
definitive image collection API out of devstack. We fall back to
the old method if it's not found, or fails to execute cleanly.

Change-Id: I9c59ac505b0a1085add76bfc6cb1b14e5545fc28
2014-04-17 06:40:11 -04:00
Jenkins
495fb9cf56 Merge "Skip downloading giant VMware images" 2014-03-14 18:36:43 +00:00
Monty Taylor
b0a03f43e0 Skip downloading giant VMware images
We're never going to use them in devstack-gate.

Change-Id: I66b7d768276616b8f11052449a41ca304cbf8942
2014-03-14 10:09:44 -07:00
Clark Boylan
6894c3ffaa Download each cached image once.
Nodepool's devstack image cacher was redownloading every image one time
per devstack branch. We only need to download the image once if the
image name doesn't change.

Change-Id: Ib1910c34b8479ebad740a915fcc9297205cbe387
2014-03-12 15:41:43 -07:00
Jeremy Stanley
eccd20e38c Stop separately caching repos for devstack images
Since devstack-gate no longer relies on the workspace-cache
directory, this is an unnecessary waste of effort.

Change-Id: Ic9ef8b269d0184f5891d355901bbfb29f7273670
2014-02-21 15:36:30 +00:00
James E. Blair
e204daab5f Handle empty IMAGE_URL lines in devstack_cache
Handles lines of the form:
        IMAGE_URLS=${IMAGE_URLS:-};;

Change-Id: Id99586393d28c3c11846f76634256cb497812e5e
2014-02-16 07:15:49 -08:00
James E. Blair
005581be50 Nodepool: cache all gerrit repos
Cache all review.openstack.org git repos in /opt/git.

Subsequent changes to gerrit-git-prep and devstack-gate will make
use of these repos (eventually deprecating the devstack-gate repos
is ~jenkins/workspace-cache).

Refactor the devstack cache python script a bit to make common
functions reusable.  Also rename it because underscores are better
than hyphens for python file names.

Change-Id: I4ae40613ebcca62b0dfc2eaba159557a4c71a529
2013-12-04 10:54:52 -08:00