project-config/roles
Ian Wienand 3e9efa3a65 copy-wheels : generate indexes version 2
Some things have become evident when generating the indexes requiring
some larger changes.

Firstly, the indexer script needs python3 on the host.  Since we're
still building CentOS 7 wheels, we need to install Python 3 from EPEL
there.

Secondly, because part of the PEP503 index page is the file hash,
reading all the files back over AFS is quite slow.  It's also quite
slow having ansible loop a task each time, which all adds up to job
timeouts.

Instead, make the indexes on the local disk before we copy the results
to AFS.  This requires copying both scripts to the host for execution
(rather than relying on "script:" ) so the wheel-copy.sh script can
call wheel-indexer.py.

While we are there, a small refactor on the wheel-indexer.py to use
os.walk() (which makes it easier to have this as a stand-alone
recursive script later, if something changes).  Also update the output
to use <ul><li> for the filenames, so it looks a little better on the
output html.

Change-Id: I85f9e132bc55fd8d33583a698e15c47665e5cf8d
2020-01-15 08:24:18 +11:00
..
build-wheels wheel-build: Work around pip 19.0 errors 2019-05-06 15:45:49 +10:00
configure-git move git configuration for release jobs to ansible tasks 2017-10-20 18:38:12 -04:00
copy-proposal-common-scripts Fix proposal scripts 2019-04-20 09:26:54 +02:00
copy-release-tools-scripts Update hacking, fix errors/warnings 2020-01-14 09:40:45 +11:00
copy-wheels copy-wheels : generate indexes version 2 2020-01-15 08:24:18 +11:00
fetch-translations-subunit-output Rename fetch-translations-stestr-output 2018-01-23 13:40:51 +01:00
legacy-zuul-git-prep-upper-constraints OpenDev Migration Patch 2019-04-19 19:41:29 +00:00
test-upload-logs Just use chmod instead of file for log permissions 2018-06-18 08:15:45 -05:00
use-cached-repos Make the task that remove the remote idempotent 2018-03-05 23:29:38 +00:00