openstack/project-config
Code Issues Proposed changes

copy-wheels: disable PEP503 indexing

Browse Source 
Creating the index has turned out to be much more difficult than first
expected.  Checksumming the files on AFS to make the index.html takes
too long and times out the jobs.

We've identified other issues such as the jobs only ever appending
wheels, making far more data than probably necessary being kept, and
the possibility of skipping those wheels already available on PyPi.

Disable this while we reconsider the approach.

Change-Id: I86a922d59b396a059b255a4d87d8c033b79f7564
This commit is contained in:
Ian Wienand 2020-01-16 12:27:48 +11:00
parent 34f963a924
commit fec3a46a01
1 changed files with 5 additions and 4 deletions
Show Stats Download Patch File Download Diff File Expand all files Collapse all files

9
roles/copy-wheels/files/wheel-index.sh
View File

@ -21,10 +21,11 @@ for f in $FILES; do
if [[ $f =~ $REGEX ]]; then if [[ $f =~ $REGEX ]]; then
echo " <li><a href=\"./${BASH_REMATCH[2]}/\">${BASH_REMATCH[2]}</a></li>" >> $TMP_INDEX_FILE echo " <li><a href=\"./${BASH_REMATCH[2]}/\">${BASH_REMATCH[2]}</a></li>" >> $TMP_INDEX_FILE
# Run the indexer over this directory # Create PEP503 style index for this directory
# NOTE(ianw) : remove temporary "--output" when working # NOTE(ianw) : 2020-01 - this is disabled because it makes the
/usr/local/bin/wheel-indexer.py --debug --output "index.html.tmp" $f # job very, very slow as it checksums all the files over AFS.
# We are currently investigating solutions to this problem.
# /usr/local/bin/wheel-indexer.py --debug --output "index.html" $f
fi fi
done done