From fec3a46a01f3369a8388286d0c325d4427be7176 Mon Sep 17 00:00:00 2001 From: Ian Wienand Date: Thu, 16 Jan 2020 12:27:48 +1100 Subject: [PATCH] copy-wheels: disable PEP503 indexing Creating the index has turned out to be much more difficult than first expected. Checksumming the files on AFS to make the index.html takes too long and times out the jobs. We've identified other issues such as the jobs only ever appending wheels, making far more data than probably necessary being kept, and the possibility of skipping those wheels already available on PyPi. Disable this while we reconsider the approach. Change-Id: I86a922d59b396a059b255a4d87d8c033b79f7564 --- roles/copy-wheels/files/wheel-index.sh | 9 +++++---- 1 file changed, 5 insertions(+), 4 deletions(-) diff --git a/roles/copy-wheels/files/wheel-index.sh b/roles/copy-wheels/files/wheel-index.sh index 1148b200a3..21038d0279 100755 --- a/roles/copy-wheels/files/wheel-index.sh +++ b/roles/copy-wheels/files/wheel-index.sh @@ -21,10 +21,11 @@ for f in $FILES; do if [[ $f =~ $REGEX ]]; then echo "
  • ${BASH_REMATCH[2]}
    • " >> $TMP_INDEX_FILE - # Run the indexer over this directory - # NOTE(ianw) : remove temporary "--output" when working - /usr/local/bin/wheel-indexer.py --debug --output "index.html.tmp" $f - + # Create PEP503 style index for this directory + # NOTE(ianw) : 2020-01 - this is disabled because it makes the + # job very, very slow as it checksums all the files over AFS. + # We are currently investigating solutions to this problem. + # /usr/local/bin/wheel-indexer.py --debug --output "index.html" $f fi done