system-config/doc/source/bandersnatch.rst
Ian Wienand 882b730fdf Update to openstackdocstheme
This modernises the openstack-infra documentation by switching to
openstackdocstheme.  Update dependencies as required.

To remove non-relevant stuff from conf.py, I have just taken the demo
file from openstackdocstheme and lightly modified it.

It seems later sphinx has included it's own ":file:" role which now
conflicts.  Change it it ":cgit_file:" in our documentation.  Remove
the custom header template which no longer applies.  Add the
post-2.0-pbr sphinx-based warning-as-error, which fixes the original
problem that I actually noticed that errors could slip through the
gate tests :)

Change-Id: Ic7bec57b971bb4c75fc839e7269d1f69a576b85c
2018-06-25 11:19:43 +10:00

2.0 KiB

title

Bandersnatch

Bandersnatch

A pypi mirror tool

At a Glance

Hosts
Puppet
Projects
Documentation
Bugs

Overview

Bandersnatch is a tool we run on the static.openstack.org host to build a complete mirror of pypi.python.org. Cron execs bandersnatch on an interval with logs going to /var/log/bandersnatch.

Stale Packages

There is an issue with pypi.python.org syncing to its CDN occasionally resulting in stale package artifacts. You will notice this in the bandersnatch logs as:

2014-07-11 01:30:04,592 INFO: Syncing package: python-novaclient (serial 1154164)
2014-07-11 01:30:04,592 DEBUG: Getting /pypi/python-novaclient/json (serial 1154164)
2014-07-11 01:30:04,599 DEBUG: Expected PyPI serial 1154164 for request https://pypi.python.org/pypi/python-novaclient/json but got 1154163
2014-07-11 01:30:04,599 ERROR: Stale serial for package python-novaclient
2014-07-11 01:30:04,599 ERROR: Stale serial for python-novaclient (1154164) not updating. Giving up.

The fix for this is to issue a PURGE against the url specified above:

curl -X PURGE https://pypi.python.org/pypi/python-novaclient/json

The next run of bandersnatch will sync the package. Note this PURGE step should be performed automatically by our bandersnatch wrapper script, but can be performed by hand safely if necessary.