swift/swift
Samuel Merritt 0e81ffd1e1 Fix socket leak on object-server death
Consider a client that's downloading a large replicated object of size
N bytes. If the object server process dies (e.g. with a segfault)
partway through the download, the proxy will have read fewer than N
bytes, and then read(sockfd) will start returning 0 bytes. At this
point, the proxy believes the object download is complete, and so the
WSGI server waits for a new request to come in. Meanwhile, the client
is waiting for the rest of their bytes. Until the client times out,
that socket will be held open.

The fix is to look at the Content-Length and Content-Range headers in
the response from the object server, then retry with another object
server in case the original GET is truncated. This way, the client
gets all the bytes they should.

Note that ResumingGetter already had retry logic for when an
object-server is slow to send bytes -- this extends it to also cover
unexpected disconnects.

Change-Id: Iab1e07706193ddc86832fd2cff0d7c2cb6d79ad9
Related-Change: I74d8c13eba2a4917b5a116875b51a781b33a7abf
Closes-Bug: 1568650
2019-01-31 18:38:35 +00:00
..
account py3: adapt the account server completely 2018-12-18 20:45:35 -06:00
cli Fix container sharding doc 2018-12-11 11:18:46 -05:00
common Fix socket leak on object-server death 2019-01-31 18:38:35 +00:00
container Merge "Py3: Fix two unbound variables" 2018-12-18 01:34:46 +00:00
locale Imported Translations from Zanata 2018-08-25 06:24:35 +00:00
obj Merge "Use remote frag index to calculate suffix diff" 2019-01-16 01:42:16 +00:00
proxy Fix socket leak on object-server death 2019-01-31 18:38:35 +00:00
__init__.py py3: Monkey-patch json.loads to accept bytes on py35 2018-11-02 21:38:53 +00:00