5985 Commits

Author SHA1 Message Date
Janie Richling
06ff865d19 Allow DLO manifest to be updated when using post-as-copy
Currently when using fast-post, the manifest is updated with the given
'x-object-manifest' header on a POST.  If no such header is supplied,
then the manifest will change to a regular object.
This is not currently true when using post-as-copy.

This patch changes the DLO POST using post-as-copy behavior to match
that of using fast-post.  It was also documented that
'x-object-manifest' must be provided on a POST to a manifest file.

Change-Id: Ie1143ab1a2c8f8c21e258a36badbff5d947769d4
Closes-bug: 1612991
2016-08-21 00:09:09 -05:00
Jenkins
29d13b7161 Merge "Reset AccountReaper stats in __init__" 2016-08-19 19:20:02 +00:00
Jenkins
5e0178d75b Merge "Documantation enhancements of nice/ionice feature" 2016-08-19 08:36:40 +00:00
Peter Lisák
8bf2233b40 Documantation enhancements of nice/ionice feature
Based on comments from patch #238799.

Change-Id: I9455cf6dc7fd12fee62439ff3c5f3255287ab1be
2016-08-19 07:39:49 +02:00
Jenkins
c643c261d1 Merge "Improve doc for using container-sync with large objects" 2016-08-19 03:56:51 +00:00
Jenkins
a2b7fafde2 Merge "Make log information format" 2016-08-19 03:56:07 +00:00
Jenkins
1c74fbec02 Merge "Use more specific asserts in test/unit/proxy tests" 2016-08-19 03:54:49 +00:00
Jenkins
fbe181cbee Merge "Add test for POST to DLO manifest file" 2016-08-18 23:25:54 +00:00
Janie Richling
13747021a8 Add test for POST to DLO manifest file
In the past, a POST to a DLO manifest file when object_post_as_copy
was true resulted in the manifest file contents being replaced
by the concatenation of the DLO segments.  This no longer
happens, but tests for this case are missing.

This patch adds a functional test to assert that the manifest
file is preserved in a POST request.

Change-Id: I90546014a7dcc7266f0d0e0ff6339688b7954b96
Related-bug: #1487791
Related-bug: #1514317
2016-08-18 09:31:57 -05:00
Jenkins
6e900205a9 Merge "monkey_patch_mimetools() now does nothing on py3" 2016-08-18 10:53:48 +00:00
Jenkins
4992c7d399 Merge "Change schedule priority of daemon/server in config" 2016-08-18 08:34:48 +00:00
zheng yin
26633af3af Reset AccountReaper stats in __init__
Make the AccountReaper __init__ method reset its stats variables.
This saves the unit test having to initialise the stats variables.
Also add more asserts to some AccountReaper test cases.

Change-Id: Iea112962d89ebfa3450f43b2a28ac8e8ed8b07b0
2016-08-18 13:28:50 +08:00
Jenkins
b211825966 Merge "Add rm to tox whitelist_externals" 2016-08-18 04:55:56 +00:00
Jenkins
72c3163be8 Merge "Don't run probe tests if resetswift failed" 2016-08-18 04:54:18 +00:00
Jenkins
0c9620be0d Merge "Drop X-Auth-Token from all versioned_writes subrequests" 2016-08-18 03:37:06 +00:00
Alistair Coles
ce49a296c6 Add rm to tox whitelist_externals
Avoids a warning when running tox -e api-ref

Change-Id: Ib02849075e6424f1db84499fd7500d7bb76dde67
2016-08-17 17:20:21 +01:00
Jenkins
f1817802bd Merge "Wait for a non-empty chunk in WSGIContext._app_call" 2016-08-17 08:39:08 +00:00
Kota Tsuyuzaki
95a5a4a7ec Don't run probe tests if resetswift failed
Probe test is cleaning up the swift environment for each test in setUp
method. However, probe tests will run even if we cannot use the resetswift
script for some reasons (e.g. not permitted, the script not found) and
probably the probe tests will fail after a long time passed for the
execution.

To prevent such an unfortunate situation and also to find the reason
easily, this patch adds the exit code check for "resetswift" and if it
failed, the test will raise AssertionError with the stdout and stderr to
make it easy to find the reason.

Closes-Bug: #1613494

Change-Id: Id80d56ab6b71402ead4fe22c120064d78c1e74ac
2016-08-16 18:02:58 -07:00
Tim Burke
30b97f2367 Drop X-Auth-Token from all versioned_writes subrequests
It is not necessary for versioned_writes to function (all of these
were pre-authed requests anyway), and transaction ID should be used to
trace requests instead.

Change-Id: If55c1586aa38f9a3bc9e1d00768ca00201af94cd
2016-08-16 14:08:10 -07:00
Alistair Coles
cc2b2cf9c8 Improve doc for using container-sync with large objects
Clarify that synced segment container names must be the same
when syncing large objects.

Also add multipart-menifest query string option to API ref
for object GETs.

Change-Id: Ib2d2a1e6c1e5eff215fc75c2b49e7d6758b17b7e
Partial-Bug: #1613681
Closes-Bug: #1613316
2016-08-16 16:35:53 +01:00
Jenkins
216d68eaa8 Merge "Added a test for delayed reap." 2016-08-16 02:36:48 +00:00
Jenkins
9c859ccfee Merge "add reminder how to run debug func tests" 2016-08-15 08:35:14 +00:00
liujiong
bb87fcefce Fix typo in the file
Change-Id: I6539e9b9fb7918e387e8ae802be7b4efbcb07f4d
2016-08-13 16:54:38 +00:00
Jenkins
9be2a58576 Merge "Move other-requirements.txt to bindep.txt" 2016-08-13 02:00:22 +00:00
Jenkins
15b2fc708a Merge "modify the home-page info with the developer documentation" 2016-08-12 20:08:48 +00:00
Andreas Jaeger
aab2cee827 Move other-requirements.txt to bindep.txt
The default filename for documenting binary dependencies has been
changed from "other-requirements.txt" to "bindep.txt" with the release
of bindep 2.1.0. While the previous name is still supported, it will
be deprecated.

Move the file around to follow this change.

Note that this change is self-testing, the OpenStack CI infrastructure
will use a "bindep.txt" file to setup nodes for testing.

For more information about bindep, see also:
http://docs.openstack.org/infra/manual/drivers.html#package-requirements
http://docs.openstack.org/infra/bindep/

As well as this announcement:
http://lists.openstack.org/pipermail/openstack-dev/2016-August/101590.html

Change-Id: I000a4e708006263acc6d9731a6677a6e62e285b6
2016-08-12 21:18:07 +02:00
Jenkins
a8626f7509 Merge "Reduce code duplication" 2016-08-12 09:47:55 +00:00
Tim Burke
f7a820ed3a Wait for a non-empty chunk in WSGIContext._app_call
We're functioning as a WSGI server here, so this bit from PEP-3333 seems
to apply:

> The start_response callable must not actually transmit the response
> headers. Instead, it must store them for the server or gateway to
> transmit only after the first iteration of the application return
> value that yields a non-empty bytestrin ... . In other words, response
> headers must not be sent until there is actual body data available, or
> until the application's returned iterable is exhausted.

Plus, it mirrors what swob.Request.call_application does.

Change-Id: I1e8501f8ce91ea912780db64fee1c56bef809a98
2016-08-12 05:51:57 +00:00
Jenkins
1f90e8a4ac Merge "fix swift_oldies on RH based systems" 2016-08-12 02:17:44 +00:00
Jenkins
1d5048a293 Merge "Add encrypter and decrypter links to middleware.rst" 2016-08-11 23:26:44 +00:00
Jenkins
5e8a0050f7 Merge "Grammer error : swift/doc/source/overview_ring.rst" 2016-08-11 23:26:36 +00:00
Jenkins
c87d04c5cb Merge "add swift-oldies man page" 2016-08-11 23:23:10 +00:00
Jenkins
2be944d6a5 Merge "Fix assertEqual error" 2016-08-11 20:37:23 +00:00
Thiago da Silva
05b8d9d7fc fix swift_oldies on RH based systems
Change-Id: Icbb4c6d461ded4fab2afade09e718b3a74917717
Signed-off-by: Thiago da Silva <thiago@redhat.com>
2016-08-11 16:24:57 -04:00
Jenkins
6d472f8a7a Merge "swift-ring-builder output corrected for ipv6" 2016-08-11 17:35:13 +00:00
Nakul Dahiwade
7e2cb23f88 Grammer error : swift/doc/source/overview_ring.rst
Changed sentence: "Regions can be used to describe geo-graphically
systems characterized by lower-bandwidth"
To: "Regions can be used to describe geographical
systems characterized by lower-bandwidth"

Change-Id: I0f614a4c53dd31459f1b6297dd32a8c0f609d9ce
Closes-Bug: 1612302
2016-08-11 16:10:35 +00:00
Jenkins
9d29ca1c76 Merge "Last-Modified header support on HEAD/GET container" 2016-08-11 14:44:12 +00:00
Shashank Kumar Shankar
844d0c965d Corrects spelling error in swift/common/middleware/slo.py
Fixes 'perfomed' to 'performed'

Change-Id: I54adf45494cd4c6edae7bb5b404d377527c6c5a0
Closes-Bug: 1612051
2016-08-11 08:30:39 +00:00
zheng yin
4638171ece Fix assertEqual error
I think assertEqual(a,a) is error that caused by carelessness
in test case, so I modify it.

Change-Id: I8767c35e8a1a47f1b64241f67959277074a37b21
2016-08-11 09:56:15 +08:00
Peter Lisák
ed772236c7 Change schedule priority of daemon/server in config
The goal is to modify schedule priority and I/O scheduling class and
priority of daemon/server via configuration.
Setting is optional, default keeps current behaviour.

Use case:
Prioritize object-server to object-auditor, because all user's requests
needed to be served in peak hours and audit could wait.

Co-Authored-By: Clay Gerrard <clay.gerrard@gmail.com>
DocImpact
Change-Id: I1018a18f4706daabdb84574ffd9a58d831e68396
2016-08-10 23:56:15 +02:00
Doron Chen
44ba3c310a Added a test for delayed reap.
The test schedules a 3-second delayed account reaping.
The test checks that no reaping after an immediate reap, and that full reaping
occurs 3 seconds later.

Change-Id: I0ab954ed3c59d808f32d84dc53fd512fd0a651be
2016-08-10 09:30:43 +03:00
Jenkins
22184eb882 Merge "Fix encryption-delimiter interaction" 2016-08-10 04:04:00 +00:00
Jenkins
93cbd10b07 Merge "Make swift-oldies py3-compatible" 2016-08-09 19:48:17 +00:00
Thiago da Silva
ddbab05094 add reminder how to run debug func tests
added comments on how to run in_process and specific
test cases

Change-Id: I485755996b15753323d30de09914d35e262fcedc
Signed-off-by: Thiago da Silva <thiago@redhat.com>
2016-08-09 15:42:20 -04:00
Jenkins
8256e93aa8 Merge "Raise ValueError if empty value coming into encrypt_header_val" 2016-08-09 18:34:12 +00:00
Jenkins
ea961cfef2 Merge "Have py35 tox env match py34" 2016-08-09 18:20:32 +00:00
Jenkins
a5a46854d5 Merge "NIT: fixing inconsistent naming of OpenStack Swift" 2016-08-09 18:16:13 +00:00
Jenkins
499fe875af Merge "Fix gettext_ calls" 2016-08-09 18:07:29 +00:00
Jenkins
1956d4c398 Merge "Fix repeated OPTIONS in swift-dispersion-report manpage" 2016-08-09 18:07:16 +00:00
Jenkins
f1b1bad79d Merge "Fix Python 3 issues in diskfile" 2016-08-09 17:51:00 +00:00