4405 Commits

Author SHA1 Message Date
Jenkins
61f14f0e90 Merge "Fix param description on _make_request" 2015-03-10 00:50:28 +00:00
Jenkins
85bad0b6a0 Merge "Small optimization to ring builder." 2015-03-09 13:55:28 +00:00
Kota Tsuyuzaki
b73e49e790 Fix param description on _make_request
make_requests requires a list of headers but _make_request needs
just headers dictionary (not a list).

Change-Id: Iaf7ba32de3702bf2189f41e42041b561c9d1b57b
2015-03-09 03:18:25 -07:00
Samuel Merritt
98911be6d7 Small optimization to ring builder.
We were already checking this condition a few lines up; no need to do
it again.

Change-Id: I066c635c8dfa3c3a1e9a944decae2f41e2c689c9
2015-03-06 15:06:50 -08:00
Thiago da Silva
7f482e9a56 fixing small typos in associated projects doc
Change-Id: Ia4555acc1763a58cdf605530219ea4e4586ad517
Signed-off-by: Thiago da Silva <thiago@redhat.com>
2015-03-06 14:35:40 -05:00
Jenkins
a3e5c85ba6 Merge "Minor change to the service token sample test config" 2015-03-05 21:17:28 +00:00
Jenkins
23f55b2ebc Merge "Fix object replicator partition cleanup" 2015-03-03 21:31:22 +00:00
Matthew Oliver
4f9a3a3342 Fixed links in multi-server Swift documentation
The link to the ubuntu installation guide was incorrect and 404'ing.

This change updates page to point (anchor) to the install guide
section of docs.openstack.org, so it will always point to the latest
versions of the install documentation.

It also updates the deep links to the current install guides for the
past few releases.

As links continue to get outdated or we forget to add new ones, the
anchor link at the top of the page will probably still work.

Change-Id: I38299c03370936eb41992a953aa9d10b01a8396b
Closes-Bug: #1147331
2015-03-03 16:18:58 +11:00
Jenkins
41058ba809 Merge "Ring checker in swift-recon" 2015-02-28 00:58:44 +00:00
Jenkins
0c9a76773f Merge "Make functests retry auth immediately" 2015-02-27 13:49:13 +00:00
Alistair Coles
13cc0efe02 Minor change to the service token sample test config
Make the sample test config project for tester5 be test5
to match the configured account in proxy-server.conf-sample.
That way the sample test config will work if uncommented.

Change-Id: I57144fe153775de51c950cfc101fcdf34dfac5e8
2015-02-27 11:54:50 +00:00
Jenkins
7bfddd4440 Merge "Add tempauth back to /info" 2015-02-27 11:51:14 +00:00
OpenStack Proposal Bot
60cf18f595 Imported Translations from Transifex
For more information about this automatic import see:
https://wiki.openstack.org/wiki/Translations/Infrastructure

Change-Id: I5032584721e390a999c84c7d4a4b0cd9c3555192
2015-02-27 06:14:07 +00:00
Clay Gerrard
2ff66a532c Fix object replicator partition cleanup
Probetests discovered two issues with the current state of the
object-replicator as a result of the attempts to clean up changes
related to efficient cross-region replication.

Known failures are:

  * rsync replication when configured with no sync_method in the config
    fails to clean up a handoff partition
  * ssync replication when there is only one region fails to cleanup a
    handoff partition

In both cases the path resulting in the failure moved through the
implicit else clause (dangling elif) of the partition cleanup code path.
In the ssync case the failure came form a miss on the first if branch
when delete_objs would be None if there is no remote regions.  In the
rsync case the failure came from a miss on the second elif condition
when looking for an entry in the conf dict and not setting a default.

This change adds unittests for both failures that should fail in a
reasonable way against master without requiring a probetest run against
other configs, as well as rephrasing the logic in the partition cleanup
handling to try and make the logic flow more explicit.

Change-Id: Ic59d998a3e36a3eb3e509d9fdf7096e812281357
2015-02-26 18:31:41 -08:00
John Dickinson
da6f8d8f13 fixed ugly code pattern in probe tests
Change-Id: I242f095ea0ca8d6d69c3b2258cce6b51c7963dce
2015-02-26 14:32:31 -08:00
Clay Gerrard
555e9894ee Make functests retry auth immediately
I don't think we need to backoff after a 401 - we have a perfectly valid
response telling us exactly what we should do so we can do that right away and
move on.

Assuming you run functional tests at least once a day, according to
http://xkcd.com/1205/ and my benchmarks you can spend roughly a full day
reviewing this change and still come out ahead.

Change-Id: I27c42c4ee3254eb32aad4d3dac08b16b3a43d611
2015-02-26 12:30:30 -08:00
Clay Gerrard
e3cbfc5c5e Add tempauth back to /info
Our functional tests are skipping Account ACL tests when using tempauth
because it does not register itself with in swift.common.utils._swift_info

Add the register_swift_info call back to the filter_factory function in the
tempauth from which it was removed, and add a test to validate creating the
filter will add the middleware to global info dict.

Change-Id: I3761da3241601c93245796beb5d29bf3f36d69f6
2015-02-26 11:48:45 -08:00
Jenkins
37fb2cef04 Merge "Enable override of container update headers" 2015-02-26 07:09:24 +00:00
Mahati Chamarthy
a248a5c09e Ring checker in swift-recon
This patch validates the server end points on the ring. And also generates
a report on issues found.

Change-Id: I913799a35d5c9178164021cfb7fcb448141b058b
2015-02-26 01:26:02 +05:30
Alistair Coles
12e9826dbd Enable override of container update headers
Crypto middleware needs to arrange for alternative
values of etag and content-type to be sent to container
servers with updates, since these will be encrypted with
a different key than the etag and content-type stored on
the object server.

Erasure coding apparently needs a similar capability.

This patch modifies the object server to overwrite the etag
and content-type values in the container update headers with
values that may optionally be specified by middleware in
X-Backend-Container-Update-Override-* headers.

Using the X-Backend- prefix ensures that these headers
cannot be sent or seen by clients.

A new probe test verifies the propagation of override
values from an internal client through the proxy, to
object server, to container server and then returned
in a container listing.

Change-Id: I7d846ed54ff173d08c66c6d5b0ecf7dff27f5a87
2015-02-25 17:51:19 +00:00
Jenkins
a14cf43c47 Merge "Clean up a couple of deprecated uses of e.message" 2015-02-25 13:09:46 +00:00
Jenkins
2486fd5d1d Merge "Clean up a couple deprecation warnings" 2015-02-25 02:40:41 +00:00
Jenkins
48a14a7775 Merge "Fix failing tox -e py26 tests" 2015-02-25 01:23:54 +00:00
Pete Zaitcev
268e31647d Clean up a couple of deprecated uses of e.message
Using the style from existing statements elsewhere in the file.

Change-Id: I3270d0c69e7446bbfd5bbc784c4e6911a5600478
2015-02-24 17:48:20 -07:00
Jenkins
fbec7cacb8 Merge "swift-ring-builder remove doesn't print message (tabbing error)" 2015-02-24 21:44:49 +00:00
Samuel Merritt
d62df398db Clean up a couple deprecation warnings
Change-Id: Ic293402702981cea124d0dc57e95341fda7eaf99
2015-02-24 10:12:16 -08:00
David Goetz
512b6ca4df swift-ring-builder remove doesn't print message (tabbing error)
Change-Id: Iaf4f6168a52e5c67dca5ebdcf9421848cf30dee8
2015-02-24 09:31:38 -08:00
Alistair Coles
0e709a1260 Fix failing tox -e py26 tests
assertNotIn was new in python 2.7

Change-Id: I8447065e1f95162843fc1b92689c4bfab8792b6e
2015-02-24 17:14:41 +00:00
Jenkins
d6467d3385 Merge "Add multiple reseller prefixes and composite tokens" 2015-02-24 16:12:01 +00:00
Jenkins
6a6f7d5c9f Merge "Fix efficient replication handoff delete" 2015-02-24 11:15:44 +00:00
Donagh McCabe
89397c5b67 Add multiple reseller prefixes and composite tokens
This change is in support of Composite Tokens and Service Accounts
(see http://specs.openstack.org/openstack/swift-specs/specs/in_progress/
service_token.html)

During coding, minor changes were made compared to the original
specification. See https://review.openstack.org/138771 for these changes.

DocImpact

Change-Id: I6072b4efb3a479a8e0cc2d9c11ffda5764b55e30
2015-02-23 15:57:20 +00:00
Jenkins
078b7aa507 Merge "Fix swift-recon --all help message" 2015-02-23 01:41:48 +00:00
Jenkins
952557de7f Merge "Output account-reaper's logs for PolicyError" 2015-02-21 01:55:16 +00:00
Jenkins
fb118d35b3 Merge "Add support of x-remove- headers for container-sync" 2015-02-21 00:51:27 +00:00
Jenkins
6cff06626c Merge "Make proxy_logging close the WSGI iterator" 2015-02-20 21:44:22 +00:00
Samuel Merritt
db29ffc983 Make proxy_logging close the WSGI iterator
PEP 333 says that the WSGI framework will call .close() on the
iterator returned by a WSGI application once it's done, provided such
a method exists. So, if our code wraps an iterator, then we have to
call .close() on it once we're done with it. proxy_logging wasn't.

Since WSGIContext gets it right, I looked at making proxy_logging use
WSGIContext. However, WSGIContext is all about forcing the first chunk
out of the iterator so that it can capture the final HTTP status and
headers; it doesn't help if you want to look at every chunk.
proxy_logging wants every chunk so it can count the bytes sent.

This didn't hurt anything in Swift, but pconstantine was complaining
in IRC that our failure to call .close() was goofing up some other
middleware he had.

Change-Id: Ic6ea0795ccef6cda2b5c6737697ef7d58eac9ab4
2015-02-20 11:04:24 -08:00
Alistair Coles
4ca08cc395 Update guest VM OS recommendation in SAIO doc
The target development platform has changed to Ubuntu 14.04 [1].
This patch makes the suggested SAIO platform the same.

Also, remove pointer to wiki page for other platform install
instructions that either redirects back to this SAIO doc or
to another wike page and then a dead link.

[1] I0a96bcf692bb240f3ab5aab7fefd294a07735a83

DocImpact

Change-Id: I9f96104b5437c1f1f28f924c048ef83cf03338f4
2015-02-19 17:46:10 +00:00
Arnaud JOST
7bc09dfdea Add support of x-remove- headers for container-sync
If the used tool to send header doesn't support empty headers (older versions
of curl), x-remove can be used to remove metadata.
sync-key and sync-to metadata, used by container-sync, can now be removed using
x-remove headers.

Change-Id: I0edb4d5425a99d20a973aa4fceaf9af6c2ddecc0
2015-02-19 15:43:31 +01:00
Kota Tsuyuzaki
f578a35100 Fix efficient replication handoff delete
Current code might delete local handoff objects incorrectly
when remote node requires whole of the objects at poking
because empty cand_objs won't be applied to the delete candidate
objects list.

This patch ensures the delete candidate objects list always
will be updated (i.e. it will be empty list when the poke job
find whole local objects are required by remote), and then,
handle deleting objects correctly according to the delete
candidate.

This patch includes a test written by Clay Gerrard at [1].

Co-Authored-By: Clay Gerrard <clay.gerrard@gmail.com>

1: https://review.openstack.org/#/c/155542/

Change-Id: Ie8f75ed65c7bfefbb18ddccd9fe0e41b72dca0a4
2015-02-19 00:09:31 -08:00
Jenkins
a6091c0f39 Merge "Promote some of the best developers I know to CORE Emeritus" 2015-02-18 19:55:33 +00:00
Jenkins
7572b00abd Merge "update the getting started doc" 2015-02-18 11:30:25 +00:00
Jenkins
65d6b93b70 Merge "more probe test refactoring" 2015-02-18 00:55:45 +00:00
John Dickinson
949804eda4 update the getting started doc
Change-Id: I0a96bcf692bb240f3ab5aab7fefd294a07735a83
2015-02-17 13:24:33 -08:00
Jenkins
bf0e01c488 Merge "Add functional tests for container TempURLs" 2015-02-16 09:53:32 +00:00
OpenStack Proposal Bot
dd1a05f527 Imported Translations from Transifex
For more information about this automatic import see:
https://wiki.openstack.org/wiki/Translations/Infrastructure

Change-Id: I013976c6192a8bff891c9050f829ae7a1e2fec59
2015-02-16 06:30:54 +00:00
John Dickinson
7acc291129 added swift_source to ratelimit info calls
Change-Id: I2b4ccb809c0f4505098e261f546f53c27440dd43
2015-02-15 17:14:31 -08:00
Richard Hawkins
023e29fa1e Add functional tests for container TempURLs
Change-Id: I7f54594df1522d72dd1d13556be0b9d33e811b30
2015-02-14 10:05:19 -06:00
Leah Klearman
ca0fce8542 more probe test refactoring
* move get_to_final_state into ProbeTest
* get rid of kill_servers
* add replicators manager and updaters manager to ProbeTest

(this is all going someplace, i promise)

Change-Id: I8393a2ebc0d04051cae48cc3c49580f70818dbf2
2015-02-13 16:55:45 -08:00
Clay Gerrard
2655465d82 Promote some of the best developers I know to CORE Emeritus
Change-Id: I4095bdbb2c137615bf9492e373a837daadea8920
2015-02-13 13:11:40 -08:00
Jenkins
9196c31f64 Merge "Imported Translations from Transifex" 2015-02-13 19:16:05 +00:00