435 Commits

Author SHA1 Message Date
Greg Lange
8d2fe89a7d Added an internal client.
Refactored object expirer to use this client.

Change-Id: Ibeca6dba873f8b4a558ecf3ba6e8d23d36f545b0
2012-05-04 18:07:54 +00:00
gholt
f7c0f91da6 Added associated_projects.rst
In the interest of keeping the core Swift code repository less
complex, but still offering a quick way to find associated projects
that enhance or use Swift, I've added this new Associated Projects
page prominently to the Swift documentation.

This will allow much less barrier to entry on enhancing Swift as
other projects can work independently and will only need to wait on
the core Swift project for approval of minimal tweaks to the core
Swift code base.

It will also allow an easy central place to find cool associated
projects that otherwise might go unnoticed or even duplicated.

The plan is to move non-essential projects that are currently
embedded in the Swift repository out into their own projects with
links to them on this new page. This would include items such as
(just what I can think of right now): bin/swift command line tool and
clients, swift-bench, swift-dispersion, TempURL, FormPost, StaticWeb,
Rate Limiting, Swift3, Domain Remap, and CNAME Lookup.

After all that is done, those projects will be able to move forward
much more quickly and new developers for Swift itself will have much
less to learn and get confused about.

Change-Id: Ib8447d8bd480f0a3d8f0413137ccdba73a11dd91
2012-05-04 03:36:56 +00:00
Dan Dillinger
f7fdb9cf12 Implement unit_test config to disable syslog.
bug 701248
bug 819303

This change makes syslog optional, by providing a unit test
config with the ability to cause test/unit/__init__.py to
replace SysLogHandler with a fake logging class. The
default behavior is unchanged.

FakeLogger now inherits directly from Handler and mocks out
its API - this was a backward-compatibility issue.

Change-Id: I653dec148c4f6cf81759de03964c6a3290c1a290
2012-05-03 14:25:46 -04:00
gholt
5f18d987a0 Fixed tabs in the multi-node doc.
Change-Id: Idf2ea227b0078026eb2693ff7c0a24ec926bb6f3
2012-04-26 20:29:08 +00:00
John Dickinson
3053c53ef7 added docs and warnings about using SSL
Change-Id: I766b2da0a3769869b5b6c5565106e9032fea8c3e
2012-04-23 19:29:26 -05:00
Jenkins
ebfa3dd2c1 Merge "Adds links to docs.openstack.org" 2012-04-23 16:05:08 +00:00
Jenkins
069beddde4 Merge "Fixed grammar and improve docs." 2012-04-23 15:49:45 +00:00
annegentle
a6a810f233 Adds links to docs.openstack.org
In the side bar, links to past versions and docs.openstack.org

On the index.rst, links to wiki and docs.openstack.org

Change-Id: Icf33c6f396e1ab016fd86a56e61df3e063a1bae2
2012-04-23 10:48:24 -05:00
Jenkins
722127d6c0 Merge "updated docs for domain remap and cname lookup middleware" 2012-04-18 21:23:52 +00:00
Paul McMillan
92fbf44d10 Fixed grammar and improve docs.
Corrected its/it's mistakes, harmonized line wrapping within some docs
and clarified doc wording in several places.

Change-Id: Ib9ac6d5e859f770a702e1fad6de8d4abe0390b47
2012-04-10 12:27:14 -07:00
Pete Zaitcev
93964ff0a5 Fix colorization of "hash" in SAIO doc.
Admittedly, this is ridiculously trivial, but the coloring of
"hash" always peeved me. Not so much that it existed, but that
I did not understand what caused it. After consulting our Sphinx
experts, it turned out that the code block was considered code
in Python and "hash" is a reserved word in Python, so it was
colored.

One option is to declare the code block "ini", which is what
it is, but that causes the block stand out just as badly, unless
we highlight every one of them. So, for now use "none".

Change-Id: Icee021fc30839eeb02cd3e232ff6be92ed32df52
2012-04-10 10:44:55 -06:00
John Dickinson
edf2637026 updated docs for domain remap and cname lookup middleware
Change-Id: I1c571951f25a6e724cdd4699eb94baad5e47eb95
2012-04-05 15:02:15 -05:00
gholt
0becfab629 Added option to disable SQLite db preallocation
Added option to disable SQLite db preallocation. This can be very
useful on pure ssd account/container servers where the extra space is
worth more than the lesser fragmentation.

Change-Id: I8fbb028a9b6143775b25b343e97896497a8b63a9
2012-03-28 21:45:18 +00:00
John Dickinson
156f27c921 object versioning
Object versioning in swift is implemented by setting a flag on the container
to tell swift to version all objects in the container. The flag is the
``X-Versions-Location`` header on the container, and its value is the
container where the versions are stored.

When data is ``PUT`` into a versioned container (a container with the
versioning flag turned on), the existing data in the file is redirected to a
new object and the data in the ``PUT`` request is saved as the data for the
versioned object. The new object name (for the previous version) is
``<versions_container>/<object_name>/<timestamp>``, where the timestamp is
generated by converting the ``Last-Modified`` header value of the current
version to a unix timestamp.

A ``GET`` to a versioned object will return the current version of the object
without having to do any request redirects or metadata lookups.

Change-Id: I4fcd723145e02bbb2ec1d3ad356713f5dea43b8b
2012-03-28 15:48:43 -05:00
gholt
ac3cc680de Add an optional delay to account reaping.
Normally, the reaper begins deleting account information for deleted
accounts immediately. With this patch you can set it to delay its
work. You set the delay_reaping value in the [account-reaper] section
of the account-server.conf. The value is in seconds; 2592000 = 30
days, for example.

Unfortunately, there are currently zero tests for the account-reaper.
This also needs fixing, but I thought I'd submit this delay patch
alone for consideration.

Change-Id: Ic077df9cdd95c5d3f8949dd3bbe9893cf24c6623
2012-03-21 15:26:07 +00:00
John Dickinson
1ecf5ebba1 updated copyright date for all files
Change-Id: Ifd909d3561c2647770a7e0caa3cd91acd1b4f298
2012-03-19 13:45:34 -05:00
gholt
2c6de2ae52 Added optional max_containers_per_account restr...
Added optional max_containers_per_account restriction. If set to a
positive value and if a client tries to perform a container PUT when
at or above the max_containers_per_acount cap, a 403 Forbidden will
be returned with an explanatory message.

This only restricts the proxy server, not any of the background
processes that might need to create containers (replication, for
instance). Also, the container count is cached for the proxy's
recheck_account_existence number of seconds. For these reasons, a
given account could exceed this cap before the 403 Forbidden
responses kick in and therefore this feature should be considered a
"soft" limit.

You may also add accounts to the proxy's max_containers_whitelist
setting to have accounts that ignore this cap.

Change-Id: I74e8fb152de5e78d070ed30006ad4e53f82c8376
2012-03-15 19:41:31 +00:00
gholt
1c349a387d Make tests work like they used to.
Change-Id: I081d853a90ad0efce5b7a20b52794ce3348a9617
2012-03-13 15:47:41 +00:00
Florian Hines
9e713e1078 Add instructions for pip install via easy_install.
Add a line item to easy_install pip since we now need to pip install
openstack.nose_plugin. Fixes bug 951019

Change-Id: Ibf4b8bb7feac2b8290db2f4c4665dacf8a881462
2012-03-09 20:49:06 +00:00
Maru Newby
e6ea310751 Add support for venv-based test run with tox.
* Adds tox config
   - based on the config from python-quantumclient and updated for
     test, pep8 and coverage execution as per nova's run_tests.sh.
 * Adds nosetests defaults in setup.cfg
 * Adds runtime dependencies in tools/pip-requires
   - dependencies were gathered by referencing the packages used in
     creation of a Swift All In One.  Versions were determined by
     checking the swift-core/trunk ppa or, failing that, the version
     available in lucid.
 * Adds test dependencies in tools/test-requires
 * Updates swift/common/middleware/formpost.py for pep8 compliance
 * Adds instructions for executing the tests with Tox to the
   developer_guidelines
 * Adds instructions for installing openstack.nose_plugin to
   developer_saio
 * Fixes bug 909177

Change-Id: I5407924d2181e9ab335aaf76bf30c8d40deccbb4
2012-03-07 22:44:34 -08:00
Derek Higgins
40dbefc9f4 Fixing some minor issues in SAIO on Fedora
Change-Id: I2abdcd1a3c7f2a54b200489efe57f8990bd94bbf
2012-03-05 15:30:43 +00:00
Jesse Andrews
62864448bc add git commit date / sha1 to sphinx html docs
Change-Id: If47cee942707d2c36b0b897470b7ec994f0e259a
2012-03-02 16:14:35 -08:00
Jenkins
64cdc19490 Merge "Add json output option to swift-dispersion-report" 2012-02-29 22:09:10 +00:00
Jenkins
ca00956e25 Merge "Few fix in the SAIO doc: - Fix the ubuntu isos urls - Removed trailing whitespaces - Correct the text that explain how to build the documentation" 2012-02-29 20:08:59 +00:00
Florian Hines
5e4127ae2a Add json output option to swift-dispersion-report
Add's the configuration file option "dump_json" or command line
options [-j|--dump-json] to have swift-dispersion-report output
the report in json format. This allows the dispersion report to
be more easily consumed elsewhere.

There's also a few pep8 fixes and removal of unused imports.

Change-Id: I2374311ccbef43e6bbae24665c9584e60f3da173
2012-02-29 04:24:54 +00:00
Jenkins
5104cf4cfc Merge "added account_autocreate = true to example proxy config" 2012-02-28 21:28:33 +00:00
Jonathan Gonzalez V
38113e22fc Few fix in the SAIO doc:
- Fix the ubuntu isos urls
 - Removed trailing whitespaces
 - Correct the text that explain how to build the documentation

Change-Id: Ie19604d4586562dcef8c1d46addd14c15db2c442
2012-02-28 12:20:49 -03:00
Jenkins
091d6a230b Merge "Fix lp:875301" 2012-02-27 19:01:30 +00:00
Pete Zaitcev
133052b1ca Fix lp:875301
Pure formatting, not a word changed.

Change-Id: I95671428c5ad648497b0275489492d04e85ac79e
Bug: 875301
2012-02-22 18:43:05 -07:00
Pete Zaitcev
6f7f95ffde Add Fedora to SAIO.
In the past we had a document at Wiki, called RHELInstructions,
but it was permanently out of date, and someone deleted it, in
order to stop the confusion.

Differences for Fedora as quite small and it makes sense to maintain
them inside the main document.

This patch also fixes a couple of obvious problems:
 - a missing period
 - unwanted leading space that breaks a paragraph

Still no idea how to remove color from [swift-hash].

Change-Id: I73cda027c9d9bf695cd640a6d55735d82fba0048
2012-02-22 08:19:37 -07:00
John Dickinson
17e95941dd added account_autocreate = true to example proxy config
Change-Id: Ib25c61da37bcbbda7bbd729560996ef6b3be1670
2012-02-09 07:40:00 -06:00
gholt
7fc1721d7d TempURL and FormPost Middleware
Change-Id: I8d2ce2abdfe3a44605c9441ad7b1abc6c77e282d
2012-01-10 21:57:52 +00:00
Jenkins
89ef1f40f5 Merge "Added swift-orphans and swift-oldies." 2012-01-03 20:43:16 +00:00
Daniele Valeriani
29e703327c ~/swift/trunk doesn't exist after git clone
Change-Id: I0b12a1bd1a119aeedda07fa6f7883ae6318ee4d6
2012-01-03 15:40:35 +00:00
gholt
65dba1a7aa Added swift-orphans and swift-oldies.
Change-Id: I95210098556a22d7bd05f245ae387ee13041fa61
2011-12-29 19:19:41 +00:00
Jenkins
913cfcf728 Merge "Explain how replication works more clearly" 2011-12-21 17:02:41 +00:00
MORITA Kazutaka
c98ee54f68 Explain how replication works more clearly
A replicator creates an extra replica when it detects a remote disk
failure. However, when it fails to create a replica due to other
reasons (e.g. entire node failures), it doesn't create another replica
at all.  We should explain it explicitly so that users can know it.
This fixes bug 906976.

Change-Id: I2f56428ccbbb0cf0d8538ca6e08f7da71257e661
2011-12-21 12:56:23 +09:00
Maru Newby
56645b9cb1 Updates swift docs to use correct release PPA.
Changes swift doc references from defunct ppa repo swift-core/ppa to
new swift-core/release repo.  Fixes lp bug 905608.

Change-Id: I58d85b22d8dbcff43b03eb256ad39e03dd208bfc
2011-12-16 20:22:18 -08:00
Florian Hines
413ca11a5f Add sockstat info to recon.
Add's support for pulling info from /proc/net/sockstat and /proc/net/sockstat6 via recon.

Change-Id: Idb403c6eda199c5d36d96cc9027ee249c12c7d8b
2011-11-15 17:55:14 +00:00
Chmouel Boudjnah
c9728e7868 Change bzr to swift in getting_started doc.
Fixes #884766.

Change-Id: Id251fa04305352522db22cd27410f0b2e6e9fc06
2011-11-07 17:27:18 +01:00
gholt
872420efdb Expiring Objects Support
Please see the doc/source/overview_expiring_objects.rst for
more detail.

Change-Id: I4ab49e731248cf62ce10001016e0c819cc531738
2011-11-01 15:49:00 +00:00
Chmouel Boudjnah
74752c8d26 Remove bazaar/lp reference and change it to github
Change-Id: Ic58d3023f41204568bff9a4a77c895937b9456d2
2011-11-01 08:18:51 +01:00
Florian Hines
bb8c4eab41 Add documentation for Swift Recon.
Change-Id: I37f4fb624bdc5b8bbf2e691d29aa6b15cd648aa8
2011-10-21 00:17:10 +00:00
Chmouel Boudjnah
3b7442801d Fix documentation example.
get HTTPUnauthorized and HTTPForbidden from webob.exc

Change-Id: Id0a40077fb0adedd8cbf4f490e13fd522c92571a
2011-10-07 18:53:48 -04:00
Jenkins
30e71fa175 Merge "Use account_autocreate for tempauth." 2011-10-07 18:30:37 +00:00
Chmouel Boudjnah
6170e66b42 Use account_autocreate for tempauth.
We don't need to create ourself account in tempauth as we can use
account_autocreate from proxy server.

Change-Id: I6d0a044be361a53faee15d15177a9b5bc95da19e
2011-10-06 11:35:43 -04:00
Julien Danjou
e3e8a1c586 Fix documentation leftover from swift-stats rename
Change-Id: Ia6f4eeb626cc34b6cec43cab92a0afe7b46354e0
Signed-off-by: Julien Danjou <julien.danjou@enovance.com>
2011-10-05 17:05:23 +02:00
Chuck Thier
42c975aa4e Fixed ppa for multinode instructions 2011-08-31 19:08:02 +00:00
David Goetz
9986c0d8eb Changing ratelimiting so that it only limits PUTs/DELETEs. 2011-07-19 20:02:31 +00:00
David Goetz
c23fa42fad fix docs 2011-07-18 15:19:32 -07:00