774 Commits

Author SHA1 Message Date
Jenkins
5961c5f7fb Merge "fixups for ipv6 memcache_servers docs" 2016-01-13 13:41:34 +00:00
Jenkins
00a4e2ce4b Merge "Install liberasurecode packages in SAIO." 2016-01-13 13:38:29 +00:00
Clay Gerrard
3347646023 fixups for ipv6 memcache_servers docs
Change-Id: I20d91c1e276014eaf210fa9eb43788bc17f4e8df
2016-01-12 21:08:58 -08:00
Jenkins
3077639d3f Merge "swift-init: New option kill-after-timeout" 2016-01-13 02:53:04 +00:00
Samuel Merritt
d5ff5447be Install liberasurecode packages in SAIO.
Change-Id: If673afa2b61a3e388612debf4860d561960963a3
2016-01-12 16:42:06 -08:00
Harshada Mangesh Kakad
6786cdf036 Fixing the deprecated library function.
os.popen() is deprecated since version 2.6. Resolved with use of
subprocess module.

Change-Id: I4409cdd9edbc1a26d6f99c125c9100fadda5d758
Partial-Bug: #1529836
2016-01-06 09:26:38 -08:00
Ondřej Nový
3b1591f235 swift-init: New option kill-after-timeout
This option send SIGKILL to daemon after kill_wait period.
When daemon hangs and doesn't respond to SIGTERM/SIGHUP
there is no way to stop it using swift-init now. Classic
init scripts in Linux kills hanged process after grace
period and this patch add same behaviour. This is most
usefull when using "restart" on hanged daemon.

Change-Id: I8c932b673a0f51e52132df87ea2f4396f4bba9d8
2016-01-05 11:34:03 +01:00
Jenkins
d446035ec4 Merge "Add support for storage policies to have more than one name" 2015-12-23 00:45:59 +00:00
Jenkins
dafeea6322 Merge "Fix incorrect kwarg in auth middleware example" 2015-12-18 22:04:47 +00:00
Jenkins
a5ce170c80 Merge "Update Erasure Coding Overview doc to remove Beta version" 2015-12-18 22:02:57 +00:00
Bill Huber
0bcd7fd50e Update Erasure Coding Overview doc to remove Beta version
The major functionality of EC has been released for Liberty and
the beta version of the code has been removed since it is now
in production.

Change-Id: If60712045fb1af803093d6753fcd60434e637772
2015-12-18 11:43:12 -06:00
Alistair Coles
84ba24a756 Fix rst errors so that html docs are complete
rst table format errors don't break the gate job
but do cause sections of the documents to go missing
from the html output.

Change-Id: Ic8c9953c93d03dcdafd8f47b271d276c7b356dc3
2015-12-18 11:24:34 +00:00
Alistair Coles
e15960a5d8 Fix incorrect kwarg in auth middleware example
When calling memcache_client.set(), timeout was deprecated
and is now removed as a keyword arg, use time instead.

Change-Id: Iedbd5b064853ef2b386963246f639fbcd3931cd3
2015-12-17 12:12:02 +00:00
Hisashi Osanai
450737f886 Fix a typo in development_auth.rst
This patch uses correct name for "CORS".

Change-Id: I5fee5c581a2b3adb7596a273baf05708bfa97f79
2015-12-15 11:46:01 +09:00
Jenkins
500f7e8d34 Merge "Unification of manpages and conf-samples (default values, etc)" 2015-12-11 03:20:52 +00:00
Catherine Northcott
211758f8cb Add support for storage policies to have more than one name
This patch alters storage_policy.py to allow storage policies
to have multiple names. Now users are able to add a number of
human-readable aliases for storage policies. Policies now have
a .name (the default name), .aliases (a string of comma
seperated aliases), and .aliases_list (a list of all human
readable names). Policies will always have an .aliases value
if no aliases are set it will contain the default name.
The policy docs and tests have been updated to reflect changes
and policy.get_policy_info has been altered to display the
name and aliases

Change-Id: I02967ca8d7c790595e5ee551581196aa64552eea
2015-12-10 14:47:23 +13:00
John Dickinson
70bc3d1a3a added a few ruby clients to associated projects
Change-Id: I4764ba505646949ff694f8939947f83c6940128a
2015-12-08 16:08:04 -08:00
Peter Lisák
28c4b7310f Unification of manpages and conf-samples (default values, etc)
Change-Id: I47a3127ef698b4bd1537b1562901ee9c2b5924d4
2015-11-30 10:08:16 -08:00
Jenkins
72ea23f590 Merge "Add more functional tests for reverse listings" 2015-11-26 04:40:02 +00:00
Jenkins
caebea16d6 Merge "swift-init return codes" 2015-11-25 16:25:55 +00:00
Jenkins
f48c6f508e Merge "Add container and account reverse listings" 2015-11-24 17:54:57 +00:00
Alistair Coles
aeccbc2074 Add more functional tests for reverse listings
Also fix typo in the api doc.

Follow-on to change I5eb655360ac95042877da26d18707aebc11c02f6

Change-Id: Ic1ea63c74a0a3b90a505865fba8fcfac584d0825
2015-11-24 17:13:47 +00:00
Matthew Oliver
7c1e6cd583 Add container and account reverse listings
This change adds the ability to tell the container or account server to
reverse their listings. This is done by sending a reverse=TRUE_VALUE,

Where TRUE_VALUE is one of the values true can be in common/utils:

  TRUE_VALUES = set(('true', '1', 'yes', 'on', 't', 'y'))

For example:

  curl -i -X GET -H "X-Auth-Token: $TOKEN" $STORAGE_URL/c/?reverse=on

I borrowed the swapping of the markers code from Kevin's old change,
thanks Kevin. And Tim Burke added some real nuggets of awesomeness.

DocImpact
Co-Authored-By: Kevin McDonald <kmcdonald@softlayer.com>
Co-Authored-By: Tim Burke <tim.burke@gmail.com>
Implements: blueprint reverse-object-listing

Change-Id: I5eb655360ac95042877da26d18707aebc11c02f6
2015-11-24 15:08:45 +00:00
Jenkins
26ddb1b5ed Merge "remove remaining simplejson uses, prefer standard library import" 2015-11-19 22:45:46 +00:00
Jenkins
f79182ec0a Merge "Remove references to now-missing havana docs" 2015-11-17 06:11:08 +00:00
Zack M. Davis
1b8b08039a remove remaining simplejson uses, prefer standard library import
a1c32702, 736cf54a, and 38787d0f remove uses of `simplejson` from
various parts of Swift in favor of the standard libary `json`
module (introduced in Python 2.6). This commit performs the remaining
`simplejson` to `json` replacements, removes two comments highlighting
quirks of simplejson with respect to Unicode, and removes the references
to it in setup documentation and requirements.txt.

There were a lot of places where we were importing json from
swift.common.utils, which is less intuitive than a direct `import json`,
so that replacement is made as well.

(And in two more tiny drive-bys, we add some pretty-indenting to an XML
fragment and use `super` rather than naming a base class explicitly.)

Change-Id: I769e88dda7f76ce15cf7ce930dc1874d24f9498a
2015-11-16 12:34:24 -08:00
Tim Burke
e534af645d Remove references to now-missing havana docs
Change-Id: I3c708bacd468e923e574bdd5afc7acc58b072159
2015-11-16 10:49:17 -08:00
Lisak, Peter
7b7c6c5249 swift-init return codes
Currently, swift-init returns zero if can't locate config on start.
Because of this problem, it is not possible to distinguish if managed
to start server.

Due to legacy two new complementary options are added. Default is context
dependent.
--strict returns non-zero if some config is missing (default mode
if explicitly named server)
--non-strict returns zero even if some config is missing (default mode
if alias is used)

As a side effect:
If some of demanded servers already running it does not try to start
unstarted and also returns non-zero (in strict mode). That is still sufficient
for the goal of patch.

For future improvements LSB status codes should be considered.

DocImpact
Change-Id: I7750abd4a94875b46f83f4aeee8509388d543c2b
2015-11-16 07:07:11 +01:00
Ondřej Nový
84891ba5a1 New swauth URL
Change-Id: I019f921417d2bd5325141e8a6873ee934fdf3f49
2015-11-15 19:25:05 +01:00
Jenkins
58fcc82428 Merge "Compare Swift config checksum in swift-recon --all" 2015-11-10 19:34:17 +00:00
venkatamahesh
705642db4c Change stackforge repo to openstack repo
The projects which are moved to openstack
are corrected by replacing stackforge with openstack

Change-Id: I65b794a7f10df617bc2a4caf2c4010477a82dbc2
2015-11-10 19:46:31 +05:30
Ondřej Nový
e0430fc74a Compare Swift config checksum in swift-recon --all
Change-Id: I796fe0895f4e5ddeb04c0d79a73579ce8bb9aa40
2015-11-05 21:21:21 +01:00
Jenkins
7242c4a006 Merge "Fix missing *-replicator conf sections in deployment guide" 2015-11-03 22:51:24 +00:00
Paul Dardeau
73e032049f Update admin guide with region.
Added region prefix to example commands for adding devices to ring.
Also updates description to include region prefix.

Change-Id: Ie6d6485b497cea973e37909b5b19b44946c8aa89
2015-10-23 18:20:25 +00:00
Alistair Coles
1a2b54fc0a Fix missing *-replicator conf sections in deployment guide
The doc for these sections was missing because of an rst error - the
source is there in rst file but didn't make it into the html output.

Add doc for per_diff and max_diffs in account and container doc sections.

Also, fix a bunch of other sphinx build errors and most of the warnings.

Change-Id: If9ed2619b2f92c6c65a94f41d8819db8726d3893
2015-10-23 14:58:38 +01:00
Lisak, Peter
b6b7578190 node_timeout as float in configs
It is more convenient to use float node_timeout for fine tunning latency.

Change-Id: I7c57bba053711a27d3802efe6f2a0bf53483a54f
2015-10-19 21:14:34 +02:00
Jenkins
8a68033948 Merge "Hyperlink fix to first contribution doc" 2015-10-16 17:30:03 +00:00
Mahati Chamarthy
a9ddc2d9ea Hyperlink fix to first contribution doc
Change-Id: I19fc1abc89f888233b80a57c68a152c1c1758640
2015-10-16 19:34:44 +05:30
asettle
384b91eb82 Moving DLO functionality doc to the middleware code
This change moves the RST DLO documentation from
statically inside overview_large_objects.rst and moves it
to middleware/dlo.py.
This is where all middleware RST documentation is defined.

The overview_large_objects.rst is still the main page
for information on large objects, so now dynamically
points to both the DLO and SLO middleware RST
documentation and the relevant middleware.rst page
simply points to it.

Change-Id: I40d918c8b7bc608ab945805d69fe359521df038a
Closes-bug: #1276852
2015-10-13 10:35:46 +01:00
Ondřej Nový
9cafa472a3 Autodetect systemctl in SAIO and use it on systemd distros
Change-Id: I84a9b27baac89327749d8774032860f8ad5166f2
2015-10-12 22:39:52 +02:00
Alistair Coles
01f9d15045 Fix EC documentation of .durable quorum
Update the doc to reflect the change [1] to ndata + 1
.durable files being committed before a success response
is returned for a PUT.

[1] Ifd36790faa0a5d00ec79c23d1f96a332a0ca0f0b

Change-Id: I1744d457bda8a52eb2451029c4031962e92c2bb7
2015-10-08 18:55:29 +01:00
Alistair Coles
167f3c8cbd Update EC overview doc for PUT path
Update the EC overview docs 'under the hood' section to reflect the
change in durable file parity from 2 to ec_nparity + 1 [1].

Also fix some typos and cleanup the text.

[1] change id I80d666f61273e589d0990baa78fd657b3470785d

Change-Id: I23f6299da59ba8357da2bb5976d879d9a4bb173e
2015-09-30 09:45:57 +01:00
Jenkins
241b68da9e Merge "Allows to configure the rsync modules where the replicators will send data" 2015-09-16 12:06:27 +00:00
Jenkins
e399dcbdaa Merge "Update EC Support on how to build an EC ring with replicas count" 2015-09-16 03:46:36 +00:00
Bill Huber
530102ae07 Update EC Support on how to build an EC ring with replicas count
This doc is being updated to specify the replicas count parameter
to build an EC ring that enforces both data and parity placements
for each partition.

Change-Id: I770ad268e4017e610be3357e89b89f0b7d3c18af
Closes-Bug: 1487203
2015-09-15 09:40:39 +01:00
Clay Gerrard
0d9142abd4 Fix typo in Deployment Guide and add some formatting
Change-Id: I58703162bf3e9f39656a5e511bd8fe845793bca2
2015-09-14 17:17:29 -07:00
Jenkins
63ab40db9a Merge "Improving statistics sent to Graphite." 2015-09-09 07:12:01 +00:00
Romain LE DISEZ
71f6fd025e Allows to configure the rsync modules where the replicators will send data
Currently, the rsync module where the replicators send data is static. It
forbids administrators to set rsync configuration based on their current
deployment or needs.

As an example, the rsyncd configuration example encourages to set a connections
limit for the modules account, container and object. It permits to protect
devices from excessives parallels connections, because it would impact
performances.

On a server with many devices, it is tempting to increase this number
proportionally, but nothing guarantees that the distribution of the connections
will be balanced. In the worst scenario, a single device can receive all the
connections, which is a severe impact on performances.

This commit adds a new option named 'rsync_module' to the *-replicator sections
of the *-server configuration file. This configuration variable can be
extrapolated with device attributes like ip, port, device, zone, ... by using
the format {NAME}. eg:
    rsync_module = {replication_ip}::object_{device}

With this configuration, an administrators can solve the problem of connections
distribution by creating one module per device in rsyncd configuration.

The default values are backward compatible:
    {replication_ip}::account
    {replication_ip}::container
    {replication_ip}::object

Option vm_test_mode is deprecated by this commit, but backward compatibility is
maintained. The option is only effective when rsync_module is not set. In that
case, {replication_port} is appended to the default value of rsync_module.

Change-Id: Iad91df50dadbe96c921181797799b4444323ce2e
2015-09-07 08:00:18 +02:00
Emett Speer
e4542455c8 [Labs] Update links to Cloud Admin Guide
Update links to the Cloud Admin Guide after the
RST conversion of that book altered URLs.

Change-Id: I899f8938498b744e62887968a65e58c00ef27f1b
2015-09-02 17:42:31 -07:00
Brian Cline
615c7a204b Adds useful dispersion info from changelog
Change-Id: I1a45088fc32620b02ff9a754b02ec1eb75a59d6e
2015-09-01 10:51:20 -05:00