openstack/swift
Code Issues Proposed changes

fixing case thing and adding docs

Browse Source
This commit is contained in:
David Goetz
2011-06-08 08:55:14 -07:00
parent 34e121200a
commit 68e5719a81
3 changed files with 11 additions and 7 deletions
Download Patch File Download Diff File Expand all files Collapse all files

11
doc/source/overview_stats.rst
View File

@@ -19,11 +19,11 @@ the proxy log output to an hourly log file. For example, a proxy request that
is made on August 4, 2010 at 12:37 gets logged in a file named 2010080412. is made on August 4, 2010 at 12:37 gets logged in a file named 2010080412.
This allows easy log rotation and easy per-hour log processing. This allows easy log rotation and easy per-hour log processing.
****************** *********************************
Account stats logs Account / Container DB stats logs
****************** *********************************
Account stats logs are generated by a stats system process. DB stats logs are generated by a stats system process.
swift-account-stats-logger runs on each account server (via cron) and walks swift-account-stats-logger runs on each account server (via cron) and walks
the filesystem looking for account databases. When an account database is the filesystem looking for account databases. When an account database is
found, the logger selects the account hash, bytes_used, container_count, and found, the logger selects the account hash, bytes_used, container_count, and
@@ -34,7 +34,8 @@ runs the account stats logger every hour. Therefore, in a cluster of ten
account servers, ten csv files are produced every hour. Also, every account account servers, ten csv files are produced every hour. Also, every account
will have one entry for every replica in the system. On average, there will be will have one entry for every replica in the system. On average, there will be
three copies of each account in the aggregate of all account stat csv files three copies of each account in the aggregate of all account stat csv files
created in one system-wide run. created in one system-wide run. The swift-container-stats-logger runs in a
similar fashion, scanning the container dbs.
---------------------- ----------------------
Log Processing plugins Log Processing plugins

1
etc/log-processor.conf-sample
View File

@@ -54,3 +54,4 @@ processable = false
# devices = /srv/node # devices = /srv/node
# mount_check = true # mount_check = true
# user = swift # user = swift
# metadata_keys = comma separated list of user metadata keys to be collected

6
swift/stats/db_stats_collector.py
View File

@@ -139,8 +139,10 @@ class ContainerStatsCollector(DatabaseStatsCollector):
super(ContainerStatsCollector, self).__init__(stats_conf, 'container', super(ContainerStatsCollector, self).__init__(stats_conf, 'container',
container_server_data_dir, container_server_data_dir,
'container-stats-%Y%m%d%H_') 'container-stats-%Y%m%d%H_')
self.metadata_keys = [mkey.strip() for mkey in # webob calls title on all the header keys
stats_conf.get('metadata_keys', '').split(',') if mkey.strip()] self.metadata_keys = ['X-Container-Meta-%s' % mkey.strip().title()
for mkey in stats_conf.get('metadata_keys', '').split(',')
if mkey.strip()]
def get_header(self): def get_header(self):
header = 'Account Hash, Container Name, Object Count, Bytes Used' header = 'Account Hash, Container Name, Object Count, Bytes Used'