6657 Commits

Author SHA1 Message Date
gord chung
5b216fae74 simplify gnocchi batch push setup
we run through samples and format samples and resources to what
gnocchi expects. this simplifies that process a little:
- don't needlessly sort and group by metric name
- build a full resource model iff resource needs to be created

Change-Id: I2ac25b3b0978eed664c500e645bae2d1b4ae6781
2018-01-08 18:19:11 +00:00
gord chung
40317d7bae compute sample as dictionary once
we shouldn't be wasting time doing the same thing over and over
in loop

Change-Id: Iaa5aeb5b91004945a24fab105c8b4884918c1644
2018-01-08 18:18:47 +00:00
gord chung
02e8ac2623 fix gnocchi stats logging
don't bother with a running count to build stats

Change-Id: I6c40e49046115512d5858a6e1348629e10d6a42f
2018-01-08 18:18:38 +00:00
gord chung
8099a9491c use hashmap to quickly find matching resource def
we shouldn't waste our time looping through resources and searching
metrics to find a match. just build hashmap and find the resource
based on metric.

this removes fnmatch functionality because we don't match on
wildcards and the code itself actually requires metric names to be
explicit to create_metrics

Change-Id: I2398247270217759c876ab5a9b60038dad79a9d3
2018-01-08 18:18:12 +00:00
gord chung
244ec7dedd cleanup measurements page
- remove note about previously storing events as meters.
- docs are not branchless anymore, remove anything that has been
removed
- minor grammar changes

Change-Id: If8486f5edb3d83c2d520345c028bc3f23609b376
2018-01-08 18:16:59 +00:00
Yuanbin.Chen
017c42b769 Add README.rst record more project message
Change-Id: I67a77ba02f503c454eeec857f65575a62ceb7170
Signed-off-by: Yuanbin.Chen <cybing4@gmail.com>
2018-01-08 20:49:05 +08:00
Zuul
1b6ad476dc Merge "Add user_id for sample volume.snapshot.size" 2018-01-05 14:30:12 +00:00
Zuul
0e9ad1ff1f Merge "Imported Translations from Zanata" 2018-01-05 09:17:10 +00:00
Zuul
b8b1da2440 Merge "Check required Gnocchi version is installed" 2018-01-05 08:42:48 +00:00
OpenStack Proposal Bot
c215379815 Imported Translations from Zanata
For more information about this automatic import see:
https://docs.openstack.org/i18n/latest/reviewing-translation-import.html

Change-Id: I10171d58e504f5d95db02ec366e6f451ddf9d28a
2018-01-05 06:52:24 +00:00
Zuul
f551a310be Merge "Replace ujson with json" 2018-01-04 18:47:19 +00:00
Zuul
f02dfce5bb Merge "update best practices" 2018-01-04 16:00:16 +00:00
Zuul
222a46568c Merge "cleanup data-pipelines admin guide" 2018-01-04 15:46:22 +00:00
Zuul
b3ebf0f97e Merge "cleanup data collection admin guide" 2018-01-04 15:41:07 +00:00
Mehdi Abaakouk
02c99b1867 Check required Gnocchi version is installed
Change-Id: I301511279c1d49736027e51274c8740935e154b0
2018-01-04 10:37:46 +01:00
James Page
05050e4b21 Replace ujson with json
ujson has not had any active maintenance for the last 12 months;
switch to using json module instead.

Change-Id: I39027b534e94b3f877d881647a7c843183f60f92
Closes-Bug: 1737989
2018-01-03 13:54:27 +00:00
Zuul
342feaa285 Merge "Fix maximum recursion depth exceeded bug when property referencing itself" 2018-01-03 12:44:41 +00:00
Zuul
26e554fb25 Merge "Run all telemetry tests in integration jobs" 2018-01-03 12:20:02 +00:00
Huachao Mao
87a97c68cf Fix maximum recursion depth exceeded bug when property referencing itself
Change-Id: Ifa5c3a03bfb05f8c69cb7a52f4a09d5d0f7855bd
2018-01-03 16:50:11 +08:00
Chandan Kumar
cfc6b3180e Run all telemetry tests in integration jobs
Change-Id: I551e218a3833bb3b55db6778b871e7994a4873b8
2018-01-03 08:09:46 +00:00
Zuul
a6da5a6b2f Merge "cleanup admin-guide architecture" 2018-01-03 07:53:45 +00:00
Zuul
bbf875011c Merge "Do not check iterable objects before for loop" 2018-01-03 01:37:57 +00:00
Zuul
379650c605 Merge "Add missing name traits" 2018-01-03 00:55:53 +00:00
Zuul
7b31c15adf Merge "reorder admin and contributor topics" 2018-01-03 00:30:07 +00:00
Zuul
6683bf17ef Merge "remove configuration from contributor guide" 2018-01-02 23:44:04 +00:00
Zuul
004c37cc3f Merge "remove install section from contributor guide" 2018-01-02 23:44:03 +00:00
Zuul
683d882b43 Merge "partial clean up of contributor install info" 2018-01-02 23:44:02 +00:00
Zuul
2f88891d0e Merge "ensure pipeline_listener set up" 2018-01-02 20:08:34 +00:00
gord chung
be1fa8f840 update best practices
- remove 'prior to ocata' conditions.
- remove shuffle_time_before_polling_task as it doesn't work in
reality and is being removed.
- add a note when to enable workload_partitioning of notification
agent

Change-Id: I44c030835de1517a3c067ab0632c09f4a5fe2f15
2018-01-02 16:20:31 +00:00
gord chung
935b53c9df cleanup data-pipelines admin guide
- add a note mentioning transformers are not durable and you
might be able to use gnocchi
- explain how to enabled/disable pipelines.

Change-Id: I3f50d5b5a1e22a114ef2c8e17c1e659f1c0eb761
2018-01-02 16:20:09 +00:00
gord chung
d5a89cd997 cleanup data collection admin guide
- remove list of notifications used for meters, it's not accurate
and is arguably of no value to an administrator even if it's
accurate. just list where the endpoints are and how to configure.
- remove comments about database connection, this means nothing
- remove libvirt comment, listing all services polled as these are
stated elsewhere and are just repeated.

Change-Id: If67ecf7e507da70abae3734618358c2458f49037
2018-01-02 16:20:04 +00:00
gord chung
5b85f02bd6 cleanup admin-guide architecture
- remove reference to api
- remove dup details on compute, central, ipmi already in data
collection
- remove hbase from panko support
- remove listing libvirt hypervisors, we only test kvm/qemu.
- remove generic listing of 'OpenStack Networking' meters. we already
have a measurements page for this
- remove user, roles, projects notes. we don't have api and it
means very little as is

Change-Id: I292cdd9297549ab8cb78caf6b15941b3986ca898
2018-01-02 16:19:42 +00:00
gord chung
435a00707f reorder admin and contributor topics
- create logical sections
- move troubleshooting-guide to bottom as it's basically useless
(but we should add to it)
- i've no idea what gmr is so i just put it where it is.

Change-Id: I647a84e2d29f00a8c64c42914939d60cc8aa6ebe
2018-01-02 16:19:17 +00:00
gord chung
96b4d1f7e5 remove configuration from contributor guide
- move polling configuration to admin data-collection docs
- move pipeline partitioning to admin data-pipeline docs
  - add a note that it's only required for transformations
- publisher section is already in admin docs
- pipeline configuration is already in admin docs

Change-Id: Ib29ec71d835b8625b518ede98e00078e7de3d282
2018-01-02 16:18:52 +00:00
gord chung
96f346abe8 remove install section from contributor guide
this is all irrelevant or duplicated:
- dbreco.rst
  - duplicates supported databases in admin-guide
  - ceilometer to gnocchi section is old and deck doesn't really
    reflect current gnocchi. also, all ocata+ docs install
    gnocchi by default.
- custom.rst
  - duplicates telemetry-data-pipelines in admin-guide
  - dups best practices in admin-guide with shuffle option
- upgrade.rst
  - upgrade is just stop, upgrade, restart for each service
  - nothing is unique except notification agent with partitioning[1]
    and existing stuff doesn't address it.

[1] https://bugs.launchpad.net/ceilometer/+bug/1729446

Change-Id: I2de2e7ba8789d896b19320c798150d0c4c6efe0d
2018-01-02 16:18:24 +00:00
gord chung
a386af9628 partial clean up of contributor install info
- remove duplication of install-guide steps
- create a page for installing with devstack and integrating
with other telemetry services.

Change-Id: I697ea46bcb0db02fdb561f0161e22411e23679c7
2018-01-02 16:17:53 +00:00
gord chung
835216e00b cleanup contributor plugins details
- remove section about tests. this is obvious and useless.
- move note about stevedore usage to top
- add note about how notification agents work
- remove most of polling details as new plugins are mostly
copy/paste.

Change-Id: I2962aa9815e821c8fc79a8658ddd999daf20b40d
2018-01-02 16:17:31 +00:00
Zuul
21da4b13d4 Merge "Remove filter_service_activity option in doc" 2018-01-02 16:09:53 +00:00
jing.liuqing
a3c5e9b7c1 Do not check iterable objects before for loop
get_VIFs, get_VBDs will return set

For more details see the XenAPI docs:
https://docs.citrix.com/content/dam/docs/en-us/xenserver/xenserver-62/xenenterpriseapi.pdf


Change-Id: Ic3f0e2eb18d5d6408c60979383465575e0a99d05
2018-01-02 15:22:29 +00:00
Zuul
ec702970ff Merge "Add doc8 to pep8 check for ceilometer project" 2018-01-02 14:30:55 +00:00
Zuul
634b6b9152 Merge "Do not check keystone domains length in TenantDiscovery" 2018-01-02 14:18:54 +00:00
jing.liuqing
cb4ba79f98 Do not check keystone domains length in TenantDiscovery
For keystone v2 and v3, it always return one domain at least

Change-Id: I1586bb07fe135eadc968fec1c675de48b88cf13c
2018-01-02 15:49:37 +08:00
Zuul
76b4e947d7 Merge "Imported Translations from Zanata" 2017-12-28 04:09:18 +00:00
Nguyen Van Trung
2e98fb2e0c Add doc8 to pep8 check for ceilometer project
This patch adds a doc8 check of .rst files to the current pep8 check.
It includes fixes to the .rst files that didn't pass the check.

Change-Id: If159ab37e2f59d7fe9ee1d7c3ebf0f62f030c87f
Co-authored-By: Hoang Trung Hieu <hieuht@vn.fujitsu.com>
2017-12-25 15:36:11 +00:00
OpenStack Proposal Bot
69fa8567ef Imported Translations from Zanata
For more information about this automatic import see:
https://docs.openstack.org/i18n/latest/reviewing-translation-import.html

Change-Id: I8a2a76cd707290cb1923e3bf324006dc38e135be
2017-12-24 07:58:09 +00:00
Huachao Mao
d2cc97f491 Remove filter_service_activity option in doc
Change-Id: I2540309359f1f309e2329fdc35f1b78df7b0e28b
2017-12-22 16:00:22 +08:00
jing.liuqing
39aaf97e8e Minor update comment of devstack settings
Change-Id: I273b4bcf3897416ffa61cfc92369b475d29ea8fb
2017-12-22 14:14:46 +08:00
jing.liuqing
0b898b467a Add user_id for sample volume.snapshot.size
Volume Snapshot details include user_id since version 3.41
https://developer.openstack.org/api-ref/block-storage/v3/#list-snapshots-and-details

Change-Id: I13ab9733d79a19bc191792ee8c7d11ab477df52e
2017-12-21 22:47:22 +08:00
jing.liuqing
0df0df7dff Remove useless trailing newlines
Change-Id: Id8ed40014679d5b999e3a43ef8f957eea90d28a5
2017-12-21 18:05:36 +08:00
jing.liuqing
1b6f6483a6 Add missing name traits
Change-Id: I4515c7d34be0b3636ad071201c19fe9e3ad83f1e
Closes-Bug: #1738361
2017-12-21 13:45:54 +08:00