4009 Commits

Author SHA1 Message Date
Chris Dent
06ea97ae45 Close and dispose test database setup connections
Without explicitly closing and disposing the connections can linger in a
non-deterministic fashion and cause intermittent "too many connection"
errors in the tests.

This is effectively a "backport" of change
I8badf2a3094f2d27d381bd178c6d579f2a5c5ffe in aodh, made here for
safety despite not seeing the problem regularly in the ceilometer
tests.

The -N 100 is removed from the setup-test-env so that we are using
whatever the postgresql default is, meaning that these tests will be
better at exposing errors that users may see.

Change-Id: I694d118ff8dc2b5c8be633121fa1037130fbe874
2015-07-23 16:14:57 +00:00
Jenkins
6c20b50c6b Merge "add mandatory limit value to meter list" 2015-07-23 12:46:36 +00:00
Jenkins
6cf0f6bb52 Merge "add mandatory limit value to resource list" 2015-07-23 12:46:27 +00:00
Jenkins
c01d1f523e Merge "Fix broken IPMI agent" 2015-07-23 08:28:03 +00:00
Jenkins
cfe81a584e Merge "Handles dns.domain.exists event in Ceilometer" 2015-07-23 07:02:20 +00:00
Jenkins
e5562b7e73 Merge "add mandatory limit value to event list" 2015-07-23 04:35:01 +00:00
Edwin Zhai
287738ba5f Fix broken IPMI agent
Use right oslo_rootwrap config to generate ceilometer rootwrap
scripts.

Change-Id: I9ba9cfab94d1c6f3d7e708c4460c286b209b128a
Closes-Bug:#1477115
2015-07-23 12:18:50 +08:00
Jenkins
ae7587a36a Merge "Pollsters now send notifications without doing transforms" 2015-07-22 18:43:51 +00:00
gordon chung
f3c01e7528 add mandatory limit value to meter list
unrestricted listing of meters can require significant memory.
this patch implements mandatory limit on meter-list

Change-Id: I8b38136c2493e75fbc7d9aef75aa055463a26319
Implements: blueprint mandatory-limit
2015-07-22 13:48:51 +00:00
gordon chung
1852eaf48e add mandatory limit value to resource list
unrestricted listing of resources can require significant memory.
this patch implements mandatory limit on resource-list

Change-Id: I5820ce759b20757febc1b92c100f584234b36b68
Implements: blueprint mandatory-limit
2015-07-22 13:48:44 +00:00
gordon chung
50fc88183c add mandatory limit value to event list
unrestricted listing of events can require significant memory.
this patch implements mandatory limit on event-list

sql backend requires a little rewrite due to fact that we grab data
in two steps: first we grab all events matching query, then we grab
appropriate traits (we don't use orm relationships because it's slow).
we can not just append order_by and limit to first query because we
use query in second part as well and sqlite will complain about
order_by/limit coming before join. this patch changes it to use a
subquery. based on testing, this does not appear to degrade
performance.

DocImpact
ApiImpact

Change-Id: Ib8009d6e4ab6d066ba5fca43b824c24c8cb32d4e
Implements: blueprint mandatory-limit
2015-07-22 09:48:08 -04:00
Jenkins
192c352ea1 Merge "Sort metric data before grouping and processing" 2015-07-22 04:46:14 +00:00
Jenkins
bee1d5e02f Merge "make notifier default event publisher" 2015-07-20 19:53:35 +00:00
Jenkins
0b7cf97518 Merge "Imported Translations from Transifex" 2015-07-20 19:48:16 +00:00
Rohit Jaiswal
c2c3273c2d Handles dns.domain.exists event in Ceilometer
Ceilometer handles Designate CRUD notifications
as events, but not the exists notification.

This fix handles the exists notification as
event and sample for measurable audit interval.

Change-Id: I53d63cc4c8bcc6924afb0560bd8482d94e564895
Closes-Bug: 1474608
2015-07-20 17:23:01 +00:00
Chris Dent
5b9e5d8e7a Pollsters now send notifications without doing transforms
This makes the polling agents not use pipelines. Instead it simply sends
notifications for the notification agent to pick up and transform if
the pipeline.yaml says it should.

Inside the AgentManager and the PollingTask the data representation
is adjusted somewhat. Rather than making a single task for any given
interval, we make a single task for any name in the "sources" list.
This ought to mean (given that the interval is the same across
various sources in the default config) that we will get some I/Ox
interleaving.

At the moment all samples gathered by one pollng task are sent as an
individual notification. This is being done to minimize the apparent
surface area of this change. The expected long term change is for
single samples to be sent so as to increase granularity and
I/O interleaving.

The unit tests have been updated to reflect the new data
representation. The agent tests are fairly strongly oriented towards
testing that discovery and resource handling behave correctly. Some
additions have been made to make sure that samples traverse a fake
messaging bus as expected. Coverage of the ceilometer/agent/base has
increased from 98 to 99%. Additional functional testing should be
implemented when we have established the infrastructure for such
things.

Implements blueprint pollsters-no-transform

DocImpact

Change-Id: I25c22077e80509799713571dfd79c87fe21c8677
2015-07-20 14:09:11 +00:00
Jenkins
a2e7fce7a7 Merge "Switch to the oslo_utils.fileutils" 2015-07-20 10:55:17 +00:00
Jenkins
b5ac94c656 Merge "add Trove(DBaaS) events" 2015-07-20 09:24:51 +00:00
OpenStack Proposal Bot
89c66f08ee Imported Translations from Transifex
For more information about this automatic import see:
https://wiki.openstack.org/wiki/Translations/Infrastructure

Change-Id: I674241f4287b3ed47fb5f9fd5f90390d35e85d6d
2015-07-20 06:09:59 +00:00
Jenkins
391010e64d Merge "Updated from global requirements" 2015-07-20 02:12:22 +00:00
Jenkins
807b625ab9 Merge "Add necessary executable permission" 2015-07-20 02:11:22 +00:00
Sergey Vilgelm
889e66eb49 Switch to the oslo_utils.fileutils
fileutils is graduated in the oslo.utils library.
Remove the openstack.common package as well.

Implements: blueprint graduate-fileutils[1]
[1] https://blueprints.launchpad.net/oslo-incubator/+spec/graduate-fileutils

Depends-On: I51ba9076e1fbc16145ee2311f47b7768c16dcb20 (requirements)
Depends-On: I661dd222da6386a7dbcf854958a63e59b13e9ba4 (oslo.utils)

Change-Id: I6ba8f492a257096d27cbe83bfd06e53b7aabfa5d
2015-07-19 23:46:28 +03:00
Jenkins
ef7623e2ac Merge "Use choices for hypervisor_inspector option" 2015-07-19 13:22:33 +00:00
OpenStack Proposal Bot
08237a7699 Updated from global requirements
Change-Id: I697330940cd49bba859c193c2ebdff9261c61fe8
2015-07-18 16:03:42 +00:00
Eric Brown
708fc84e09 Use choices for hypervisor_inspector option
The hypervisor_inspector option allows the loading of various
drivers.  The choice of drivers is limited to those within the
'ceilometer.compute.virt' namespace as indicated in
get_hypervisor_inspector().

Change-Id: I358b18ae190cdb578381f3af79956ace1ba97ec6
2015-07-17 23:14:31 -07:00
Eric Brown
078efd543a The product name Vsphere should be vSphere
Within the VMware compute driver there are various references to
"Vsphere" when the proper product name should be "vSphere".

TrivialFix

Change-Id: Ic7e51b99cc1c88212b24d22d3adda3d872e12bbf
2015-07-17 23:07:44 -07:00
Jenkins
36af88fe92 Merge "Fix gnocchi DispatcherTest tests" 2015-07-18 01:54:12 +00:00
Jenkins
527e7b4783 Merge "Store and restore the xtrace option in devstack plugin" 2015-07-17 20:06:47 +00:00
Jenkins
ef31b6b4f0 Merge "Delay the start of the collector until after apache restart" 2015-07-17 17:23:17 +00:00
Jenkins
9a6b55b5cf Merge "gnocchi: Remove useless resources patching" 2015-07-17 14:41:13 +00:00
Jenkins
e4835676c1 Merge "Clean the re-implemented serializers in Ceilometer" 2015-07-17 14:38:18 +00:00
Qiaowei Ren
ca1cd7a616 Add necessary executable permission
Change-Id: I626ed411a1d476a2fa48a8cbea553e59bb8e5f05
2015-07-17 07:33:03 +00:00
Jenkins
9a67d602b3 Merge "Declarative meters support" 2015-07-16 19:07:55 +00:00
Jenkins
87576a862e Merge "Set conf.gnocchi_dispatcher.url explicitly in tests" 2015-07-16 16:06:44 +00:00
Chris Dent
6d7c7cb00a Store and restore the xtrace option in devstack plugin
Otherwise we might upset the xtrace setting in other files.

Change-Id: I93e7654fb67f455d3cbedb1e6cd010651d8d67dd
2015-07-16 13:17:06 +00:00
Mehdi Abaakouk
7414af1d8e gnocchi: Remove useless resources patching
Change-Id: If8967efe9dea5222f90de640a4d27a3232ea2b7f
2015-07-16 13:26:58 +02:00
Rohit Jaiswal
014ee79698 add Trove(DBaaS) events
this patch adds support for Trove crud notifications
as events in ceilometer, and a notification plugin to
emit sample for the trove exists event.

Change-Id: I932941c88e7c8e9f059c97ec41ac098263e38803
Partially-Implements: blueprint track-dbaas-notifications
2015-07-16 05:35:14 +00:00
Chris Dent
feaee6ece1 Set conf.gnocchi_dispatcher.url explicitly in tests
Otherwise the value in /etc/ceilometer/ceilometer.conf can conflict
and cause test failures.

Change-Id: I06bbdaab0ee1396616855d3d54542845caa2b95f
2015-07-15 19:27:05 +00:00
Pradeep Kilambi
0a895a8212 Declarative meters support
This is the initial support to migrate some basic meters to
leverage declarative approach.

Partially Implements: blueprint declarative-notifications

Change-Id: I64a4b2925981cfa14dc22ae30acd1f17821c9a2c
2015-07-15 14:36:37 -04:00
Ilya Tyaptin
a744e1b9e7 Stop the tests if backend hasn't started
Now wait_for_line function behaves like all is ok even
if line hasn't been founded, but it should stop tests running.
In current CR checking of this situation is added.

Change-Id: I9f992feffd8d528e16d00269f62d24ce241f88ca
2015-07-15 21:22:00 +03:00
Chris Dent
33de8f9904 Delay the start of the collector until after apache restart
Otherwise when using the gnocchi plugin keystone can drop out of
sight at exactly the wrong time.

Change-Id: If0d5faaadd297cbb6c25dd66da07e83a4bce71bd
2015-07-15 17:02:09 +00:00
LiuSheng
3cdeb25bd0 Clean the re-implemented serializers in Ceilometer
The RequestContextSerializer and JsonPayloadSerializer have been
implemented in oslo_messaging, This change remove the re-implemented
serializers in ceilometer/messaging.py

Change-Id: I871ff34a8e1a140273fd10fe1fbb539ff864c9f7
Closes-Bug: 1467524
2015-07-15 09:28:12 +08:00
Chris Dent
f7e0592cf9 monkey_patch thread in tests
oslo.messaging recommends that eventlet be monkey_patched for
thread to avoid spurious or unexpected lock-ups (which we have
been witnessing recently).

Change-Id: I9b2dbc09441bd2e812a44f9c6da948a6889adc29
2015-07-14 18:58:33 +00:00
gordon chung
2b01aeee59 make notifier default event publisher
direct publisher is mainly for testing and was used for event
pipeline to maintain consistency with previous functionality. this
patch makes notifier default to move storage load to collector
where it should be.

Change-Id: I2b12ac8afcd6e66e36d03276198f2d8e310b518f
2015-07-14 11:23:11 -04:00
liu-sheng
e76bf88be8 Fix gnocchi DispatcherTest tests
The test_activity_filter_match_project_id tested failed, in the test
class, the filter_service_activity configure option is False, this cause
the _is_gnocchi_activity() method in gnocchi.py always returning False.

Change-Id: Ib07ca4e05a8ca5a5b0864a69062b25b8ce2506e1
Closes-Bug: #1474331
2015-07-14 19:58:38 +08:00
liu-sheng
9f85f7010d Sort metric data before grouping and processing
In gnocchi dispatcher, metric data will be grouped by resource_id and
counter_name before processing. But the inputted data is an unordered
list. It is better being sorted by resource_id and counter_name before
processing.

Change-Id: I8f493f720c479fd84b1a554ee5196115b992ecd1
2015-07-14 15:40:09 +08:00
Jenkins
617ae2b384 Merge "Make ceilometer work correctly when hosted with a SCRIPT_NAME" 2015-07-13 17:02:14 +00:00
Jenkins
5298f83397 Merge "Implementation of dynamically reloadable pipeline" 2015-07-13 14:32:31 +00:00
Jenkins
65fe2b2305 Merge "Namespace functions in devstack plugin" 2015-07-13 14:32:26 +00:00
Jenkins
0a90c9fb4b Merge "disable non-metric meters" 2015-07-12 16:47:49 +00:00