From 2d573a1aae438c974e63b7567995e133bf315834 Mon Sep 17 00:00:00 2001 From: Dirk Mueller Date: Sun, 28 Oct 2018 17:29:56 +0100 Subject: [PATCH] Update git submodules * Update oslo.messaging from branch 'master' - Avoid unnecessary use of items() The key, value pair returned by items() wasn't used here, so rewrite the logic to just iterate over the keys, filtered by the type. Change-Id: I7512ea93ac794d161a4cd9944546d6ca035a12cf - Merge "Switch driver to confluent-kafka client library" - Update mailinglist from dev to discuss openstack-dev was decomissioned this night in https://review.openstack.org/621258 Update openstack-dev to openstack-discuss Change-Id: I7d889d3f9a6c95e707ed57dbf5a9cffb1d41ddf5 - Switch driver to confluent-kafka client library This patch switches the kafka python client from kafka-python to confluent-kafka due to documented threading issues with the kafka-python consumer and the recommendation to use multiplrocessing. The confluent-kafka client leverages the high performance librdkafka C client and is safe for multiple thread use. This patch: * switches to confluent-kafka library * revises consumer and producer message operations * utilizes event.tpool method for confluent-kafka blocking calls * updates unit tests * adds kafka specific timeouts for functional tests * adds release note Depends-On: Ice374dca539b8ed1b1965b75379bad5140121483 Change-Id: Idfb9fe3700d882c8285c6dc56b0620951178eba2 - Don't use monotonic with Python >=3.3 A change to the global-requirements has limited use of monotonic library to Python versions earlier than 3.3 (later versions have built-in support for a monotonic clock), so limit it in requirements.txt. Note: this patch updates kafka driver (due to deprecated exception in library) in order to pass unit tests Change-Id: Id6b0814e05a0e548a8c2a5359daf1a6878cf6859 - Merge "Add a test for rabbit URLs lacking terminating '/'" - Use ensure_connection to prevent loss of connection error logs Change-Id: I31e3f83304c0780cfd380aa63ec2962c3c28ec78 Closes-Bug: #1801011 - Merge "Use default exchange for direct messaging" - Merge "doc: Remove crud from conf.py file" - Add a test for rabbit URLs lacking terminating '/' Change-Id: I062ca84b6b8a5d1eeccafef87608c783ad5ffb03 - Use '/' for the vhost if the transport_url has no trailing '/' This change https://review.openstack.org/#/c/599912/ accidentally removed setting the virtual host to '/' if none were provided in the transport_url configuration option. Closes-Bug: #1798241 Change-Id: I2dbcec3f77eb7cc513350b00ea020cc8faaecec1 - Merge "Clean up .gitignore references to personal tools" - Using pip as a python module Since python 2.7.9 and python 3.4 pip is a stdin module Change-Id: I17c8c93337fa4f0a33f9131d4117739179133ea9 - doc: Remove crud from conf.py file Change-Id: I35c6221f78cac9fe4ab3e194e8a94ca4f0b24ca2 - Clean up .gitignore references to personal tools Developers run all sorts of different tools within Git repositories, any of which can leave their own special trashfiles all over the place. We can't every hope to catalog them all, so better to recommend developers simply configure a global core.excludesfile to filter the irrelevant files which tend to get created by their personal choice of tools. To this end, remove the long-standing sections for "Mr Developer" and "Editors" since their mere existence here sends the signal that we welcome (and have time to review) additions for any old tool someone ever might happen to try. Also add a comment block explaining this, for clarity. We can, and should of course, continue to list files created by the tools recommended by our workflow (test frameworks called from tox, documentation and packaging builds, et cetera). This change is a port of I1b41efac219fca44e2548fc36633724d0ecfc0cb from the openstack-dev/oslo-cookiecutter repository. Change-Id: I4078179f3d55847ea23f8790572ba911e52fce53 - Allow transport_url initialization in ConfFixture constructor Change-Id: Ibe2a5277cdcf89cd006507f13eddbbec4b384681 - Merge "Fix oslo.messaging default transport" - Fix oslo.messaging default transport Change d3f6ca0b47e2a5a3413b27617d9655f02b191c6a have broken oslo.messaging defaults, no more transport are selected by default and oslo.messaging just crash: Traceback (most recent call last): File "/home/sileht/workspace/openstack/oslo.messaging/.tox/py27/lib/python2.7/site-packages/mock/mock.py", line 1305, in patched return func(*args, **keywargs) File "oslo_messaging/tests/test_transport.py", line 111, in test_get_transport transport_ = oslo_messaging.get_transport(self.conf, **kwargs) File "/home/sileht/workspace/openstack/oslo.messaging/.tox/py27/lib/python2.7/site-packages/debtcollector/removals.py", line 242, in wrapper return f(*args, **kwargs) File "oslo_messaging/transport.py", line 247, in get_transport transport_cls=RPCTransport) File "oslo_messaging/transport.py", line 205, in _get_transport url.transport.split('+')[0], AttributeError: 'NoneType' object has no attribute 'split' This change restores rabbit:// as default. Change-Id: I945a2aca60347dad672cc406cd33e80e93c588a7 - always build universal wheels All of our projects are pure python, so we can build universal wheels by default. Change-Id: I3369303d278af6154cdcf06b727e8ff941dc410a - Use default exchange for direct messaging Lots of exchanges create problems during failover under high load. Please see bug report for details. This is step 1 in the process: only using default exchange when publishing. Consumers will still consume on separate exchanges (and on default exchange by default) so this should be (and tested to be) a non-breaking and upgrade-friendly change. Step 2 is to update consumers to only listen on default exchange, to happen in T release. Change-Id: Id3603f4b7e1274b616d76e1c0c009d2ab7f6efb6 Closes-Bug: #1789177 - Refactor GetTransportSadPathTestCase GetTransportSadPathTestCase did an awful lot of mocking for things that were no longer called. Since we only have one callable now, make use of self.assertRaises. Change-Id: Ie93ff74de84ff4d6cc75a3c89dd9a03fdcba5d35 - Merge "Add release note about deprecated option removals" - Merge "Remove rpc_backend and ConfFixture.transport_driver" - Merge "Use templates for cover and lower-constraints" - Add release note about deprecated option removals Since we have removed a large amount of deprecated options, add a release note documenting which options have been removed. Depends-On: https://review.openstack.org/580910 Change-Id: Idb45f691dab77e5bfae841ea45fa167c224c3322 - Merge "Remove deprecated amqp1 options" - Merge "Remove default_{host,port} deprecated options" - Remove rpc_backend and ConfFixture.transport_driver Now that most projects have transitioned from using ConfFixture.transport_driver, we can remove it and rpc_backend as a whole. rpc_backend was first deprecated in 5.10.0, released during Ocata. Closes-Bug: #1712399 Change-Id: I193cc0e613459a6dbbfd54ed0901a54ded78d712 - Remove deprecated rabbit options Remove the deprecated options rabbit_host, rabbit_port, rabbit_hosts, rabbit_userid, rabbit_password, rabbit_virtual_host and rabbit_max_retries which were deprecated in 5.10.0, released during Ocata. Change-Id: I39dec568e5de0b653e5af1f196537e09ef126a36 Closes-Bug: #1712394 - Use templates for cover and lower-constraints Use openstack-tox-cover template, this runs the cover job as non-voting in the check queue only. Use openstack-lower-constraints-jobs template Remove jobs that are part of the templates. Sort list of templates, move templates first in project stanza as is common practice. Change-Id: Idb976b160479efcf9f3726c1716bf9d2c39ab6cc - Remove deprecated amqp1 options The amqp1 options allow_insecure_options, username and password are all deprecated, remove them. allow_insecure_options was deprecated during Ocata, and the other two were deprecated in 5.22.0, released during Pike. Change-Id: I321266c3dba83a38fe6ebd775db2e74c14cc96cd - Remove rabbit_durable_queues deprecated option The rabbit_durable_queues option has been deprecated since amqp code was moved from olso-incubator to this project, so it's high time it was removed. Change-Id: If2450696a43c05c32d35bff26d3dc38423f4330e - Remove default_{host,port} deprecated options The Kafka driver deprecated the kafka_default_host and kafka_default_port options in 5.10.0, released in Ocata. Remove them. Change-Id: I206e68ec1624bb6d5d6ba320572530352bbd4378 - Merge "Remove the deprecated ZeroMQ driver" - Merge "Fix the coverage tox tests" - Remove the deprecated ZeroMQ driver Users of the oslo.messaging RPC communications service must use the rabbit ("rabbit://...") or AMQP 1.0 ("amqp://...") drivers. Change-Id: If3474142f1fe99d41d7b4466061ed0e23ca38549 Closes-Bug: 1789259 - Fix the coverage tox tests Change-Id: I45f7269c95807e7a804f116c2d1aed6baf9f46e2 - Avoid logging passwords on connection events Change-Id: I15c8c4a1177c363283281d2fed63545658eda5de Closes-Bug: #1787214 - add lib-forward-testing-python3 test job This is a mechanically generated patch to add a functional test job running under Python 3 as part of the python3-first goal. See the python3-first goal document for details: https://governance.openstack.org/tc/goals/stein/python3-first.html Change-Id: Ib99a323861c0fdb548287446ab25e0516a7c182e Story: #2002586 Task: #24322 - add python 3.6 unit test job This is a mechanically generated patch to add a unit test job running under Python 3.6 as part of the python3-first goal. See the python3-first goal document for details: https://governance.openstack.org/tc/goals/stein/python3-first.html Change-Id: I1da69d0b77a3970c727b60de4c341552970fbb47 Story: #2002586 Task: #24322 - import zuul job settings from project-config This is a mechanically generated patch to complete step 1 of moving the zuul job settings out of project-config and into each project repository. Because there will be a separate patch on each branch, the branch specifiers for branch-specific jobs have been removed. See the python3-first goal document for details: https://governance.openstack.org/tc/goals/stein/python3-first.html Change-Id: I0401a53945ad87e1dc046904054b12e2b106a3e8 Story: #2003250 - Call listener stop only if listener is initialized Change-Id: I1303d74af7a242edefe774d8f5e12e63614c0158 Closes-Bug: #1785048 - Merge "Update reno for stable/rocky" - Merge "Issue blocking ACK for RPC requests from the consumer thread" - Update reno for stable/rocky Change-Id: I1a8834b95487805805395e919e2c6cdc435522b0 - Remove setting of DEVSTACK_GATE_EXERCISES This defaults to 0 anyway, and is being removed as the devstack excercises are being removed. see https://review.openstack.org/#/c/581377/ Change-Id: Ifb147f9fb2071724a9eaf306273276db65125cf7 - Bump py-amqp to >= 2.3.0 Due to the bug below we want to have py-amqp>=2.3.0 so that connecting to rabbit endpoints don't timeout when relying on /etc/hosts entries. Closes-Bug: 1780992 Change-Id: Ia2c1114cb0f8d480695197714f7c6293751430dd - Issue blocking ACK for RPC requests from the consumer thread The patch for https://review.openstack.org/#/c/436958/ fixed a threading problem by moving the ack back to the polling thread. However the RPC server expects to catch any failures of the ACK and abort the request. This patch adds the ACK error handling back to the polling thread. This patch is based heavily off the original work done by Mehdi Abaakouk (sileht). Change-Id: I708c3d6676b974d8daac6817c15f596cdf35817b Closes-Bug: #1695746 - Merge "No longer allow redundant calls to server start()" - Merge "py37: deal with Exception repr changes" - Merge "py37: drop use of 'async' as parameter name" - Merge "Do not access the connection's socket during error callback" - Do not access the connection's socket during error callback The _get_connection_info() method attempts to gather debug information from the connection, and will reach into the amqp channel to get the local (client's) TCP port number via the 'sock' property. If _get_connection_info() is called from autoretry's on_error handler the 'sock' property notices that the transport is not set and attempts to re-connect. amqp has deprecated this reconnect behavior, and in any case the client's socket is irrelevant since the connection may not be valid at this point. Closes-Bug: #1745166 Change-Id: I3c42f8463605927f6f94d6c3a7f05e584476abc1 - Fix debug log message - missing argument Change-Id: I811c6051808a34fa5235b47e56ee3b41cb35adad - Merge "Remove transport aliases support" - py37: deal with Exception repr changes Under Python 3.7, a trailing comma is no longer added to the init parameters generated by a repr() call: >>> repr(Exception('It Works')) "Exception('It Works')" vs >>> repr(Exception('It Works')) "Exception('It Works',)" Support pre and post Python 3.7 formats in test cases for notification middleware. Change-Id: I30a46ae82f2cc1b529287c049aa5fc6d987e2538 - py37: drop use of 'async' as parameter name Python 3.7 does not allow the use of 'async' as a parameter name or object attribute; update occurrences to use a different name. This is inline with PEP-492, where await and async are keywords. Change-Id: I73efcafab1e0832a0ada95f6c12cb6a659dfcf27 - Remove transport aliases support To facilitate removing rpc_backend support, disentangle the aliases code by removing it to simplify the code and the tests. Aliases were first depreacted in 5.20.0 during Pike. Change-Id: I7d80cd050ce1eca2c6b6c38f0fac29d090b90bf3 Closes-Bug: #1424728 - Moving stestr to correct package order in test-requirements.txt As the comment from Stephen [1], after moving to stestr, the package should be in exact position where testrepository is removed. [1] https://review.openstack.org/#/c/579743/2/test-requirements.txt@16 Change-Id: Ib748e4f8ba1263f2c6475c8641c800b7df872b88 - Merge "Fix the bandit security linter test" - Merge "Switch to stestr" - Switch to stestr According to Openstack summit session [1], stestr is maintained project to which all Openstack projects should migrate. Let's switch to stestr as other projects have already moved to it. [1] https://etherpad.openstack.org/p/YVR-python-pti Change-Id: I89b785c91738ab62e3f42da42c431b9df8ccfd70 - Merge "Enable RPC call monitoring in AMQP 1.0 driver" - No longer allow redundant calls to server start() This has been deprecated since before Ocata. Change-Id: I659cc690c0a5d4f82349c7c4882c34c9c82e8a8a Closes-Bug: #1712397 - Fix the bandit security linter test Add the bandit security linter test to the pep8 target Change-Id: I9324b9d9df77fd05c2e10bb48d7ccf8b4c634525 - Replace 'raise StopIteration' with 'return' With PEP 479, the behaviour of StopIteration is changing. Raising it to stop a generator is considered incorrect and from Python 3.7 this will cause a RuntimeError. The PEP recommends using the return statement. More details: https://www.python.org/dev/peps/pep-0479/#examples-of-breakage Change-Id: Ib27581fccbbf14c082fb919d8b6edea1ac83e3c0 - Remove fake_rabbit configuration option The fake_rabbit configuration option has been deprecated since the release of 1.5.0 in late 2014. Finally remove it, and its test. Change-Id: I014c2012cca0f289de0d95b9bb35bbde7f61d2ee - Add release notes link to README Change-Id: I082305a2e11e26115271322b49b3f9b2e79e3dd0 - Add ZeroMQ deprecation release note Change-Id: I32d36c986567646d9e470ce417b3e04776197e94 - Merge "Fix oslo messaging gating" - Fix oslo messaging gating This change fixes the oslo.messaging gate for rabbit/amqp1/kafka. Change-Id: I7c80b89231ca0a6a9e38aecc9e744da5d7227f00 - Enable RPC call monitoring in AMQP 1.0 driver The call monitoring feature was introduced in commit b34ab8b1cc9f4d513a2927c102dbbe82031d9c2a for RabbitMQ. This patch enables the feature on the AMQP 1.0 driver - currently the only other driver that supports RPC. Change-Id: Ic787696852690b59779fb4716aec1e78c48bbe6a - Mark the ZeroMQ driver deprecated As per the Dublin 2018 PTG decision: http://lists.openstack.org/pipermail/openstack-dev/2018-March/128055.html Change-Id: I1cda5dffbc29aad5fea001a79562db7c144a339b - Merge "fix tox python3 overrides" - fix tox python3 overrides We want to default to running all tox environments under python 3, so set the basepython value in each environment. We do not want to specify a minor version number, because we do not want to have to update the file every time we upgrade python. We do not want to set the override once in testenv, because that breaks the more specific versions used in default environments like py35 and py36. Change-Id: I02ef155ef47a5eaddf9de902ad3608bee677fbcf Signed-off-by: Doug Hellmann - Merge "Correct usage of transport_url in example" - Add warning output if failed to rebuild exception when deserialize In some specific cases, the middleware would fail to rebuild the original exception, see bug [1] below. Adding this output may help locate the root cause quickly. [1]: https://bugs.launchpad.net/cinder/+bug/1728826 Change-Id: Ia9304bda4e515812b146885f830e70f28a285f2d - Correct usage of transport_url in example The example usage of transport_url in ConfFixture was not corrected when the rest of the code was switched to using 'fake:/' for transport_url. Since other projects will refer to this example to review changes, it should be correct. Also change the transport URLs used in test_transport to correspond to the correct way of specifying virtual hosts. Change-Id: If8e0a869e02fda2d8d2c86d82ef83ffc3a4361e4 - Add ConfFixture.transport_url As the first step towards removing rpc_backend, we need all of the test fixtures to stop setting/using it via ConfFixture.transport_driver. Add ConfFixture.transport_url, and move the tests over to setting it rather than transport_driver. Partial-Bug: #1712399 Change-Id: I6e2ae2b511fdc52790d5755a9aecaf2f427ab706 - Merge "Convert legacy zuul jobs to v3" - Convert legacy zuul jobs to v3 This patch converts the devstack tempest-based jobs to Zuulv3. Change-Id: Ic20b7632ee314b51e12f37480476a6bdd72006bf Partial-Bug: #1768049 - [rabbitmq] Implement active call monitoring This adds an optional call_monitor_timeout parameter to the RPC client, which if specified, will enable heartbeating of long-running calls by the server. This enables the user to increase the regular timeout to a much larger value, allowing calls to take a very long time, but with heartbeating to indicate that they are still running on the server side. If the server stops heartbeating, then the call_monitor_timeout takes over and we fail with the usual MessagingTimeout instead of waiting for the longer overall timeout to expire. Change-Id: I60334aaf019f177a984583528b71d00859d31f84 - Make oslo.messaging-devstack-amqp1 job non-voting Change-Id: I9011017e818da0d01f6c58b9dc402e81584c83ba - Merge "Remove stale pip-missing-reqs tox test." - Merge "Add heartbeat() method to RpcIncomingMessage" - Remove stale pip-missing-reqs tox test. pip_check_reqs tool is no longer maintained and has broken with release 10 of pip Change-Id: Ic4b42ed54d4d276c65ad2fa37f316c43d9c71ffb - Add a skeleton for a v3-native devstack job Change-Id: Ib0b12cdc8b59c77b06d527268194d4599b24e71a Depends-On: https://review.openstack.org/549252 - Merge "Add kafka for python 3 functional test" - Add heartbeat() method to RpcIncomingMessage This adds a heartbeat() method to RpcIncomingMessage to be used by a subsequent patch implementation of active-call heartbeating. This is unimplemented in all drivers for the moment. Change-Id: If8ab0dc16e3bef69d5a826c31c0fe35e403ac6a1 - Trivial: Update pypi url to new url Pypi url changed from [1] to [2] [1] https://pypi.python.org/pypi/ [2] https://pypi.org/project/ Change-Id: I1cee400bc9dce4f02235e519833b05bb0f4e500d - Add kafka for python 3 functional test Change-Id: I743cd09e3450fac215ff65db37c3fe53e2e43601 - Merge "Update kafka and dsvm jobs" - Move requirements for the optional drivers (amqp1, kafka) Move the requirements for the optional drivers to test-requirements.txt and setup.cfg. The default rabbitmq driver's dependencies should be the only hard requirements for the base package. Leaving ZeroMQ deps unchanged for now as it will be removed in Stein Change-Id: I19dd699ccf87e43202ccefb99258fbaa9ea17b7e - set default python to python3 Set the default python to python3 except for the py27 specific test environments. Set Python 2.7 as the python version to use for these tests. Temporarily ignore optional driver requirements for now. This will be addressed in a later update. Change-Id: Iea8e48b72234bb9a580f2345396cf60fe2022618 - fix lower constraints and uncap eventlet Fix the lower constraints to match the expected values. We will manage the eventlet version using constraints now. See the thread starting at http://lists.openstack.org/pipermail/openstack-dev/2018-April/129096.html for more details. Change-Id: I61d5680182c53774713ee83808b1f6e7a4fba9ff Signed-off-by: Doug Hellmann - Merge "Add restart() method to DecayingTimer" - Merge "update configuration for qdrouter v1.0.0" - Revert "rabbit: Don't prefetch when batch_size is set" This reverts commit c881baed29db49c5710795496cb07907e35ceaba. Eventhough batch_size is set, rabbitMQ prefetch count is not changed at the first time of connection creation. It works only connection reset cases(i.e. rabbitMQ restart). So this patch can not fix original issue https://bugs.launchpad.net/ceilometer/+bug/1551667 Moreover, it makes another bug that messages of sameple queues are not consumed properly. So revert it. Change-Id: Ia8ebee8e2a670e46b6a68859bc30e717bd56ed7e Signed-off-by: Wonil Choi Closes-bug: 1759755 - Update kafka and dsvm jobs Depends-On: I3232378790cff0a956db204e99e34337bbe019ff Change-Id: I913dde81a83937b355019abc428d21d44882a98f - Merge "Updated from global requirements" - Merge "add lower-constraints job" - Merge "remove zmq tests" - Merge "Restore devstack project name in amqp1 test" - add lower-constraints job Create a tox environment for running the unit tests against the lower bounds of the dependencies. Create a lower-constraints.txt to be used to enforce the lower bounds in those tests. Add openstack-tox-lower-constraints job to the zuul configuration. See http://lists.openstack.org/pipermail/openstack-dev/2018-March/128352.html for more details. Change-Id: I8991c2ab1c880c401fd807e38565258403af05e8 Depends-On: https://review.openstack.org/555034 Signed-off-by: Doug Hellmann - remove zmq tests At the Rocky PTG the Oslo team decided to once again deprecate and remove the ZMQ driver. This is the first part of doing that, which removes the unit tests and extra functional test jobs, which are failing. Change-Id: Ia02adf122d2d4ff281e7c9fd3dff8894da241925 Signed-off-by: Doug Hellmann - Updated from global requirements Change-Id: Ie79d1e4a364ec17c7a2524a095c852677e562c7f - Remove the deprecated Pika driver It is recommended that all users of the Pika driver transition to using the Rabbit driver instead. Typically this is done by changing the prefix of the transport_url configuration option from "pika://..." to "rabbit://...". There are no changes required to the RabbitMQ server configuration. Change-Id: I52ea5ccb7e7c247abd95e2d8d50dac4c4ad11246 Closes-Bug: #1744741 - update configuration for qdrouter v1.0.0 Change-Id: I20637c51d5ae4a96f1de9ea6e2a50891adaca52a - Merge "Modify grammatical errors" - Updated from global requirements Change-Id: I9500a0d27953881cfad24d5542356c539353d6a7 - Add restart() method to DecayingTimer This merely provides a restart() method that passes through to the existing restart() method on the StopWatch used as the internal for DecayingTimer so that we can reset it. Change-Id: Ie6b607ec588db94e2c768bd22ae736a05ab484c1 - Imported Translations from Zanata For more information about this automatic import see: https://docs.openstack.org/i18n/latest/reviewing-translation-import.html Change-Id: If6a1cb9165815aa705f1939ec68bd375d157df55 - Merge "Add kafka config options for security (ssl/sasl)" - Add rabbitmq-server for platform:rpm into bindep.txt It lacks rabbitmq-server dependency under plateform:rpm Change-Id: Ia060a13dede0183e9340b9f2913a9475a97a0398 - Restore devstack project name in amqp1 test This patch also adds heat to required projects Change-Id: Ic150f9ce01787a1892b67e00cccc4ba43eaf0373 - Switch from pip_missing_reqs to pip_check_reqs The pip_missing_reqs tool is abandoned and now incompatible with recent versions of pip. It has been supplanted by the pip_check_reqs tool which provides the same pip-missing-reqs entrypoint (plus some others), effectively renamed. This is the same as https://review.openstack.org/#/c/453208/ and the commit message above is copied here. Change-Id: Ibd02fda9c3f96034c96c7bf4abb9248219e0662c - Add kafka config options for security (ssl/sasl) Change-Id: Ia1be1b67a7151d449185e2ad52eff1787e8b0933 - Merge "Zuul: Remove project name" - Merge "Zuul: Remove project name" - Zuul: Remove project name Zuul no longer requires the project-name for in-repo configuration. Omitting it makes forking or renaming projects easier. Change-Id: I9cb1cce40e473d854a9fe6a640c8fc5036288cbd - Modify grammatical errors Change-Id: I8c1cd79179eb3930b1ce69c63015adc5ec4a1d3c - Fixed telemetry integration zuul jobs * telemetry integration tests run in tempest-venv so plugin needs to be installed in the same venv. devstack plugin installs the plugin all-plugin venv so tests are not discovered by tempest. In order to fix the same we need to use TEMPEST_PLUGINS vars for the same. * telemetry integration tests are dependent on heat-tempest-plugin so we need to add that to the required projects. Change-Id: Icab1e53d20bb7c95c232a4512e83905dcca7c599 - Zuul: Remove project name Zuul no longer requires the project-name for in-repo configuration. Omitting it makes forking or renaming projects easier. Change-Id: I42269c34d2c9647d827a88a9ae8f1fd79dffac98 - Merge "Updated from global requirements" - Merge "Imported Translations from Zanata" - Merge "Add support for synchronous commit" - Updated from global requirements Change-Id: I289f97bc931e865feea2beb7b78456f8020da8c6 - Imported Translations from Zanata For more information about this automatic import see: https://docs.openstack.org/i18n/latest/reviewing-translation-import.html Change-Id: I0ed0ad232ab447441935c7c4b69d0317707dfbfa - Merge "Update reno for stable/queens" - Update reno for stable/queens Change-Id: Ib6aee372f7dcdbd468bb4239e08473536525603a - Updated from global requirements Change-Id: Ieee5fa811e69e7ae4f597ce361319758d8030bde - Imported Translations from Zanata For more information about this automatic import see: https://docs.openstack.org/i18n/latest/reviewing-translation-import.html Change-Id: Id63a23d40299a85510ce844ca72b462934416c98 - Add support for synchronous commit This patch changes the default driver behavior to synchronously commit messages following consumer poll. A configuration option will enable the auto commit for asynchronous commit if desired. Depends-On: I5b4f01c928373cac530aa6877a34c684577bc64e Change-Id: I92a3dc95c5d424aa722138195fef5a855a66b31d - Update telemetry integration playbooks Change-Id: I5b4f01c928373cac530aa6877a34c684577bc64e - Follow the new PTI for document build For compliance with the Project Testing Interface as described in: https://governance.openstack.org/tc/reference/project-testing-interface.html For more detials information, please refer to: http://lists.openstack.org/pipermail/openstack-dev/2017-December/125710.html Change-Id: I39b9806013a0912b27c0523dfc2b713b3105bdf1 - Add kafka driver vhost emulation Emulate vhost support by adding the virtual host name to the topic created on the kafka server. Also, update connection management for producer/consumer. This patch: * updates target to topic generation * add consumer and producer connection classes * remove connection pool * update driver test Change-Id: Idd164444c04e9f465a43ee909af840a41bb090c0 - Merge "Updated from global requirements" - Merge "Update kafka functional test" - Updated from global requirements Change-Id: I5bc6a1ba5214d5f73fc61fd8b656d3c00b0ca193 - Create doc/requirements.txt For compliance with the Project Testing Interface as described in: https://governance.openstack.org/tc/reference/project-testing-interface.html Refer to: http://lists.openstack.org/pipermail/openstack-dev/2017-November/124815.html Change-Id: I3d8c70f66931c15247b530ff7e1c89bfc753446f - Update kafka functional test This patch addresses a number of issues that prevented the functional tests from running. The functional tests now execute and can complete succesfully. At times, the test will fail (noticiably in CI) indicating an underlying issue with consumer interaction with the kafka server. It would be beneficial to merge this patch as it provides repeatability and visibility for driver-kafka server integration to facilitate additional debugging and testing. This patch: * removes use of deprecated get_transport * override consumer_group for each test * changed to synchronous send * update to kafka 1.0.0 server Depends-On: Ib552152e841a9fc0bffdcb7c3f7bc75613d0ed62 Change-Id: I7009a3b96ee250c177c10f5121eb73d908747a52 - Merge "Imported Translations from Zanata" - Imported Translations from Zanata For more information about this automatic import see: https://docs.openstack.org/i18n/latest/reviewing-translation-import.html Change-Id: Iaf8bc96558135054f59aa5c30bed52af57e7cc6e - Updated from global requirements Change-Id: Id9da62486347345db39a2b053499f75b319f3aff - Merge "Remove pbr version from setup.py" - Merge "Provide bindep_profile in openstack-tox job setup" - Merge "Updated from global requirements" - Imported Translations from Zanata For more information about this automatic import see: https://docs.openstack.org/i18n/latest/reviewing-translation-import.html Change-Id: I82de13c53c446be73c39813c2f1b1ee7245ae4a6 - Avoid tox_install.sh for constraints support We do not need tox_install.sh, pip can handle constraints itself and install the project correctly. Thus update tox.ini and remove the now obsolete tools/tox_install.sh file. This follows https://review.openstack.org/#/c/508061 to remove tools/tox_install.sh. Change-Id: Ifaaf656effff20ef08214f111645a3b5fc8b4d28 - Merge "rabbitmq: don't wait for message ack/requeue" - rabbitmq: don't wait for message ack/requeue I don't see any obvious reason why we should wait ack/requeue is done. This waiter have already be removed from amqp1. https://git.openstack.org/cgit/openstack/oslo.messaging/tree/oslo_messaging/_drivers/amqp1_driver/controller.py#n242 So, this change remove it from rabbitmq driver too. Closes-bug: #1734788 Change-Id: I5ecedc762596181be19410b863851a0054fd6579 - Merge "sort when using groupby" - Provide bindep_profile in openstack-tox job setup Oslo.messaging uses a single bindep.txt to define common and driver dependencies. The bindep_profile is used by the bindep role to select the driver specific packages. This patch: * Add bindep_profile var to jobs * Add kafka dependencies * update test-setup for use by amqp1 Depends-On: I6beb7b07a7dbc345e63e758ebbc86400e0ee16d3 Change-Id: Ib552152e841a9fc0bffdcb7c3f7bc75613d0ed62 - Updated from global requirements Change-Id: I370881ada05c29399f1351444544eaf28150c4d1 - Add zmq packages that are no longer in bindep-fallback Change-Id: Id47e3097dd7ea3ad9dc9e9f73bce829d6a705b6e Needed-By: Iab9495bd381b135e8a0f2e8f35e51a9218cf8f40 - don't convert generator to list unless required there's only one scenario where the generator actually needs to be forced into a list. don't waste time doing something unnecessary. Change-Id: Iec897b1f6fed3d88b798eb673779e7c68ff930ec - sort when using groupby groupby requires items to be sorted as it's clumping consecutive items together. also, just use itemgetter instead of lambda Change-Id: I1676fc60ebc2c9ff03ea00cc67061fdfb3b50868 - Merge "Updated from global requirements" - Merge "Catch socket.timeout when doing heartbeat_check" - Remove setting of version/release from releasenotes Release notes are version independent, so remove version/release values. We've found that projects now require the service package to be installed in order to build release notes, and this is entirely due to the current convention of pulling in the version information. Release notes should not need installation in order to build, so this unnecessary version setting needs to be removed. This is needed for new release notes publishing, see I56909152975f731a9d2c21b2825b972195e48ee8 and the discussion starting at http://lists.openstack.org/pipermail/openstack-dev/2017-November/124480.html . Change-Id: Icb7de5c9020c3543c218744c0dc75e758f0abb43 - Updated from global requirements Change-Id: Id5276f0b18005af895cad852bedfdc7d8eb9b8e8 - Updated from global requirements Change-Id: Iea65ddb73a626c048411d85af2669a2e01819f66 - Catch socket.timeout when doing heartbeat_check heartbeat_check in kombu.connection is not reraising exceptions as exceptions.OperationalError, and the socket timeout during the heartbeat check is really an issue seen in the field when a node goes down; the heartbeat thread just tries again and again to deal with it, without success. Change-Id: I26dbdb18a7e64946db2cba676764ff2d428c7897 Closes-Bug: #1657444 - Merge "Updated from global requirements" - Updated from global requirements Change-Id: If146ea28a75593f6ef07a9088b87431881721c12 - fix batch handling for some reason there are two timeouts. in the batch scenario, all the time wasted waiting on initial 'get' is never accounted for so the batch timeout is always longer than it is declared. Change-Id: I6132c770cccdf0ffad9f178f7463288cf954d672 - Merge "Remove stable/newton from zuul settings" - Remove stable/newton from zuul settings stable/newton branch is EOL now, remove relevant settings from zuul. Change-Id: I5359f9f1096f5e4cce9d359db813a3749a0b9c64 - Zuul: add file extension to playbook path Zuul now supports including the file extension on the playbook path and omitting the extension is now deprecrated. Update references to include the extension. Change-Id: I025170ddb33b404747b18fcbac9ef4af6a1181f0 - Merge "Move legacy zuulv3 tests into oslo.messaging repo" - Move legacy zuulv3 tests into oslo.messaging repo Next step will be to re-write these for zuulv3 Change-Id: I2f6a8432e037f75d6abee3bc977933a310a4a2c7 - Merge "Fix typo in contributor docs title" - Imported Translations from Zanata For more information about this automatic import see: https://docs.openstack.org/i18n/latest/reviewing-translation-import.html Change-Id: Ib28aea3b87c63d0d3e470d43f72d236d5edbc37b - Flesh out transport_url help This is a complicated config opt and the single line help text doesn't provide anywhere near enough detail for a user to properly configure it. This change adds the expected format from the TransportURL docstring and leaves a link to the docs for that class since the full details are probably too verbose to put in the help text in their entirety. Change-Id: I66122bf9c619d35bcb3caadfde9c0dcdb5cd9095 - Fix typo in contributor docs title "Contributing oslo.messaging" is not grammatically correct. It should be "Contributing to oslo.messaging". Change-Id: I71737086745beb6d8d76669ab04b7580f1b7b11a - Merge "Fix default value of RPC dispatcher access_policy" - Fix default value of RPC dispatcher access_policy Change-Id: I4d30ff269b2e34f4409e8d1ce822eb93918cf5a2 Closes-Bug: #1712393 - Fix wrong transport warnings in functional tests Change-Id: Ie6726ecd566d965a94343bde7a518e986b434346 Closes-Bug: #1718691 - Updated from global requirements Change-Id: I1315cfd256afa17aaa3be3ae4a3a3f6ee5cbb564 - Remove pbr version from setup.py Using pbr version in setup_requires is no longer recommended by Pbr. Change-Id: I9373c0ba4017f8db732c0eb9c5cf0d129726f315 --- oslo.messaging | 2 +- 1 file changed, 1 insertion(+), 1 deletion(-) diff --git a/oslo.messaging b/oslo.messaging index 393ecff345..344ec5e8bb 160000 --- a/oslo.messaging +++ b/oslo.messaging @@ -1 +1 @@ -Subproject commit 393ecff3451091404832dd6b8a088e1bec760101 +Subproject commit 344ec5e8bb4a3df92e50edeab8d670f79aad5eb4