2531 Commits

Author SHA1 Message Date
jacky06
9b7bcbda2f Replace git.openstack.org URLs with opendev.org URLs
Change-Id: Ib4a523adf3275a8727d5a4f2a149e163a81be3cc
2019-04-26 10:31:26 +08:00
Zuul
433d34ed41 Merge "Retry to declare a queue after internal error" 2019-04-22 22:23:07 +00:00
Zuul
78777a92b8 Merge "Handle unexpected failures during call monitor heartbeat" 2019-04-22 22:11:48 +00:00
OpenDev Sysadmins
815ea9ac98 OpenDev Migration Patch
This commit was bulk generated and pushed by the OpenDev sysadmins
as a part of the Git hosting and code review systems migration
detailed in these mailing list posts:

http://lists.openstack.org/pipermail/openstack-discuss/2019-March/003603.html
http://lists.openstack.org/pipermail/openstack-discuss/2019-April/004920.html

Attempts have been made to correct repository namespaces and
hostnames based on simple pattern matching, but it's possible some
were updated incorrectly or missed entirely. Please reach out to us
via the contact information listed at https://opendev.org/ with any
questions you may have.
9.6.0
2019-04-19 19:31:51 +00:00
Zuul
d4873f983b Merge "Dropping the py35 testing" 2019-04-18 01:14:36 +00:00
Zuul
81e9d81770 Merge "Update messaging intermediaries for amqp1 tests" 2019-04-17 15:14:01 +00:00
Ghanshyam Mann
0d4f1d64b6 Dropping the py35 testing
All the integration testing has been moved to
Bionic now[1] and py3.5 is not tested runtime for
Train or stable/stein[2].

As per below ML thread, we are good to drop the py35
testing now:
http://lists.openstack.org/pipermail/openstack-discuss/2019-April/005097.html

[1] http://lists.openstack.org/pipermail/openstack-discuss/2019-April/004647.html
[2]
https://governance.openstack.org/tc/reference/runtimes/stein.html
https://governance.openstack.org/tc/reference/runtimes/train.html

Change-Id: I1874f96f78cb403e6f3a56a49cb83df40d531f8d
2019-04-15 01:14:11 +00:00
Zuul
56ac3a27b3 Merge "Handle collections.abc deprecations" 2019-04-11 15:21:12 +00:00
Ian Wienand
e99af8ca57 Merge "Replace openstack.org git:// URLs with https://" 2019-04-10 01:32:56 +00:00
Sean McGinnis
4d48b33a41 Handle collections.abc deprecations
The use of ABC classes directly from collections has been deprecated in
3.x versions of Python. The direction is to use the classes defined in
collections.abc. Python 2.7 does not have this, but Python 3.8 will be
dropping the backwards compatibility to use the old location.

Six also does not have support for this yet, so in the mean time to make
sure we don't run into issues as folks try to move to 3.8, and to get
rid of deprecation warnings in logs, this handles importing from the
preferred location and falls back if it not available.

Change-Id: If67133813634f41d89ccdf0f6d6d5ffa66c97dd8
Signed-off-by: Sean McGinnis <sean.mcginnis@gmail.com>
2019-04-09 16:43:45 -05:00
Gabriele
4d2787227b Retry to declare a queue after internal error
Without this commit, the client can lose the messages, because the
client does not handler the 'AMQP internal error 541',
read here [2] for details.
The fix retries to create the queue after a delay.
When the virtual-host is ready the declare does not fail.
This is a rare condiction, please read the bug [1] for details.

Closes-Bug: #1822778

[1] https://bugs.launchpad.net/oslo.messaging/+bug/1822778
[2] https://www.rabbitmq.com/amqp-0-9-1-reference.html

Change-Id: I7ab1f9d21ebb807285bf1422bc14cc6e07dcd32a
2019-04-05 15:08:12 +02:00
Pierre Riteau
44bd971bfb Unmark RabbitMQ heartbeat as experimental
Commit 287a4f56f45ed9cd40116a9e7b6e529f3382a925 marked RabbitMQ
heartbeat as experimental in 2015, due to issues with the underlying
amqp library. Later, commit 168f6cc2bb72591012d54b15e1c2e4a0332fb5c9
enabled heartbeat by default, but the EXPERIMENTAL string was left.

Change-Id: I78838df2a0db9836f98d8f79624d688c3ed351ae
2019-03-26 10:50:33 +00:00
Zuul
51fa1b81e3 Merge "Explain why Listener connections cannot be pooled" 2019-03-26 09:48:03 +00:00
Zuul
cee6aec5dc Merge "Clarify the documentation for pooled Notification Listeners" 2019-03-25 16:47:11 +00:00
Ian Wienand
a4d087cc1b Replace openstack.org git:// URLs with https://
This is a mechanically generated change to replace openstack.org
git:// URLs with https:// equivalents.

This is in aid of a planned future move of the git hosting
infrastructure to a self-hosted instance of gitea (https://gitea.io),
which does not support the git wire protocol at this stage.

This update should result in no functional change.

For more information see the thread at

 http://lists.openstack.org/pipermail/openstack-discuss/2019-March/003825.html

Change-Id: Iec59af4e909e307df789589d9e40d019d2545088
2019-03-24 20:35:28 +00:00
Kenneth Giusti
83a84d3f98 Explain why Listener connections cannot be pooled
Restoring an old comment to the code that explains why the RabbitMQ
driver provides a dedicated connection for each listener.

Change-Id: If833d41d78444cc26535cb165ea821dce21b768b
2019-03-18 12:26:47 -04:00
d143a06b48 Update master for stable/stein
Add file to the reno documentation build to show release notes for
stable/stein.

Use pbr instruction to increment the minor version number
automatically so that master versions are higher than the versions on
stable/stein.

Change-Id: Icb3ca5bb875df1dda9f3d86bb164b6299059664e
Sem-Ver: feature
2019-03-18 14:45:21 +00:00
Kenneth Giusti
855a85fa2d Clarify the documentation for pooled Notification Listeners
Change-Id: I184b045edaa8e61f075df576992426e94bf7386a
Closes-Bug: #1814544
2019-03-11 09:31:38 -04:00
Andy Smith
8897e1584f Update messaging intermediaries for amqp1 tests
This patch messaging intermediaries used for the amqp1 driver
test. The combination of the apache qpid-dispatch-router (qdrouterd)
with an attached apache artemis broker is used in place of the qpidd
broker. The qdrouterd will directly message oslo.messaging rpc
communications and will link route oslo.messaging notify
communications to the artemis broker (e.g. for persistence).

This patch:
* updates the dependencies
* updates the test environment setup
* uses the pifpaf drivers to create servers

Change-Id: I9fb56450346fca84bc1573fa5e9b6fe81c14e33a
2019-03-11 08:47:46 -04:00
Zuul
472d483942 Merge "Change python3.5 job to python3.7 job on Stein+" 2019-02-22 01:23:52 +00:00
Zuul
d1db4509ac Merge "Kafka driver deployment guide" 2019-02-21 18:59:53 +00:00
Zuul
28e213c506 Merge "Bump amqp requirement version to >=2.4.1" 2019-02-20 22:39:25 +00:00
Kenneth Giusti
f948e24294 Handle unexpected failures during call monitor heartbeat
Change-Id: Iec04c18ac3565a3610377d94caf128c6704a89eb
Closes-Bug: #1816816
2019-02-20 15:07:31 -05:00
Zuul
7102eddb1f Merge "Update hacking version" 2019-02-20 18:59:03 +00:00
Zuul
b2439756a0 Merge "add python 3.7 unit test job" 2019-02-20 04:13:42 +00:00
ZhongShengping
76101e32fe add python 3.7 unit test job
This is a mechanically generated patch to add a unit test job running
under Python 3.7.

See ML discussion here [1] for context.

[1] http://lists.openstack.org/pipermail/openstack-dev/2018-October/135626.html
Story: #2004073
Task: #27440

Change-Id: I2ee368245286ca5fb6091a5ea5ebbed5261c54c0
2019-02-19 13:56:43 +08:00
Andy Smith
f8d0dcf04c Mark telemetry tests nv and remove from gate
Change-Id: I3a49e7397df9cd0b2d7eba5747795c3d771dcbea
2019-02-18 15:19:15 -05:00
mb
64f74cd2cc Bump amqp requirement version to >=2.4.1
Bumping the version of amqp in requirements.txt and
lower-constraints.txt from 2.4.0 to 2.4.1 to mitigate issues with
MessagingTimeouts when using TLS due to a amqp bug that was fixed in
2.4.1

Change-Id: I0b094f32dec24c70f95ccd509164a14a71fcfc7d
Closes-Bug: #1800957
2019-02-18 18:29:26 +01:00
Charles Short
fa2a3e4fcc Change python3.5 job to python3.7 job on Stein+
python3.5 was the only supported python3 version on Xenial, now that we have
Bionic Beaver nodes that support python3.7, lets switch to testing with
python3.7 in addition with python3.6 in Stein and beyond.
See ML discussion here [1] for context.

[1] http://lists.openstack.org/pipermail/openstack-dev/2018-October/135632.html

Change-Id: I3335ccb01667d22a181d99d4d53d7356005d72ad
Signed-off-by: Charles Short <chucks@redhat.com>
Story: #2004073
Task: #27440
2019-02-14 10:28:20 +00:00
Kenneth Giusti
0a784d2604 Bump amqp requirement version to >= 2.4.0
See http://lists.openstack.org/pipermail/openstack-discuss/2019-January/001998.html

Closes-Bug: #1813029

Change-Id: I4ef3d1184fd593f4acd090395579d91e093dd82c
2019-01-24 16:28:43 -05:00
Andy Smith
0953fa1759 Kafka driver deployment guide
Depends-On: Idfb9fe3700d882c8285c6dc56b0620951178eba2
Change-Id: If8370c0c83312d675bde837f768ae40ec3603972
2019-01-23 08:27:43 -05:00
ZhijunWei
cb902e5aff Update hacking version
update the hacking to latest, duo to[1]

[1]: https://github.com/openstack/oslo.messaging/blob/master/HACKING.rst

Change-Id: I1ee7387272690f0de0d7b1937d7c2b0ee404063c
2019-01-21 19:45:42 -05:00
Dirk Mueller
344ec5e8bb Avoid unnecessary use of items()
The key, value pair returned by items() wasn't used here,
so rewrite the logic to just iterate over the keys, filtered
by the type.

Change-Id: I7512ea93ac794d161a4cd9944546d6ca035a12cf
2019-01-07 14:07:24 +00:00
Zuul
13fa4f5ab1 Merge "Switch driver to confluent-kafka client library" 2018-12-07 19:59:50 +00:00
ZhongShengping
c047f431ea Update mailinglist from dev to discuss
openstack-dev was decomissioned this night in https://review.openstack.org/621258
Update openstack-dev to openstack-discuss

Change-Id: I7d889d3f9a6c95e707ed57dbf5a9cffb1d41ddf5
2018-12-05 09:39:30 +08:00
Andy Smith
5a842ae155 Switch driver to confluent-kafka client library
This patch switches the kafka python client from kafka-python to
confluent-kafka due to documented threading issues with the
kafka-python consumer and the recommendation to use multiplrocessing.
The confluent-kafka client leverages the high performance librdkafka
C client and is safe for multiple thread use.

This patch:
* switches to confluent-kafka library
* revises consumer and producer message operations
* utilizes event.tpool method for confluent-kafka blocking calls
* updates unit tests
* adds kafka specific timeouts for functional tests
* adds release note

Depends-On: Ice374dca539b8ed1b1965b75379bad5140121483
Change-Id: Idfb9fe3700d882c8285c6dc56b0620951178eba2
2018-12-04 11:25:07 -05:00
Andy Smith
252844879d Don't use monotonic with Python >=3.3
A change to the global-requirements has limited use of monotonic
library to Python versions earlier than 3.3 (later versions have
built-in support for a monotonic clock), so limit it in
requirements.txt.

Note: this patch updates kafka driver (due to deprecated exception
in library) in order to pass unit tests

Change-Id: Id6b0814e05a0e548a8c2a5359daf1a6878cf6859
2018-12-03 14:52:49 -05:00
Zuul
274b7c3eb4 Merge "Add a test for rabbit URLs lacking terminating '/'" 2018-11-19 21:55:24 +00:00
Kenneth Giusti
fb3ab00d1d Use ensure_connection to prevent loss of connection error logs
Change-Id: I31e3f83304c0780cfd380aa63ec2962c3c28ec78
Closes-Bug: #1801011
2018-11-05 16:02:06 -05:00
Zuul
1a781bd6dc Merge "Use default exchange for direct messaging" 2018-11-01 20:03:07 +00:00
Zuul
7b6e2e49e3 Merge "doc: Remove crud from conf.py file" 2018-10-23 10:23:04 +00:00
Kenneth Giusti
d913c179c7 Add a test for rabbit URLs lacking terminating '/'
Change-Id: I062ca84b6b8a5d1eeccafef87608c783ad5ffb03
2018-10-19 09:22:48 -04:00
Kenneth Giusti
92b4080654 Use '/' for the vhost if the transport_url has no trailing '/'
This change https://review.openstack.org/#/c/599912/ accidentally
removed setting the virtual host to '/' if none were provided in the
transport_url configuration option.

Closes-Bug: #1798241
Change-Id: I2dbcec3f77eb7cc513350b00ea020cc8faaecec1
2018-10-18 13:08:13 -04:00
Zuul
e0de93c793 Merge "Clean up .gitignore references to personal tools" 2018-10-16 21:24:57 +00:00
Hervé Beraud
0410bcbf54 Using pip as a python module
Since python 2.7.9 and python 3.4
pip is a stdin module

Change-Id: I17c8c93337fa4f0a33f9131d4117739179133ea9
2018-10-15 10:56:55 +02:00
Hervé Beraud
ad0d99c812 doc: Remove crud from conf.py file
Change-Id: I35c6221f78cac9fe4ab3e194e8a94ca4f0b24ca2
2018-10-15 09:42:18 +02:00
ZhongShengping
b868aebf45 Clean up .gitignore references to personal tools
Developers run all sorts of different tools within Git repositories,
any of which can leave their own special trashfiles all over the
place. We can't every hope to catalog them all, so better to
recommend developers simply configure a global core.excludesfile to
filter the irrelevant files which tend to get created by their
personal choice of tools.

To this end, remove the long-standing sections for "Mr Developer"
and "Editors" since their mere existence here sends the signal that
we welcome (and have time to review) additions for any old tool
someone ever might happen to try. Also add a comment block
explaining this, for clarity.

We can, and should of course, continue to list files created by the
tools recommended by our workflow (test frameworks called from tox,
documentation and packaging builds, et cetera).

This change is a port of I1b41efac219fca44e2548fc36633724d0ecfc0cb
from the openstack-dev/oslo-cookiecutter repository.

Change-Id: I4078179f3d55847ea23f8790572ba911e52fce53
2018-10-15 11:49:38 +08:00
Kenneth Giusti
9ca7359bfd Allow transport_url initialization in ConfFixture constructor
Change-Id: Ibe2a5277cdcf89cd006507f13eddbbec4b384681
2018-10-09 13:46:00 -04:00
Zuul
16fea5b368 Merge "Fix oslo.messaging default transport" 2018-10-05 22:48:55 +00:00
Mehdi Abaakouk
172cfb33f3 Fix oslo.messaging default transport
Change d3f6ca0b47e2a5a3413b27617d9655f02b191c6a have broken
oslo.messaging defaults, no more transport are selected by default and
oslo.messaging just crash:

    Traceback (most recent call last):
      File "/home/sileht/workspace/openstack/oslo.messaging/.tox/py27/lib/python2.7/site-packages/mock/mock.py", line 1305, in patched
        return func(*args, **keywargs)
      File "oslo_messaging/tests/test_transport.py", line 111, in test_get_transport
        transport_ = oslo_messaging.get_transport(self.conf, **kwargs)
      File "/home/sileht/workspace/openstack/oslo.messaging/.tox/py27/lib/python2.7/site-packages/debtcollector/removals.py", line 242, in wrapper
        return f(*args, **kwargs)
      File "oslo_messaging/transport.py", line 247, in get_transport
        transport_cls=RPCTransport)
      File "oslo_messaging/transport.py", line 205, in _get_transport
        url.transport.split('+')[0],
    AttributeError: 'NoneType' object has no attribute 'split'

This change restores rabbit:// as default.

Change-Id: I945a2aca60347dad672cc406cd33e80e93c588a7
2018-10-05 15:21:45 +02:00