oslo.messaging/tools
Ilya Tyaptin f139eb258d Moving driver to new kafka-python version
Currently Kafka driver for an oslo.messaging uses kafka-python==0.9.5
and mostly broken. This package version supports only low level Kafka
producer and consumer API which are marked as deprecated now [1]. Using
of these interfaces bring a big concern to the message processing,
because current KafkaConsumer has not any consuming coordination. This
fact causes a message duplication for the several consumers of one
topic. This behavior is specific to Ceilometer and services which read
and process notifications from other services.

New version of kafka-python allows to use async thread safe message
producers and coordinated consumers [1].

[1] http://kafka-python.readthedocs.io/en/master/changelog.html#feb-15-2016

The driver is currently experimental, python-kafka<1.0.0 API have major
issue described above that can't make the oslo.messaging driver works,
so we prefer having a working driver with a non-synced dependencies, that the
reverse.

Co-Authored-By: Mehdi Abaakouk <sileht@redhat.com>
Change-Id: I29862ed7bf56b9d8878fa8e9fb1cbd9d643908a4
2017-01-02 11:46:48 +01:00
..
functions.sh Don't use devstack to setup our functional env 2015-06-11 12:01:01 +02:00
messages_length.yaml Modify simulator.py tool 2015-10-22 17:34:17 +03:00
simulator.py Merge "[simulator] Fix transport_url usage" 2016-11-03 16:59:29 +00:00
test-setup.sh [AMQP 1.0] Setup the amqp1 test environment on ubuntu 2016-12-19 14:47:04 -05:00
tox_install.sh Moving driver to new kafka-python version 2017-01-02 11:46:48 +01:00