openstack/deb-python-kafka
Code Issues Proposed changes

Commit Graph

  • ec323bcd0a BrokerConnection: separate send / recv in BrokerConnection improve connection and error handling use different read and write fds for py3 Dana Powers 2015-11-29 11:22:03 -08:00
  • 389fa20423 Recursive repr, display all field names and values for Structs Dana Powers 2015-11-29 23:53:23 +08:00
  • 51227eae4f Use simply counting instead of buffer.tell() -- socket.makefile does not support tell() Dana Powers 2015-11-29 10:05:58 +08:00
  • 058567912e Add simple BrokerConnection class; add request.RESPONSE_TYPE class vars Dana Powers 2015-11-29 10:00:50 +08:00
  • a85e09df89 Rework protocol type definition: AbstractType, Schema, Struct Dana Powers 2015-11-28 19:41:06 +08:00
  • e24a4d5f52 Fix __init__ legacy relative module import Dana Powers 2015-11-28 19:40:07 +08:00
  • f08775a619 Switch crc32 back to signed integer -- this is consistent with protocol encoding spec Dana Powers 2015-11-28 19:34:37 +08:00
  • dc94b5fe9f Fix tests broken by legacy module move Dana Powers 2015-11-28 19:29:32 +08:00
  • 3f65ff4ab9 Move ProduceRequest to kafka.protocol.produce Dana Powers 2015-11-23 05:26:13 +08:00
  • a0be374ce3 Basic 0.8 Request protocol classes, with encoding only Dana Powers 2015-11-23 04:24:28 +08:00
  • f6edeafac3 Add base api type classes w/ encoders in kafka.protocol.types Dana Powers 2015-11-23 04:15:19 +08:00
  • f0cd6d4082 Rename kafka.protocol -> kafka.protocol.legacy Dana Powers 2015-11-23 04:01:20 +08:00
  • eab0a55962 Add 0.8.2.2 and 0.9.0.0 resources for integration tests; update default official releases Dana Powers 2015-12-04 10:40:56 -08:00
  • 770a9bb4da Update docs and links wrt maintainer change (mumrah -> dpkp) Dana Powers 2015-12-03 12:43:07 -08:00
  • 63b0e6108a Merge pull request #481 from zackdever/pylint-1.5-changes Dana Powers 2015-12-03 11:48:41 -08:00
  • 16f6154778 new pylint disables for pylint 1.5.1 Zack Dever 2015-12-02 16:23:01 -08:00
  • 3e28b42e66 Merge pull request #420 from toddpalino/master Dana Powers 2015-12-02 15:50:05 -08:00
  • ee6b9cb5b1 Fix python3 / python2 comments re queue/Queue Dana Powers 2015-12-02 15:00:35 -08:00
  • cfbdc05f27 Add Murmur2Partitioner to kafka __all__ imports - fix issue 471 Dana Powers 2015-12-02 14:38:02 -08:00
  • 58e2ab41a7 Merge pull request #473 from ecanzonieri/use_unblocking_io_for_aware_requests Dana Powers 2015-12-02 14:21:13 -08:00
  • cdcaea6f94 Merge pull request #467 from bschopman/master Dana Powers 2015-12-02 14:19:27 -08:00
  • 2eca5538ee Merge pull request #457 from saaros/block-for-number-of-messages Dana Powers 2015-12-02 13:50:22 -08:00
  • c2eccd5bd1 Merge pull request #446 from zackdever/consumer-class-configs Dana Powers 2015-12-02 13:46:41 -08:00
  • da217442c1 Merge pull request #456 from barricadeio/mp-retry Dana Powers 2015-12-02 13:45:54 -08:00
  • a0f103eb3f Merge pull request #454 from trbs/gzip_compressionlevel Dana Powers 2015-12-02 13:41:26 -08:00
  • 20df6cdcb5 Merge pull request #441 from koobs/patch-1 Dana Powers 2015-12-02 13:35:02 -08:00
  • 4fc15a5f27 Merge pull request #439 from chrischamberlin/fix-murmur Dana Powers 2015-12-02 13:34:33 -08:00
  • 149d43cf6c Merge pull request #435 from docker-hub/fix-producer-cleanup-logic Dana Powers 2015-12-02 13:33:30 -08:00
  • 0ba9d3d782 Merge pull request #418 from scrapinghub/mp_partition_info Dana Powers 2015-12-02 13:04:50 -08:00
  • 0d41e6b07e Merge pull request #409 from scrapinghub/feature-allow-null-payload Dana Powers 2015-12-02 12:49:49 -08:00
  • c2adeeab05 Add tests. Bug fix. Rename socket_conn dict. Enrico Canzonieri 2015-10-24 16:50:46 -07:00
  • 04920bb89f Unblocking broker aware request Enrico Canzonieri 2015-10-12 00:11:18 -07:00
  • 64cda819d9 Prevents crashing communication thread of async producer Balthasar Schopman 2015-10-22 17:12:06 +02:00
  • e99a934bab Merge pull request #436 from mutability/async-catch-unavailable-error Dana Powers 2015-10-07 09:51:32 -07:00
  • e74a8ba494 Consumers get_messages: allow blocking until some messages are received Oskari Saarenmaa 2015-09-18 14:06:51 +03:00
  • 7e19de5550 Support retry semantics in MultiProcessConsumer Ross Duggan 2015-09-14 16:30:01 +01:00
  • 4d516fbd49 allow to specify compression level for codecs which support this trbs 2015-09-12 18:22:50 +02:00
  • b525e1a8d6 Merge pull request #432 from ecanzonieri/lower_logging_level_metadata Dana Powers 2015-08-24 10:56:32 -07:00
  • e59e6cf4f6 set default config on consumer class to support subclass config changes. Zack Dever 2015-08-13 12:12:49 -07:00
  • 6d0403d612 Include LICENSE in PyPI sdist Kubilay Kocak 2015-07-31 16:03:27 +10:00
  • bb6283df6f Fix translation of Java murmur2 code, fix byte encoding for Python 3. Chris Chamberlin 2015-07-28 22:38:28 -07:00
  • 1f85735139 Fixing https://github.com/mumrah/kafka-python/issues/434 Reworked the if statement logic to only call stop() on not-stopped objects. added tests toli 2015-07-23 17:06:41 -07:00
  • 77e5180a37 Init responses before we use it. Oliver Jowett 2015-07-24 10:53:01 +00:00
  • 00ceada028 Use debug logging level for metadata request Enrico Canzonieri 2015-07-21 11:09:46 -07:00
  • 3376ed1cef Errors -> Error typo Oliver Jowett 2015-07-20 20:25:02 +00:00
  • 718e5fb66d Treat KafkaUnavailableError like other errors. Oliver Jowett 2015-07-19 10:57:37 +00:00
  • b47736dc26 Add KafkaConsumer#close Ulysse Carion 2015-07-07 16:03:44 -07:00
  • da03827d12 Fix misnamed node to nodeId in test tpalino 2015-07-02 09:32:37 -07:00
  • 5d8d5412e5 Add missing import for ConsumerMetadataResponse tpalino 2015-07-01 22:47:02 -07:00
  • c01963682e Support consumer metadata requests tpalino 2015-07-01 22:29:56 -07:00
  • 43164ad096 allow to retrieve partition info in mp consumer Martin Olveyra 2015-06-29 13:28:12 -02:00
  • adbd4ac052 Merge pull request #412 from haosdent/seek_absolute_offset Dana Powers 2015-06-20 09:39:17 -07:00
  • 2028a23209 fix #410 SimpleConsumer cannot seek to an absolute offset. haosdent 2015-06-20 20:04:57 +08:00
  • 4b064340e8 Merge pull request #415 from ecanzonieri/lower_logging_level Dana Powers 2015-06-19 12:19:34 -07:00
  • f74d712adf Lower logging level on replica not available and commit Enrico Canzonieri 2015-06-19 10:17:49 -07:00
  • 3fbd1cc809 Producer test fix for python3 Viktor Shlapakov 2015-06-17 17:16:38 +03:00
  • 4df78c293f Add KeyedProducer test with null payloads Viktor Shlapakov 2015-06-17 16:11:37 +03:00
  • 8677233247 Add basic keyed producer tests Viktor Shlapakov 2015-06-17 14:05:44 +03:00
  • a943eb3bed Exclude (null,null) pair for producer Viktor Shlapakov 2015-06-17 14:05:05 +03:00
  • 99998af7ed Allow null payload for deletion feature Viktor Shlapakov 2015-06-16 12:09:03 +03:00
  • 915a9ce0d1 Set development version until next release Dana Powers 2015-06-12 11:23:52 -07:00
  • 176d0167ec Update docs to 0.9.4 as latest Dana Powers 2015-06-12 11:21:48 -07:00
  • 4955582be1 Release 0.9.4 v0.9.4 Dana Powers 2015-06-11 23:27:48 -07:00
  • a6ab3fa482 Update CHANGELOG for 0.9.4 Dana Powers 2015-06-10 02:39:59 -07:00
  • 605402116e Update contributors list -- great community! Dana Powers 2015-06-11 23:02:09 -07:00
  • 513f210ba3 Add KafkaClient.topics property to get list of known topics Dana Powers 2015-06-09 09:39:29 -07:00
  • 47bc6a7095 Some minor updates to usage docs Dana Powers 2015-06-11 22:52:50 -07:00
  • 4c76da9ad7 Fix reading version in docs/conf.py Dana Powers 2015-06-11 22:52:15 -07:00
  • 2451dcc552 Increase timeout and backoff when retrying spawn of test fixtures Dana Powers 2015-06-11 10:38:41 -07:00
  • e2955e7759 Merge pull request #378 from dpkp/murmur2_hashed_partitioner Dana Powers 2015-06-10 23:14:04 -07:00
  • 58e885b5f2 Merge pull request #399 from dpkp/refactor_simple_consumer_get_messages Dana Powers 2015-06-10 23:11:25 -07:00
  • 08daf324b2 Merge pull request #402 from dpkp/kafka_0_8_2_1 Dana Powers 2015-06-10 13:46:49 -07:00
  • 4e339a746d Use MurmurHash2 for key partition hashing Dana Powers 2015-05-17 12:28:28 -07:00
  • 430deb3c3f Refactor SimpleConsumer get_messages and _fetch - attempt to make these easier to read - add marginal retry logic to internal _fetch loop Dana Powers 2015-06-08 23:44:29 -07:00
  • 2727a07be2 Merge pull request #405 from dpkp/log_error_type Dana Powers 2015-06-10 13:19:40 -07:00
  • 4dec5d31a9 Merge pull request #404 from dpkp/consumer_more_exception_handling Dana Powers 2015-06-10 13:19:06 -07:00
  • 92da259539 Update to 0.8.2.1 compatibility in docs Dana Powers 2015-06-08 21:49:25 -07:00
  • 6fde9236d4 Add kafka 0.8.2.1 to integration tests, remove 0.8.2.0 Dana Powers 2015-06-04 23:50:10 -07:00
  • 942c693c23 Add error type to SimpleConsumer error logging Dana Powers 2015-06-10 12:08:02 -07:00
  • 04cf4b3668 Use 500ms zookeeper session timeout for integration tests - no network here, and our restarts are fast Dana Powers 2015-06-10 11:21:21 -07:00
  • 6a3e813199 Use at_least=True when counting messages in leader failover tests Dana Powers 2015-06-10 11:06:26 -07:00
  • ed42d78991 Change SimpleConsumer.reset_partition_offset to return offset / None on failure (dont raise exception) Dana Powers 2015-06-10 09:50:06 -07:00
  • 680a8dc337 (test) SimpleConsumer.reset_partition_offset should not raise exception on failure Dana Powers 2015-06-10 09:46:33 -07:00
  • f021609911 Change Consumer commit() to return True/False and log error; dont raise client exceptions Dana Powers 2015-06-10 09:48:19 -07:00
  • ecdcdf531d (test) Consumer commit() should log errors and return True/False, not raise exceptions Dana Powers 2015-06-10 09:43:47 -07:00
  • e60de94317 Split consumer test class between Simple and MultiProcess Dana Powers 2015-06-10 09:38:24 -07:00
  • 043e9bb04f Retry failed messages in failover integration tests; use module logger Dana Powers 2015-06-10 10:01:30 -07:00
  • 8984141aef Log response error type in async producer Dana Powers 2015-06-09 23:18:03 -07:00
  • ded2ac7d32 Remove 1 sec timeout on topic creation in client response ordering test Dana Powers 2015-06-10 07:50:36 -07:00
  • 8e3cd1ca28 Merge pull request #403 from dpkp/client_request_response_ordering Dana Powers 2015-06-10 02:39:05 -07:00
  • 66b6b4aa6e Fix KafkaClient request / response ordering Dana Powers 2015-06-10 00:48:36 -07:00
  • 6117265108 Add KafkaClient test to show that request / response ordering is broken Dana Powers 2015-06-10 00:48:19 -07:00
  • 4c9a3c6b9d Reduce replica timeouts to 1sec for failover integration testing Dana Powers 2015-06-10 00:56:19 -07:00
  • 57b9c75df6 Test failover integration with 3-brokers / replicas / partitions Dana Powers 2015-06-09 22:59:52 -07:00
  • 8b0a598045 Add send/receive debug logging to async producer Dana Powers 2015-06-09 22:28:54 -07:00
  • 7b2f98f5ec KafkaClient log new broker and topic metadata received as INFO Dana Powers 2015-06-09 21:58:19 -07:00
  • d6585483e0 KafkaClient: log responses by requestId for debugging Dana Powers 2015-06-09 21:57:26 -07:00
  • bedaafa804 KafkaClient: log requestId on ConnectionError instead of hexdump of request contents Dana Powers 2015-06-09 21:56:35 -07:00
  • 0a048a3422 Add thread id to logging format to assist with debugging test failures Dana Powers 2015-06-09 20:25:45 -07:00
  • fc30855953 Reset kafka.conn logger level in tearDown Dana Powers 2015-06-09 20:25:13 -07:00