Commit Graph

  • 9820c5d553 Define ConsumerRebalanceListener abstract class Dana Powers 2015-12-28 14:54:50 -08:00
  • 35eb8c5eaa Add UNKNOWN_MEMBER_ID to JoinGroupRequest Dana Powers 2015-12-28 13:39:27 -08:00
  • 264fc8bb7c Add DEFAULT_GENERATION_ID and DEFAULT_RETENTION_TIME to OffsetCommitRequest_v2 Dana Powers 2015-12-28 13:39:10 -08:00
  • d0782dfecf New class: kafka.consumer.fetcher.Fetcher Dana Powers 2015-12-21 09:28:22 -08:00
  • 87257bddf2 Improvements to kafka.future.Future Dana Powers 2015-12-28 13:24:37 -08:00
  • b643ba1a1e New class SubscriptionState, based on upstream Java client Dana Powers 2015-12-21 09:14:57 -08:00
  • 87f0181b2c Add OffsetAndMetadata namedtuple Dana Powers 2015-12-21 09:13:58 -08:00
  • 97c7d8829b Add Message.validate_crc() method Dana Powers 2015-12-21 01:45:23 -08:00
  • a57ab55a5c Add OffsetResetStrategy enum class to kafka.protocol.offset Dana Powers 2015-12-21 01:44:53 -08:00
  • d2af5b37ce Use attributes on exception classes to signal retriable and invalid metadata errors Dana Powers 2015-12-21 01:43:57 -08:00
  • c9e6f17e42 Rename TopicAndPartition -> TopicPartition Dana Powers 2015-12-21 01:37:25 -08:00
  • fd1801907f New async KafkaClient, based on java NetworkClient and ConsumerClient Dana Powers 2015-12-20 10:27:52 -08:00
  • 76222f24b2 Update BrokerConnection for use with async client Dana Powers 2015-12-20 10:20:24 -08:00
  • 7c76138640 Add ClusterMetadata.add_group_coordinator() Dana Powers 2015-12-28 13:08:23 -08:00
  • cda2e17cd1 Rename Cluster -> ClusterMetadata; align with upstream Metadata class Dana Powers 2015-12-20 10:19:11 -08:00
  • a844d4fad6 Remove old kafka-bin directory and verify kafka-run-class.sh exists when installing server artifacts Dana Powers 2015-12-18 11:17:27 -08:00
  • d203b900ea Remove old kafka-bin directory and verify kafka-run-class.sh exists when installing server artifacts Dana Powers 2015-12-18 11:17:27 -08:00
  • 281fc0bc69 Only download/install server artifacts if bin/kafka-run-class.sh not found Dana Powers 2015-12-18 09:49:58 -08:00
  • a6aa6d53fa Only download/install server artifacts if bin/kafka-run-class.sh not found Dana Powers 2015-12-18 09:49:58 -08:00
  • fa28b2a9f4 Retry on FailedPayloadsError from consumer.pending() in failover tests Dana Powers 2015-12-18 08:52:21 -08:00
  • 680bd71755 Merge pull request #490 from mre/patch-1 Dana Powers 2015-12-18 08:25:00 -08:00
  • a3c85ddf91 Fix typo in docblock Matthias Endler 2015-12-18 17:03:27 +01:00
  • 04a3a32eb7 Merge pull request #489 from dpkp/producer_new_topic Dana Powers 2015-12-17 23:28:35 -08:00
  • f1ad0247df Switch BrokerConnection to (mostly) non-blocking IO. - return kafka.Future on send() - recv is now non-blocking call that completes futures when possible - update KafkaClient to block on future completion Dana Powers 2015-12-17 17:29:54 -08:00
  • f89b9da1f3 Mock client.ensure_topic_exists in test_producer_sync_fail_on_error Dana Powers 2015-12-17 10:23:15 -08:00
  • 178a1dccd8 Handle new topic creation / LeaderNotAvailableError in initial SimpleProducer.send_messages call Dana Powers 2015-12-16 22:39:51 -08:00
  • 7d4161f6d2 Add producer integration test for SimpleProducer handling new topic creation Dana Powers 2015-12-16 22:38:54 -08:00
  • 799824535c new 0.9 error codes plus descriptions. Zack Dever 2015-12-15 16:29:53 -08:00
  • 9da5e49331 Drop bytes encoding of consumer group in consumer integration test Dana Powers 2015-12-10 18:52:44 -08:00
  • b528410818 Remove bytes encoding for topic name in producer integration test Dana Powers 2015-12-10 18:52:18 -08:00
  • f86068a51a Check for no in-flight-requests in BrokerConnection.recv Dana Powers 2015-12-10 18:40:11 -08:00
  • 06e1b0329d Only log topic names (and broker metadata) in KafkaClient load_metadata debug logging Dana Powers 2015-12-10 18:39:23 -08:00
  • 8fff81468d Move Request / Response logging from KafkaClient to BrokerConnection and reenable kafka.conn debug logging in tests Dana Powers 2015-12-10 18:38:34 -08:00
  • 1cb732aba1 pylint fixes - temporarily ignore kafka/consumer/group.py - temporarily ignore test/test_protocol.py - disable-msg deprecated; use disable= instead Dana Powers 2015-12-10 17:48:12 -08:00
  • 5cf60f4482 Remove KafkaProtocol._decode_message Dana Powers 2015-12-10 17:48:05 -08:00
  • 3662cb6c50 Fix consumer integration test that assumed a single broker Dana Powers 2015-12-10 17:24:39 -08:00
  • 8411c169ec Add pylint hints to AbstractType because we cant mark a classmethod as abstract Dana Powers 2015-12-10 16:27:42 -08:00
  • 4d9f8971e1 Handle python3 in kafka.protocol.pickle Dana Powers 2015-12-10 16:26:45 -08:00
  • b3bd4cf09b Fix zk_chroot in consumer integration kafka fixtures Dana Powers 2015-12-10 16:26:14 -08:00
  • d54980a2cd Drop kafka_bytestring Dana Powers 2015-12-10 16:24:32 -08:00
  • ba4ec47af0 Merge pull request #487 from dpkp/kafka_version_tests Dana Powers 2015-12-10 14:55:15 -08:00
  • 4bd20aad2b Refactor kafka_versions to support arbitrary operators (> >= < <= ! =) Dana Powers 2015-12-10 12:21:37 -08:00
  • 7a80422494 Configure consumer group in consumer_integration tests Dana Powers 2015-12-10 10:59:40 -08:00
  • 7470cade6b Convert OffsetCommit and OffsetFetch protocol encode/decode Dana Powers 2015-12-10 10:57:27 -08:00
  • c3d2fda3c3 Fix test_consumer generator/list mock, reenable tests Dana Powers 2015-12-10 09:57:39 -08:00
  • eea162eb03 Update kafka.common imports to Payloads namedtuples in test_protocol Dana Powers 2015-12-09 16:03:33 -08:00
  • e37049fb69 Add next_correlation_id_recv + send helper methods to BrokerConnection Dana Powers 2015-12-09 15:58:18 -08:00
  • 06cc91c64c Support requests that do not expect a response in BrokerConnection Dana Powers 2015-12-09 15:53:07 -08:00
  • 98f393ba6f Default consumer integration tests should not use offset commits Dana Powers 2015-12-09 15:51:11 -08:00
  • f304fb6c4d Skip protocol tests for now -- need updating Dana Powers 2015-12-09 15:50:33 -08:00
  • 5c0bf5f377 Update to Payload namedtuples in consumer tests Dana Powers 2015-12-09 15:48:30 -08:00
  • 99514c3337 Skip consumer tests that cause iterator errors -- needs investigation Dana Powers 2015-12-09 15:48:00 -08:00
  • 1a50de4c3c Update client tests for new protocol usage Dana Powers 2015-12-09 15:46:36 -08:00
  • 172a272c42 Handle PartialMessage / ConsumerFetchSizeTooSmall in SimpleConsumer Dana Powers 2015-12-09 15:45:18 -08:00
  • a3ec9bd8e8 Update references to kafka.common Request/Response (now Payload) Dana Powers 2015-12-09 15:37:17 -08:00
  • ad030ccd4d Refactor KafkaClient to use BrokerConnections and new Request/Response structs Dana Powers 2015-12-09 15:34:58 -08:00
  • 4be8a58592 Exception handling cleanup in BrokerConnection (also catch struct.errors in recv) Dana Powers 2015-12-09 15:32:41 -08:00
  • 17d6a68f6e Add client_id and correlation_id to BrokerConnection constructor kwargs Dana Powers 2015-12-09 15:31:48 -08:00
  • d0de279459 Change KafkaProtocol to encode/decode Structs, not bytes - add Payload to kafka.common Request/Responses namedtuples - OffsetFetch and OffsetCommit still need to be converted Dana Powers 2015-12-09 15:20:57 -08:00
  • 9740b2b88b Support pickling of Structs -- _encode_self instance method needs some magic Dana Powers 2015-12-09 15:17:52 -08:00
  • 1636c96df4 Return PartialMessage object in MessageSet.decode if message is truncated by max_bytes Dana Powers 2015-12-09 15:16:37 -08:00
  • 5aeba4a7dc Fallback to simple repr() in Schema.repr() Dana Powers 2015-12-09 15:14:50 -08:00
  • c4f87bce20 Fix BytesIO import in kafka.protocol.message Dana Powers 2015-12-09 15:13:54 -08:00
  • 58bdeb17d7 Fix _mp_consume queue variable name conflict Dana Powers 2015-12-09 13:56:49 -08:00
  • 1856063f4e Fix _mp_consume queue variable name conflict Dana Powers 2015-12-09 13:56:49 -08:00
  • 035b936d7c Bump version for development of next release Dana Powers 2015-12-09 13:59:41 -08:00
  • 3a0a8e1ee4 Handle special __init__ signature in Message decode() Dana Powers 2015-12-09 10:14:10 -08:00
  • f719ffcc04 Handle decoding partial messages in MessageSet - caused by FetchRequest max_bytes Dana Powers 2015-12-09 10:13:19 -08:00
  • 753d8dca13 Merge branch 'master' into 0.9 Zack Dever 2015-12-07 13:37:30 -08:00
  • a678260d36 spelling fix in CHANGES.md and format fix in README.rst Zack Dever 2015-12-07 12:33:08 -08:00
  • 3168b6cacc Remove inadvertent markdown in CHANGES.md Dana Powers 2015-12-07 11:43:30 -08:00
  • 99d4a3a8b1 Release 0.9.5 v0.9.5 0.9.5 Dana Powers 2015-12-06 15:32:59 -08:00
  • 89d9d6f56b Update README links (restructured not markdown) Dana Powers 2015-12-07 00:01:35 -08:00
  • 205c9506c6 Update docs for new release Dana Powers 2015-12-06 17:55:20 -08:00
  • 0f07871951 Include README.rst, CHANGES.md, and AUTHORS.md in manifest Dana Powers 2015-12-06 16:50:12 -08:00
  • ca7c96c211 Update README links Dana Powers 2015-12-06 16:44:27 -08:00
  • 51edb421c7 Update README for new release Dana Powers 2015-12-04 11:29:45 -08:00
  • 74f04bc07e Add KafkaConsumer.close() PR to CHANGES Dana Powers 2015-12-06 16:56:00 -08:00
  • 89ea42af45 Merge pull request #426 from ucarion/ucarion-kafkaconsumer-close Dana Powers 2015-12-06 16:08:47 -08:00
  • c3b40b7569 Update Changelog in preparation for 0.9.5 release Dana Powers 2015-12-06 12:19:09 -08:00
  • 31ee4ed2af Log deprecation warning for timeout argument in Producer.stop() Dana Powers 2015-12-06 12:18:22 -08:00
  • 3b422544ac Merge pull request #485 from dpkp/async_producer_stop Dana Powers 2015-12-05 18:26:07 -08:00
  • 5682ff6353 Producer.stop() now blocks until async thread completes (drop confusing timeout arg) Dana Powers 2015-12-05 04:05:48 -08:00
  • 2916bb8650 Revert broken send_produce_request try/except from PR 467 (resps=None) Dana Powers 2015-12-05 03:59:09 -08:00
  • b687b4c5d4 Use producer.stop() to flush messages in async producer test Dana Powers 2015-12-05 03:36:12 -08:00
  • 0ab97a9908 Fix requestId handling in send_broker_aware_request Dana Powers 2015-12-04 18:02:22 -08:00
  • fb024355f0 Cleanup new producer tests... Dana Powers 2015-12-04 17:15:49 -08:00
  • 7dec992a4e client.reinit() can raise an exception; catch in async producer Dana Powers 2015-12-04 16:29:29 -08:00
  • 8a74c20345 Update kafka broker list for travis testing (add 0.9.0.0, bump 0.8.2.2) Dana Powers 2015-12-04 11:35:56 -08:00
  • 25a220fd08 Update setup.py to show python 3.5 compatibility explicitly Dana Powers 2015-12-04 11:17:45 -08:00
  • 71a789133b Add py35 to tox testing move python3 configs to default and special case py26/py27 add py35 to travis_selector.sh Dana Powers 2015-12-04 10:45:56 -08:00
  • 7355bf4359 Cache pip and servers/ for travis builds Dana Powers 2015-12-04 10:45:16 -08:00
  • e289ab5931 Update travis config to use container infrastructure Dana Powers 2015-12-04 10:15:27 -08:00
  • efc3d4f466 few small cleanups Zack Dever 2015-12-03 17:46:08 -08:00
  • 5d87a5edb4 administration api schemas Zack Dever 2015-12-03 15:55:04 -08:00
  • 892f5dd933 group membership api schemas Zack Dever 2015-12-03 15:17:47 -08:00
  • 7a6c51bf2e Add size and correlation id decoding to try/except block in BrokerConnection Dana Powers 2015-12-01 16:21:08 -08:00
  • 254c17e39f Add comment re bytes offset tracking in MessageSet decode() Dana Powers 2015-12-01 16:20:33 -08:00
  • 235f7ac855 Unfinished kafka.consumer.group commit Dana Powers 2015-12-01 11:11:51 -08:00
  • c94cb62029 Add simple Cluster class to manage broker metadata Dana Powers 2015-11-29 11:24:35 -08:00