Commit Graph

Select branches

Hide Pull Requests

0.10.0.1

0.7

0.8

0.9

0_10_1_0

0_10_1_1

0_11_0_0

709

741

KAFKA-3117

KAFKA-3196

KAFKA-3197

KAFKA-3388

KAFKA-3486

KAFKA-3960

absolute_import

at_exit_weakref

await_reserved

backoff_coordinator_retry

batch_expiration_message

benchmarks

check_version

check_version_0_10

client_api_version

combine_send_bytes

compacted_offsets

config_selector

conn_check_version_max_in_flight

conn_legacy

conn_metrics_fix

connection_error_close

consumer_iterator

coordinator_dead_error_logging

coordinator_del

coordinator_unknown_heartbeat

debian/newton

decode_errors

disconnects

double_compression

drain_pending_coordinator_requests

drain_requests_join_group

errors

exclude_internal_topics

exp_backoff

faster_validate_crc

fetcher_offset_out_of_range

fetcher_randomize_order

fix_leaks

fixture_auto_ports

kafka-0.8.0-release

kafka_error_str

larsjsol-sasl_plain

leak_z4

least_loaded_node

lz4_0_10

master

max_poll_records

message_format_v1

message_set_encode_size

metadata_refresh_backoff

metadata_v1

metadata_wait_for_connect

metadata_with_partitions

more_metrics

murmur2_ascii

no_sleep_til_brooklyn

partial_messages

produce_fetch_v2

producer_defaults

protocol_updates

pylint_fixup

receive_bytes_pipe

record_metadata_simplify

refactor

release

release-0.9.x

remove_bad_test

request_response_classes

sensor_quota_message

serialize_interface

simple

six

skip_autocommit_consumer_close

socket_options

subscription_copy

testing

timeout_idle_connections

timeout_noresponse

unrecurse_unpack_message_set

update-rtd-links

wake_socketpair_exceptions

warn_dns_error

zk_autocommit

0.1-alpha

0.9.3

0.9.5

1.0.0

1.0.1

1.0.2

1.1.0

1.1.1

1.2.0

1.2.1

1.2.2

1.2.3

1.2.4

1.2.5

1.3.0

1.3.1

1.3.2

1.3.3

debian/0.9.3-1

debian/0.9.3-2

debian/0.9.5-2

debian/0.9.5.1

v0.8.0

v0.9.0

v0.9.1

v0.9.2

v0.9.3

v0.9.4

v0.9.5

Mono Color

• 843b34732d Add KafkaConsumer.highwater(partition) to get highwater offsets from FetchResponses Dana Powers 2016-01-31 23:46:31 -08:00
• 33b9ff2e33 Fetcher iterator should check for pause and seek resets Dana Powers 2016-01-31 23:42:04 -08:00
• 130155b874 Fetcher should filter compressed messages with offsets lower than were requested Dana Powers 2016-01-31 23:41:08 -08:00
• 54d21bf0f9 Fix missing import Dana Powers 2016-01-30 18:24:07 -08:00
• 47da03d90f Skip MultiProcessConsumer integration tests Dana Powers 2016-01-30 14:07:39 -08:00
• c506c61364 Merge pull request #527 from dpkp/iterator_timeout Dana Powers 2016-01-30 10:43:43 -08:00
• 995f11f9ec Fix internal timeout / sleep handling in consumer iterator Dana Powers 2016-01-29 17:12:06 -08:00
• 421977a342 Catch dns lookup errors when attempting to connect to nodes Dana Powers 2016-01-27 13:16:09 -08:00
• 0daab2cadc Merge pull request #523 from dpkp/null_logger Dana Powers 2016-01-27 13:14:41 -08:00
• 0914b81248 Merge pull request #522 from dpkp/lz4_fixup Dana Powers 2016-01-27 10:54:57 -08:00
• a8dd3b45a2 Add logging NullHandler to avoid No Handlers warnings Dana Powers 2016-01-27 10:53:50 -08:00
• f08ec792ee Handle broken LZ4 framing; switch to lz4tools + xxhash Dana Powers 2016-01-26 20:35:22 -08:00
• 66284e57ac Add end-to-end integration testing for all compression types Dana Powers 2016-01-26 20:34:13 -08:00
• 54a735bed0 Add error 104 / Connection reset by peer to expected check_version errors Dana Powers 2016-01-25 22:44:54 -08:00
• 489f9192f8 Prefer module imports (io.BytesIO) Dana Powers 2016-01-25 22:11:58 -08:00
• ccf0de0f4d python-snappy does not like buffer-slices on pypy... Dana Powers 2016-01-25 22:11:18 -08:00
• a2e9eb5214 Update docs w/ KafkaProducer; move Simple clients to separate document Dana Powers 2016-01-25 17:32:06 -08:00
• 650a27103c Ignore pylint errors on buffer/memoryview Dana Powers 2016-01-25 17:34:06 -08:00
• 0a74a9eec0 Python3 does not support buffer -- use memoryview in snappy_decode Dana Powers 2016-01-25 17:14:35 -08:00
• 78bbc6d4d4 Add Fetcher unit tests Dana Powers 2016-01-25 16:41:50 -08:00
• d9f886b88d Fix Fetch._create_fetch_requests docstring Dana Powers 2016-01-25 16:40:59 -08:00
• 654f6b6247 Remove test_correlation_id_rollover; use daemon threads for test consumers Dana Powers 2016-01-25 16:03:22 -08:00
• a154d0471c Ok to sleep in blocking poll for metadata update Dana Powers 2016-01-25 16:01:53 -08:00
• a667a4b3be Small KafkaClient.check_version() improvements Dana Powers 2016-01-25 15:59:35 -08:00
• 71a9e65e58 Log new KafkaClient under kafka.client until files are merged Dana Powers 2016-01-25 15:58:37 -08:00
• 7b5e42bc8b Update xerial snappy tests for new xerial default Dana Powers 2016-01-25 16:28:23 -08:00
• cd956d8d79 Dont need context manager for BytesIO Dana Powers 2016-01-25 15:37:13 -08:00
• 7e09258409 Write xerial-formatted snappy by default; use buffers to reduce copies Dana Powers 2016-01-25 15:36:08 -08:00
• 0dcd5f10b9 Merge pull request #518 from dpkp/lz4 Dana Powers 2016-01-25 12:27:24 -08:00
• c118991a1c Add lz4 to tox environment deps Dana Powers 2016-01-24 22:02:06 -08:00
• 86639e736f Convert codec tests to pytest; add simple lz4 test Dana Powers 2016-01-24 22:01:43 -08:00
• 0d5899020a Add support for LZ4 compressed messages using python-lz4 module Dana Powers 2016-01-24 22:01:09 -08:00
• 2c7b7452a8 Merge pull request #516 from dpkp/group_id_none Dana Powers 2016-01-24 21:24:21 -08:00
• c02b2711f1 Disable auto-commit / group assignment in producer test Dana Powers 2016-01-24 18:43:17 -08:00
• 2a1970138c Disable offset commits and auto-partition-assignment when group_id is None Dana Powers 2016-01-24 16:22:14 -08:00
• 077dc4742f Merge pull request #515 from dpkp/kafka_producer Dana Powers 2016-01-24 18:36:46 -08:00
• 85c0dd2579 Add KafkaProducer to autodocs and README Dana Powers 2016-01-23 22:50:26 -08:00
• f51623142d Add simple KafkaProducer -> KafkaConsumer integration test Dana Powers 2016-01-23 22:47:11 -08:00
• 4d993bbe12 add DefaultPartitioner test Dana Powers 2016-01-24 17:32:29 -08:00
• acd1ae4d74 Move pytest broker/zk fixtures to test.conftest Dana Powers 2016-01-23 22:46:17 -08:00
• 34a18aea78 Rename legacy producer tests Dana Powers 2016-01-23 18:42:40 -08:00
• 0a6af29625 Add KafkaProducer to kafka and kafka.producer module imports Dana Powers 2016-01-23 22:39:39 -08:00
• 44330f49cf Implement new KafkaProducer, mimicing java client interface / design Dana Powers 2016-01-23 16:58:09 -08:00
• 434d1abb18 Sender class to manage background IO for KafkaProducer Dana Powers 2016-01-23 15:45:29 -08:00
• a250fe3418 RecordAccumulator and RecordBatch, for use by async batching KafkaProducer Dana Powers 2016-01-23 15:41:44 -08:00
• 4761e242c1 Add thread-aware futures for use with KafkaProducer Dana Powers 2016-01-23 15:34:50 -08:00
• f944392273 Add MessageSetBuffer and SimpleBufferPool to manage producer messages Dana Powers 2016-01-23 15:32:08 -08:00
• 030d133f6f DefaultPartitioner - implements java client logic Dana Powers 2016-01-23 15:27:11 -08:00
• da787214e1 Support encode and repr on raw BytesIO MessageSets (used in new producer) Dana Powers 2016-01-23 15:25:05 -08:00
• ee19cbfa4a Add Message and MessageSet HEADER_SIZE bytes Dana Powers 2016-01-23 15:19:55 -08:00
• 48e96822b3 Dont need to refresh metadata on GroupCoordinatorNotAvailableErrors Dana Powers 2016-01-24 13:23:26 -08:00
• 6eecabfe85 Write bytes to wake_fd Dana Powers 2016-01-24 12:46:05 -08:00
• 80c3a76aa6 Warn on 0.8.2 GroupCoordinator no-topic-quirk, dont raise exception Dana Powers 2016-01-23 23:27:17 -08:00
• b52f17e18d Ignore _socketobject errors in pylint -- v1.5.4 started throwing no-member errors on python 2.7 Dana Powers 2016-01-23 18:39:42 -08:00
• 0c395bd96a Pylint ignores to fix weird 2.7 error in new pylint version Dana Powers 2016-01-23 16:58:56 -08:00
• 962d8c0805 Fix client poll tests (called with sleep=False) Dana Powers 2016-01-23 16:17:42 -08:00
• 318b10744c Add available_partitions_for_topic() and partitions_for_broker() Dana Powers 2016-01-23 15:07:23 -08:00
• d2012e067c KafkaClient.add_topic() -- for use by async producer Dana Powers 2016-01-23 15:06:17 -08:00
• b8c209714c Optionally sleep in KafkaClient.poll(), add KafkaClient.wakeup() Dana Powers 2016-01-23 15:02:29 -08:00
• 4c2ad12780 Add back connection_delay method to KafkaClient - used by KafkaProducer Dana Powers 2016-01-18 22:15:58 -08:00
• 1f6be11b09 Merge pull request #507 from dpkp/deprecation_warnings Dana Powers 2016-01-12 22:57:24 -08:00
• 22f84bfb78 Merge pull request #503 from dpkp/iterator_fetches Dana Powers 2016-01-12 22:53:51 -08:00
• 4079a582b0 Add DeprecationWarnings to legacy KafkaClient, Simple/MultiProcess/Consumer, and KafkaConnection Dana Powers 2016-01-12 16:52:30 -08:00
• 3e622068ea Sleep in KafkaConsumer iterator if no partition assignment; dont block in poll if no in-flight fetches Dana Powers 2016-01-12 14:46:02 -08:00
• 22e84a57cb Remove sleep call in client.poll -- expect callers to manage this and log warning Dana Powers 2016-01-12 14:43:49 -08:00
• dcd62b72e3 Move consumer_timeout handling to private method Dana Powers 2016-01-12 14:42:17 -08:00
• cc3e1cc9a1 Attempt to pipeline fetchrequests in iterator Dana Powers 2016-01-12 14:41:22 -08:00
• e58b447b8e Use private deque to track in-flight fetchrequests Dana Powers 2016-01-12 14:38:16 -08:00
• dcad3fea16 Add mocking to test_coordinator::test_close to fix random test failure (via travis logs) Dana Powers 2016-01-11 16:09:04 -08:00
• 1c4a8bfc67 Update docstring and comments in _create_fetch_requests re KAFKA-2978 Dana Powers 2016-01-10 22:58:11 -08:00
• 458bdb50f6 Reorganize init_fetches calls during iteration Dana Powers 2016-01-10 22:53:35 -08:00
• 76e7d13bdd Check for assignment changes before yielding new record Dana Powers 2016-01-10 22:48:09 -08:00
• 0adb71af38 Fetcher logging should be debug or trace (left higher during testing) Dana Powers 2016-01-10 22:47:13 -08:00
• 829b0379eb Merge pull request #496 from dpkp/idle_sleep Dana Powers 2016-01-10 22:20:42 -08:00
• ecb4d49c06 Pass consumer timeout to client.poll() in iterator; check timeout before iterating fetcher Dana Powers 2016-01-10 19:56:00 -08:00
• b86daafeaf Fix sec / millisec unit bug in KafkaConsumer._poll_once() Dana Powers 2016-01-10 19:54:14 -08:00
• d2f136073c Receive all available responses in client._poll Dana Powers 2016-01-10 19:53:07 -08:00
• 5fa8c88d6f If a completed future is polled, do not block Dana Powers 2016-01-10 19:52:16 -08:00
• 1fd596062f Avoid CPU spinnning when there are no sockets to read Dana Powers 2016-01-08 15:47:37 -08:00
• 5d2886bae3 Fix delayed_task timeout commit 45d26b6 Dana Powers 2016-01-10 21:11:02 -08:00
• ca08f759df Merge pull request #502 from dpkp/task_poll_timeout Dana Powers 2016-01-10 16:40:29 -08:00
• 8ae2a30731 Log generation and member_id in threaded consumer group test Dana Powers 2016-01-10 16:14:30 -08:00
• 1eaad6fcbe Fix debug logging call in PR 500 Dana Powers 2016-01-10 16:02:40 -08:00
• 98e4ab3cb9 Improve KafkaConsumer iterator loop timeouts Dana Powers 2016-01-10 15:47:33 -08:00
• cc4cf23692 Improve cluster.ttl() readability Dana Powers 2016-01-10 15:43:33 -08:00
• 45d26b6d32 Check delayed task timeout in client.poll() Dana Powers 2016-01-10 15:42:26 -08:00
• 7ee73df4c4 Remove old kafka.consumer.kafka module Dana Powers 2016-01-10 12:49:47 -08:00
• 2d4b0d1f78 Merge pull request #500 from dpkp/kafka-2978 Dana Powers 2016-01-10 12:47:40 -08:00
• 9837927c70 KAFKA-2978: consumer stops fetching when consumed and fetch positions get out of sync Dana Powers 2016-01-09 16:52:01 -08:00
• 814b599c49 Merge pull request #501 from dpkp/coordinator_tests Dana Powers 2016-01-10 12:05:14 -08:00
• 240f7029de Add ConsumerCoordinator unit tests Dana Powers 2016-01-10 03:15:47 -08:00
• 0a62cc1b86 Merge pull request #499 from dpkp/handle_disconnect Dana Powers 2016-01-10 09:30:06 -08:00
• bbd6444e85 ConsumerCoordinator cleanups Dana Powers 2016-01-10 00:25:54 -08:00
• 35ed2e75da Add error checking to mark_for_reassignment Dana Powers 2016-01-10 00:34:23 -08:00
• b7104957f7 Move ConsumerProtocol definition to kafka.coordinator.protocol Dana Powers 2016-01-10 00:25:12 -08:00
• 5975de8b79 Refresh metadata on failed connection attempts Dana Powers 2016-01-09 13:39:05 -08:00
• 651454a074 Fill out more async client unit tests Dana Powers 2016-01-09 18:43:46 -08:00
• cc22d1bab8 Remove errant kafka_versions('all') from 0.9 merge Dana Powers 2016-01-07 20:27:01 -08:00
• e30a09882a Update README from new docs Dana Powers 2016-01-07 19:21:50 -08:00
• 828377377d Merge branch '0.9' Dana Powers 2016-01-07 18:51:14 -08:00