This website requires JavaScript.
d736d0b074
Add tests for limited and unlimited consumer max_buffer_size
2014-01-03 17:49:23 -08:00
59f884c5aa
Fix client and consumer params in integration tests
2014-01-03 17:47:39 -08:00
57218546d7
Remove unnecessary brackets
2014-01-03 17:40:07 -08:00
6d2b28a59e
Handle starting/stopping Kafka brokers that are already started/stopped in integration tests
2014-01-03 15:52:37 -08:00
bbd90e12ff
Add a limit to fetch buffer size, and actually retry requests when fetch size is too small
2014-01-03 15:49:55 -08:00
8540f1f3b6
Fix client error handling
2014-01-03 15:29:04 -08:00
d1e4fd25c6
Raise a ConnectionError when a socket.error is raised when receiving data Also, log.exception() is unhelpfully noisy. Use log.error() with some error details in the message instead.
2014-01-03 15:26:00 -08:00
81d001bfa2
Fix seek offset deltas
2014-01-03 15:18:32 -08:00
99b561d95f
Style fix for imports
2014-01-03 10:57:29 -08:00
b6b1ba0940
Fix unit tests.
2014-01-02 18:16:41 -08:00
009ed92894
Add note about questionable error handling while decoding messages. Will remove once any error handling issues are resolved.
2014-01-02 18:14:44 -08:00
93b6579a0f
Add and fix comments to protocol.py
2014-01-02 18:10:57 -08:00
c1ba5101b7
Add comments and maintain 80 character line limit
2013-12-19 13:35:53 -08:00
dc4198bddc
Add iter_timeout option to SimpleConsumer. If not None, it causes the iterator to exit when reached. Also put constant timeout values in pre-defined constants
2013-12-19 13:24:28 -08:00
450faeb328
Add buffer_size param description to docstring
2013-12-19 13:19:40 -08:00
b68523fd28
Remove SimpleConsumer queue size limit since it can cause the iterator to block forever if it's reached.
2013-12-19 11:36:15 -08:00
0c7cf2569e
SimpleConsumer flow changes: * Combine partition fetch requests into a single request * Put the messages received in a queue and update offsets * Grab as many messages from the queue as requested * When the queue is empty, request more * timeout param for get_messages() is the actual timeout for getting those messages * Based on https://github.com/mumrah/kafka-python/pull/74 - don't increase min_bytes if the consumer fetch buffer size is too small.
2013-12-18 18:36:32 -08:00
5dd8d81c9e
Reset consumer fields to original values rather than defaults in FetchContext
2013-12-18 17:56:29 -08:00
4d6bafae7e
Allow None timeout in FetchContext even if block is False
2013-12-18 17:54:17 -08:00
8c8ca5fa57
* Guarantee reading the expected number of bytes from the socket every time * Remove bufsize from client and conn, since they're not actually enforced
2013-12-18 17:51:22 -08:00
0f2b08d802
Read the correct number of bytes from kafka.
2013-12-18 17:47:52 -08:00
60ccb4dd02
Allow customizing socket timeouts.
2013-12-18 16:53:03 -08:00
8f076df94c
Merge pull request #84 from nieksand/simpler_timeouts
2013-12-28 12:01:11 -08:00
bec4dd3c16
Merge pull request #83 from eklitzke/master
2013-12-28 11:58:35 -08:00
607bfa0aae
Remove tox from requires
2013-12-28 14:56:00 -05:00
cab017a9aa
Replaced _send_upstream datetime logic with simpler time().
2013-12-25 22:00:21 -08:00
7f1db1d346
reduce memory copies when consuming kafka responses
2013-12-25 16:16:05 -08:00
a3066879d2
Merge pull request #77 from zever/timeout-none
2013-12-13 07:10:51 -08:00
67c13f9bcd
Merge pull request #78 from zever/README-typo
2013-12-13 07:08:35 -08:00
043e7fda6b
fix typo in README acks_timeout -> ack_timeout
2013-12-12 17:39:19 -08:00
8d26368433
allow for timeout to be None in SimpleConsumer.get_messages
2013-12-12 17:03:35 -08:00
cc96e5c89a
Update kafka-src to 0.8.0 tag
2013-12-06 21:18:26 -05:00
0bdff4e833
Allow KafkaClient to take in a list of brokers for bootstrapping
2013-11-14 09:26:49 -05:00
af3a57edb2
Set host and port in ExternalService test fixture
2013-11-11 10:20:25 -05:00
da255638aa
Enable absolute imports for modules using Queue.
2013-10-21 20:07:43 +00:00
33cde520de
Merge pull request #62 from mahendra/cons-windows
2013-10-09 01:46:47 -07:00
ceee715fc7
Add proper string representations for each class
2013-10-08 14:46:02 +05:30
6e3ee64ef3
Ensure that multiprocess consumer works in windows
2013-10-08 09:28:58 +05:30
92d70e7310
Merge pull request #61 from mahendra/prod-windows
2013-10-07 20:29:35 -07:00
f9cf62816f
Merge branch 'master' into prod-windows
2013-10-08 08:50:52 +05:30
eb2c1735f2
Merge pull request #55 from quixey/fault-tolerance
2013-10-07 14:16:13 -07:00
75de0f0095
Ensure that async producer works in windows. Fixes #46
2013-10-07 15:57:44 +05:30
a6c99b287b
make changes to be more fault tolerant: clean up connections, brokers, failed_messages
2013-09-27 14:02:10 -07:00
cfd9f86e60
Merge pull request #59 from mrtheb/master
2013-10-04 04:54:12 -07:00
59af614d1d
Test fixes after flake8 run
2013-10-03 23:01:35 -04:00
a03f0c86b8
flake8 pass (pep8 and pyflakes)
2013-10-03 22:52:04 -04:00
b0cacc9485
Update kafka-src to 0.8.0 RC1
2013-10-03 20:12:33 -04:00
11f22fb3d7
remove unused exception instance variables
2013-10-03 18:26:34 +04:00
7ac75c575c
use NotImplementedError instead of NotImplementedError
2013-10-03 18:22:00 +04:00
4ccfa5ce76
don't forget to call superclass __init__
2013-10-03 18:19:54 +04:00
3ba54c6e05
style: fix camelCase variable names again
2013-10-03 18:13:34 +04:00
e82f04e3b8
style: remove extra brackets one more time
2013-10-03 18:11:07 +04:00
a6b314d963
style: remove extra brackets
2013-10-03 18:09:47 +04:00
3a56dfd624
style: fix camelCase variable names once more
2013-10-03 18:08:51 +04:00
8b05e6240b
style: fix camelCase variable names
2013-10-03 18:06:28 +04:00
e392e0c201
style: use triple quotes for docstrings
2013-10-03 18:00:57 +04:00
e87cddef1b
style: fix whitespaces
2013-10-03 17:56:29 +04:00
f833050f0a
Updating year in LICENSE
2013-10-03 13:43:48 -04:00
0866be7844
Remove Python 2.6 from CI builds, ref #57
2013-10-03 13:12:04 -04:00
f70ef1d3d6
Revert "Disable unit tests for 2.6, close #57 "
2013-10-03 13:11:33 -04:00
e39e05f8a5
Disable unit tests for 2.6, close #57
2013-10-03 12:59:21 -04:00
e898500ac6
Travis-CI workaround for multiprocessing.Queue OSError
2013-10-03 12:41:25 -04:00
9c868d47cd
Add assembly-package-dependency to Travis config
2013-10-03 12:23:22 -04:00
deb584c908
Cherry-pick mrtheb/kafka-python 2b016b69
2013-10-01 15:15:36 -04:00
c304e3d4b0
Cherry-pick mrtheb/kafka-python 8b9c7e51
2013-10-01 15:07:47 -04:00
1d4bc3f631
Updating authors, thanks to all the contributors!
2013-10-02 16:32:33 -04:00
8cc4666f07
Update POWERED-BY.md
2013-10-02 16:15:06 -04:00
3dbf3b60c3
Adding a POWERED-BY.md file to people to give us props
2013-10-02 16:14:02 -04:00
2a90506ce7
Merge pull request #54 from jimjh/patch-1
2013-10-02 12:46:24 -07:00
7c3cfbcfc3
update README.md to link to travis-ci's build page
2013-10-02 11:55:09 -07:00
a55f59d50e
Adding git-submodule update to Travis YML file
2013-10-02 08:06:43 -04:00
b10b73aa11
Merge pull request #53 from jimjh/testing
2013-10-02 05:04:28 -07:00
791e07f89c
add .travis.yml
2013-10-01 18:10:19 -07:00
c1a6b8ebdb
Merge pull request #49 from jimjh/import-buffer-underflow-error
2013-09-27 14:23:59 -07:00
f81d254e80
import bufferunderflow error
2013-09-27 13:53:08 -07:00
2ed7638044
Merge pull request #48 from StevenLeRoux/master
2013-09-26 09:44:20 -07:00
3194d55642
Update README.md
2013-09-26 18:08:44 +02:00
2f6bcc2b8c
Merge pull request #47 from StevenLeRoux/master
2013-09-26 03:23:22 -07:00
3e68f94038
Update README.md
2013-09-26 12:00:46 +02:00
c0d2cac669
Fix #44 Add missing exception class
2013-09-24 21:18:55 -04:00
9af7b817c1
Merge pull request #45 from quixey/allow-client-id
2013-09-24 16:44:28 -07:00
caf7c6860c
allow a client id to be passed to the client
2013-09-24 16:17:47 -07:00
0c732ca68a
Documenting new behavior in CHANGES.md
2013-09-09 10:21:38 -04:00
f67ad27f72
Auto-adjusting consumer fetch size
2013-09-09 00:44:36 -04:00
40d8e9e550
Fixed #42 , make fetch size configurable
2013-09-08 20:20:12 -04:00
c3bce13b84
Show alternative way of running tests in README.md
2013-07-26 08:54:21 -04:00
e297a7a8c8
Merge branch 'issue-35'
2013-07-26 08:39:44 -04:00
5684af438e
Merge pull request #33 from mahendra/asyncproducer
2013-07-11 05:58:54 -07:00
1d278f0f60
Fix minor bug in offset management
2013-07-01 10:33:50 +05:30
c54a2edbae
Add more cleanup in consumer.stop()
2013-06-28 14:54:11 +05:30
c13ee1df6a
Fix cases of single partition
2013-06-28 13:59:06 +05:30
7b2a08faed
Minor markup fix
2013-06-28 13:09:02 +05:30
9a557ed0bc
Fix markups
2013-06-28 13:08:04 +05:30
6b76d9d682
Fix markup in README
2013-06-28 13:07:10 +05:30
c2a49c1370
Add TODO comments
2013-06-27 17:51:12 +05:30
36b5f81543
Test cases for multi-process consumer and blocking APIs
2013-06-27 17:47:47 +05:30
b3fece508d
Re-init the sockets in the new process
2013-06-27 17:47:26 +05:30
d6d7299b7d
Fix a bug in seek.
2013-06-27 16:26:01 +05:30
d2df8f5463
Test cases for new producer
2013-06-27 14:02:45 +05:30
ffdc08aeec
Adding @sandello to AUTHORS.md
2013-06-26 10:07:47 -04:00
Omar Ghishan