taskflow/taskflow/utils
Joshua Harlow c5e9cf28df Instead of a multiprocessing queue use sockets via asyncore
For a local process based executor usage currently to ensure
that task emitted notifications are proxied we use the multi
processing library and use its queue concept. This sadly creates
a proxy process that gets associated, and this proxy process
handles the queue and messages sent to and from it. Instead of
doing this we can instead just create a temporary local socket
using a random socket and have tasks (which are running in
different processes) use that to communicate back any emitted
notifications instead (and we can use the asyncore module to handle
the emitted notifications since it handles the lower level socket
reading, polling and dispatching).

To ensure that the socket created is somewhat secure we use a
similar process as the multi-processing library uses where we
sign all messages with a hmac that uses a one time key that only
the main process and the child process know about (and reject
any messages that do not validate using this key).

Change-Id: Iff9180054bf14495e5667af00ae2fafbdbc23791
2016-05-24 16:16:56 -07:00
..
__init__.py Removed copyright from empty files 2014-02-22 17:16:29 +08:00
async_utils.py Bump futurist and remove waiting code in taskflow 2015-07-25 18:54:22 -07:00
banner.py Spice up WBE banner and add simple worker __main__ entrypoint 2016-02-08 16:33:14 -08:00
eventlet_utils.py Use importutils.try_import for optional eventlet imports 2015-01-25 11:10:14 -08:00
iter_utils.py Fix wrong usage of iter_utils.unique_seen 2016-01-09 22:42:17 -08:00
kazoo_utils.py Merge "Remove kazoo hack/fix for issue no longer needed" 2015-07-21 04:39:20 +00:00
kombu_utils.py Add todo note for kombu pull request 2015-02-16 21:55:44 -08:00
misc.py Instead of a multiprocessing queue use sockets via asyncore 2016-05-24 16:16:56 -07:00
mixins.py Use encodeutils for exception -> string function 2015-06-30 17:08:45 -07:00
persistence_utils.py Retrieve the store from flowdetails as well, if it exists 2016-01-25 15:04:34 -06:00
redis_utils.py Build-out + test a redis backed jobboard 2015-06-29 12:13:01 -07:00
schema_utils.py Add + use failure json schema validation 2015-03-11 12:53:15 -07:00
threading_utils.py Add a executor backed conductor and have existing impl. use it 2015-11-12 17:03:00 -08:00