neutron/neutron/tests/unit
Rodolfo Alonso Hernandez 2d849c6fee Refactor the L3 agent batch notifier
This patch is the first one of a series of patches improving how the L3
agents update the router HA state to the Neutron server.

This patch partially reverts the previous patch [1]. When the batch
notifier sends events, it calls the callback method passed during the
initialization, in this case AgentMixin.notify_server. The batch
notifier spawns a new thread in charge of sending the notifications and
then wait the specified "batch_interval" time. If the callback method is
not synchronous with the notify thread execution (what [1] implemented),
the thread can finish while the RPC client is still sending the
HA router states. If another HA state update is received, then both
updates can be executed at the same time. It is possible then that a new
router state can be overwritten with an old one still not sent or
processed.

The batch notifier is refactored, to improve what initally was
implemented [2] and then updated [3]. Currently, each new event thread
can update the "pending_events" list. Then, a new thread is spawned to
process this event list. This thread decouples the current execution
from the calling thread, making the event processing a non-blocking
process.

But with the current implementation, each new process will spawn a new
thread, synchronized with the previous and new ones (using a
synchronized decorator). That means, during the batch interval time, the
system can have as many threads waiting as new events received. Those
threads will end secuentially when the previous threads end the batch
interval sleep time.

Instead of this, this patch receives and enqueue each new event and
allows only one thread to be alive while processing the event list. If
at the end of the processing loop new events are stored, the thread will
process then.

[1] I3f555a0c78fbc02d8214f12b62c37d140bc71da1
[2] I2f8cf261f48bdb632ac0bd643a337290b5297fce
[3] I82f403441564955345f47877151e0c457712dd2f

Partial-Bug: #1837635

Change-Id: I20cfa1cf5281198079f5e0dbf195755abc919581
(cherry picked from commit 8b7d2c8a93)
2020-04-10 16:39:30 +02:00
..
agent Add accepted egress direct flow 2020-03-26 08:23:32 +00:00
api Fix bug: AttributeError arises while sorting with standard attributes 2020-02-15 12:32:24 +01:00
cmd Fix exception in neutron-sanity-check 2018-06-13 18:21:14 +00:00
common Packets getting lost during SNAT with too many connections 2019-06-04 23:23:07 +00:00
conf/agent Agent common config 2017-03-15 09:52:18 -06:00
core_extensions Refactor duplicated implementation of _get_policy_obj 2018-06-20 09:51:02 +08:00
db Handle ports assigned to routers without routerports 2019-10-15 10:44:54 +00:00
debug Change ip_lib network namespace code to use pyroute2 2017-10-04 21:09:28 +00:00
extensions fixed_configured=True when Add/Remove port IPs 2019-10-09 09:36:57 +00:00
hacking Adopt hacking 1.1.0 2018-07-05 11:31:40 +09:00
ipam Add bulk IP address assignment to ipam driver 2020-03-26 12:30:50 +00:00
notifiers Refactor the L3 agent batch notifier 2020-04-10 16:39:30 +02:00
objects Use dynamic lazy mode for fetching security group rules 2019-04-29 21:46:55 -06:00
pecan_wsgi Removing deprecated module neutron.api.versions 2018-03-28 14:15:50 +07:00
plugins Add accepted egress direct flow 2020-03-26 08:23:32 +00:00
privileged python3: fix netlink_lib delete_entries 2018-06-29 00:30:19 +02:00
quota use get reader/writer session from neutron-lib 2018-07-06 14:43:31 -06:00
scheduler Trigger router update only when gateway port IP changed 2020-02-20 09:57:48 +00:00
services Run revision bump operations en masse 2019-11-25 13:55:43 -05:00
tests Increase timeouts for OVSDB in functional tests 2019-09-13 10:57:24 +00:00
__init__.py Don't set use_stderr to False for tests 2017-04-15 01:41:29 +00:00
_test_extension_portbindings.py Remove the unit test 'test_ports_vnic_type_list' 2018-06-15 15:12:10 +00:00
dummy_plugin.py Add dependency for service plugin 2019-04-12 08:33:27 +00:00
extension_stubs.py Consume ServicePluginBase from neutron-lib 2017-03-17 12:06:57 -06:00
test_auth.py Fix context deprecation warnings 2018-02-13 15:02:49 -05:00
test_manager.py Avoid loading same service plugin more than once 2019-04-12 08:33:38 +00:00
test_neutron_plugin_base_v2.py Add unit test to validate non DB base core plugin can be loaded 2017-11-15 21:21:35 +00:00
test_opts.py
test_policy.py Fix handling of network:shared field in policy module 2019-05-09 09:42:25 +00:00
test_service.py use callback payloads for _SPAWN events 2017-12-21 11:03:36 -07:00
test_worker.py Move AgentStatusCheckWorker to PeriodicWorker 2016-11-17 15:31:19 -08:00
test_wsgi.py Update neutron files for new over-indentation hacking rule (E117) 2019-01-30 20:05:18 +03:00
testlib_api.py Adopt hacking 1.1.0 2018-07-05 11:31:40 +09:00