Commit Graph

266 Commits (master)

Author SHA1 Message Date
Mitchell Jameson cec3251ee7 Add support for provisioning L2 connectivity for L3 GW ports
Change-Id: I2a0eab2bcb087f206252b3d8e5ea095187d1a07e
2023-05-03 09:32:37 -07:00
Nader Lahouti 0fff7b8ae3 Use context manager from neutron-lib accessing VlanAllocation
Changed the code to use context manager for updating ml2_vlan_allocations db when
arista_vlan type driver is in use. This also makes the code compatible with
SQLAlchemy version 2.0 where Session.autocommit is removed

Change-Id: I75b760a27d7aef29591c0efc03542d37a30afd70
2022-12-14 21:40:44 -08:00
Zuul e04620b729 Merge "Revert "Check for missing port bindings each sync period"" 2022-10-21 00:58:28 +00:00
Mitchell Jameson 8c882aadd8 Revert "Check for missing port bindings each sync period"
This reverts commit 14640a366c.

Reason for revert: This causes issues for HA deployments as it may cause port bindings to be synced before dependent ports, vms, networks, etc.. Rather than working around the upstream issue, I think we need to try to fix it (or treat it as a known limitation that requires re-creating DVR ports as a workaround.)

Change-Id: I903133a0365ddee9b309962c26c06ac6ba0abb68
2022-10-13 20:53:38 +00:00
Zuul 720b4dcf74 Merge "Ensure queries are executed in reader sessions" 2022-07-26 20:24:48 +00:00
Mitchell Jameson 5fd0d90df4 Ensure queries are executed in reader sessions
Change-Id: I8d233e3b6025e4580fc3291cdffe4af19fd14305
2022-07-26 12:38:16 -07:00
Mitchell Jameson 76b2378f6b Don't send sync complete on sync failure after switchover
Change-Id: Ib3792f9d3c18dd828000ca4721594c5c3885800a
2022-07-01 22:59:54 -07:00
Mitchell Jameson 03a525f9b0 Don't use router_interface fixed_ip for MLAG peer SVI IPs
When selecting IPs for MLAG peers SVIs, we typically choose
the top two IPs in the subnet (eg. .254 and .253 in a /24).
However, this may collide with the fixed_ip for the router,
which will cause EOS to reject the router create on one of
the peers as the VARP IP cannot be the same as the SVI IP.

The fix prosed here is to use the third highest IP in the
subnet if the fixed_ip is one of the two highest IPs in the
subnet.

Change-Id: I6a320a31b55edc947d288c9ad030bc476ae6ee9f
2022-05-03 17:09:15 -07:00
Mitchell Jameson 8a02945f61 Start running jobs against newer python versions
Notable changes:
 - bump hacking to make it py38+ compatible
    - (with changes to pass against the newer pep8 rules)
 - ensure requests get monkey-patched to avoid exceeding
   maximum recursion depth in SSL
 - start running openstack-python3-yoga-jobs-neutron

Change-Id: I84be86737b493dfc811a772bbeabefd10e645206
2022-03-03 22:14:20 -08:00
Mitchell Jameson 113ac088ab Add connectivity property to MechanismDrivers
A recent change (https://review.opendev.org/c/openstack/neutron/+/826502)
now requires that L2 drivers specify their connectivity in a property
rather than in vif_details. This change updates the mech drivers
in networking-arista to follow that paradigm

Change-Id: I9c5805b9dfa3b21dbe422b7ba3e2babf700aec9a
2022-03-03 17:17:28 -08:00
Mitchell Jameson 8b1273a07a Make unit tests backwards compatible with the latest pyPI Neutron
It's difficult to ensure the Neutron master is installed in the test
env, so this change allows tests to run against a slightly older
Neutron that still looks for 'tenant_id' in the trunk dict.

Change-Id: I7de8939923bd60cc31097c3469e5bb2183f41262
Closes-Bug: 1954697
2021-12-14 12:32:10 -08:00
Mitchell Jameson 2766d4eea3 Fix unit tests and lower-constraints
- Fixup constraints, requirements and tox envs
- Update trunk-related tests to account for 8bad71ad36

Change-Id: I87000a819276b98203a4a27d3ae2918f5f459553
2021-11-01 14:10:09 -07:00
Mitchell Jameson f26e45b2b3 Use new callback payloads for PORT AFTER_UPDATE and AFTER_DELETE
Change-Id: I9b03cafafbca2a0d537d05842055bc08943ce8e8
2021-07-15 12:56:40 -07:00
Mitchell Jameson bf3aa1d3b1 Handle new payload format for SUBNETs, SG and SG_RULES
Change-Id: Id592f871a199913ecbe48f6704a34e16e644852a
2021-07-08 16:21:06 -07:00
Nader Lahouti e69c124471 Temporary fix to make code work with SQLAlchemy 1.4.18
The db_lib.py needs changes to be compatible with SQLAlchemy 2.0.
This patch is a temporary fix to avoid failure in the CI and make it
working

Change-Id: I30035658b369fb1e54a340d20b384d7d3b2e9971
2021-06-16 17:31:35 -07:00
Mitchell Jameson 155f93d1e5 Add support for specifying switch shortnames in physnets for HPB
Change-Id: I9a9d57ecfadc194024d3619928f3a816d12cba75
2021-06-01 09:32:13 -07:00
Mitchell Jameson 225765aca3 Fix L3 plugin to handle new payload format
A recent to the way neutron sends network info in callbacks
(4aa5de254d)
partially breaks the Arista L3 plugin.

This change moves over to the new format.

Change-Id: I553f8911a79d2b3ad8fdb03c9ceb9f9ff2acb6b0
2021-05-28 01:44:15 +00:00
Mitchell Jameson 3230e30dee Fix arista_trunk plugin to handle new payload format
A recent to the way neutron sends trunk/subport payloads
(0f3e04b00f)
breaks the arista_trunk service plugin.

This change adopts the new format.

Change-Id: Id0c46a2fc63eea0a6e80d6052649dedcebf4b041
2021-05-27 18:29:02 -07:00
Mitchell Jameson 1327851e5a Add test coverage for managed_physnets without HPB
Change-Id: I15ff2a95632f6066310023ce204e59946b292815
2021-05-06 13:18:49 -07:00
Mitchell Jameson 02e953f96c Fix handling of FQDN in port binding delete
When a port binding resource update comes in from the provisioning
queue, its host will always be the FQDN (if Neutron/Nova have been
configured to use FQDN hostnames.) If use_fqdn is false, we already
use the short host name on create and in tracking existing neutron
and CVX resources, but on delete, we're correctly querying the DB
with the FQDN, but then continuing to use the FQDN in forcing the
CVX update and generating the data for the HTTP DELETE call.

The proposed fix is to override the force_resource_update and
_delete_neutron_resource methods to correct the hostname in those
calls if necessary.

Change-Id: Ifaca6c22770991a6195f69dd245c865ebf978138
2021-04-29 22:25:21 -07:00
Mitchell Jameson 14640a366c Check for missing port bindings each sync period
When two DVR bindings go to ACTIVE simultaneously, one of the
updates will hit a stale data exception when commit to the DB.
This will ultimately result in update_port_postcommit not getting
called when the second binding's status goes to ACTIVE on retry.

To handle this, we now check for missing port bindings once per
sync period.

Change-Id: I8262bec98993fe80ca3482a47d283aeafea75101
2020-12-15 00:18:06 +00:00
Mitchell Jameson 32bbd0fb14 Revert "Bind DVR ports when DOWN to workaround upstream issue"
This reverts commit 7da640b4ed.

Reason for revert: Breaks sync when DVR ports are DOWN while DVR port bindings exist

Change-Id: If6d5f67da7a19d4d5e0469023e24e060afa2c2d3
2020-12-14 23:25:49 +00:00
Mitchell Jameson 7da640b4ed Bind DVR ports when DOWN to workaround upstream issue
When two DVR bindings go to ACTIVE simultaneously, one of the
updates will hit a stale data exception when commit to the DB.
This will ultimately result in update_port_postcommit not getting
called when the second binding's status goes to ACTIVE on retry.

In order to workaround this issue, we now bind DVR ports even
in a DOWN state.

Change-Id: I4811c8ce398a5a95a446c68ed81af550f6ea394f
(cherry picked from commit f2e081e7fa)
2020-12-04 21:48:30 +00:00
Mitchell Jameson 6697901bdd Fix security_group unit tests
Change-Id: I913e8299a75c3735038aaaf66d60389221520db2
2020-12-04 11:56:41 -08:00
Mitchell Jameson a778bf9056 Don't call get_session in vlan type driver
In stein the get_session function was removed from the
upstream type driver helper. This change replaces that
with calls to neutron-lib's db_api.

This also re-enables the type driver unit tests which have
been disabled for a while (missing __init__.py) and adds
coverage for a upstream test cases for the upstream VLAN
type driver against the Arista VLAN type driver.

Change-Id: I5b52abafadf236278ca707c89b69883501992219
2020-11-05 00:09:18 -08:00
Mitchell Jameson f8a5a585f1 Try re-importing any deleted multiprocessing modules
This is just a patch of the remaining diff for bug 1889396 between
stable branches and master to keep them inline.

Change-Id: Icf4121c2a3a05912ce2a4ac2c9cf441d6609ae24
2020-09-02 11:38:45 -07:00
Zuul 2dbf103749 Merge "Fix AttributeError on select.poll()" 2020-08-28 21:17:27 +00:00
Aurelien Lourot c859952ee3 Fix AttributeError on select.poll()
Change-Id: Iefcae89cdedd13535c3135ca7227362f1cf9abc8
Closes-Bug: #1889396
2020-08-17 17:20:04 +02:00
Mitchell Jameson 58eadd002e Encode special characters in CVX username and password
Change-Id: I2f147ab44e7124675dd31a1a5b780ac00f51dc54
2020-08-12 16:28:32 -07:00
Mitchell Jameson c35fef5129 Reduce info level logging output
This change reduces info level logging such that it only produces
logs when CVX state needs to be updated. Internal accounting has
been changed to DEBUG level.

Network create before change at INFO level:

31521 Arista Sync time 1590625762.4879267 last sync 1590625762.2405837 timeout 0.7526607513427734
31521 Processing create network ID: e7af8f41-89ef-4a9c-b0bf-619056e5112f
31521 create network with id e7af8f41-89ef-4a9c-b0bf-619056e5112f
31521 Requesting create Networks resource e7af8f41-89ef-4a9c-b0bf-619056e5112f
31521 Resource Networks e7af8f41-89ef-4a9c-b0bf-619056e5112f found, creating
31521 Networks resource e7af8f41-89ef-4a9c-b0bf-619056e5112f added locally
31521 create requisite tenant with id tid
31521 Requesting create Tenants resource tid
31521 Resource Tenants tid found, creating
31521 Tenants resource tid added locally
31521 Tenants resource tid requires update
31521 create requisite segment with id 253f985d-4708-4980-a298-e99489cb6a74
31521 Requesting create Segments resource 253f985d-4708-4980-a298-e99489cb6a74
31521 Resource Segments 253f985d-4708-4980-a298-e99489cb6a74 found, creating
31521 Segments resource 253f985d-4708-4980-a298-e99489cb6a74 added locally
31521 Getting PortBindings from CVX
31521 No PortBindings resources to delete
31521 Getting BaremetalPorts from CVX
31521 No BaremetalPorts resources to delete
31521 Getting VmPorts from CVX
31521 No VmPorts resources to delete
31521 Getting RouterPorts from CVX
31521 No RouterPorts resources to delete
31521 Getting DhcpPorts from CVX
31521 No DhcpPorts resources to delete
31521 Getting Baremetals from CVX
31521 No Baremetals resources to delete
31521 Getting Vms from CVX
31521 No Vms resources to delete
31521 Getting Routers from CVX
31521 No Routers resources to delete
31521 Getting Dhcps from CVX
31521 No Dhcps resources to delete
31521 Getting Segments from CVX
31521 No Segments resources to delete
31521 Getting Networks from CVX
31521 No Networks resources to delete
31521 Getting Tenants from CVX
31521 No Tenants resources to delete
31521 Getting Tenants from CVX
31521 Getting Tenants from neutron
31521 Creating Tenants resources with ids tid on CVX
31521 Tenants resources with ids tid created on CVX
31521 Getting Networks from CVX
31521 Getting Networks from neutron
31521 Creating Networks resources with ids e7af8f41-89ef-4a9c-b0bf-619056e5112f on CVX
31521 Networks resources with ids e7af8f41-89ef-4a9c-b0bf-619056e5112f created on CVX
31521 Getting Segments from CVX
31521 Getting Segments from neutron
31521 Creating Segments resources with ids 253f985d-4708-4980-a298-e99489cb6a74 on CVX
31521 Segments resources with ids 253f985d-4708-4980-a298-e99489cb6a74 created on CVX
31521 Getting Dhcps from CVX
31521 Getting Dhcps from neutron
31521 No Dhcps resources to create
31521 Getting Routers from CVX
31521 Getting Routers from neutron
31521 No Routers resources to create
31521 Getting Vms from CVX
31521 Getting Vms from neutron
31521 No Vms resources to create
31521 Getting Baremetals from CVX
31521 Getting Baremetals from neutron
31521 No Baremetals resources to create
31521 Getting DhcpPorts from CVX
31521 Getting DhcpPorts from neutron
31521 No DhcpPorts resources to create
31521 Getting RouterPorts from CVX
31521 Getting RouterPorts from neutron
31521 No RouterPorts resources to create
31521 Getting VmPorts from CVX
31521 Getting VmPorts from neutron
31521 No VmPorts resources to create
31521 Getting BaremetalPorts from CVX
31521 Getting BaremetalPorts from neutron
31521 No BaremetalPorts resources to create
31521 Getting PortBindings from CVX
31521 Getting PortBindings from neutron
31521 No PortBindings resources to create

After:

32632 Arista Sync time 1590625370.1938148 last sync 1590625369.7015142 timeout 0.5077025890350342
32632 Processing create network ID: db232697-ba88-43c0-85e2-7957cf675aca
32632 Creating Tenants resources with ids tid on CVX
32632 Tenants resources with ids tid created on CVX
32632 Creating Networks resources with ids db232697-ba88-43c0-85e2-7957cf675aca on CVX
32632 Networks resources with ids db232697-ba88-43c0-85e2-7957cf675aca created on CVX
32632 Creating Segments resources with ids 978ae7ed-718f-4d43-8c4c-f227656278fa on CVX
32632 Segments resources with ids 978ae7ed-718f-4d43-8c4c-f227656278fa created on CVX

Change-Id: I77c569870f9c1a09e4d4956c87943ebd77d7a62f
2020-05-28 00:43:12 +00:00
Mitchell Jameson 7ac2b9585e Fix handling of ERROR ports and '' device_id
This change contains two fixes:
1. When a port goes to ERROR state, treat it as a delete
2. When a device_id is '', don't query for all instances

Change-Id: I587fef123e0552cc3bd2fe3fb74cfcb2dbb23c8b
2020-05-15 15:03:41 -07:00
Alin Iorga 5843ba4cc6 Test routes are not deleted on sync
This test adds support to store defined routes in unit tests and to
validate that no routes are recreated during sync operation

Change-Id: If2bc4b7334f472d83b307fecc6aad5b20f6b86af
2020-04-14 08:56:34 -07:00
Alin Iorga 382e8a9266 Remove delete_default_gateway from create_router
This change removes the delete_default_gateway function from
create_router call path and updates the synchronize function to update
proper VRF default gateways only when needed.

Change-Id: I874b3f15f39e914282d7b92a07af9024c39e916f
2020-04-04 09:32:44 -07:00
Alin Iorga 4b002ee6bb Use show version to validate vrf support
Updated the code to use show version to check which vrf creation command
the switch supports. This will eliminate extra entries in syslog

Change-Id: Id3c3e42d2fc7165e5ea3c20bec3343c559f6465f
2020-02-21 10:32:36 -08:00
Mitchell Jameson 1dce57fa75 Use an interprocess lock for physnets
bind_port gets called in the API worker, of which there may be
multiple processes. This change passes external=True to ensure
we use an interprocess lock.

Change-Id: Ia4a94f00ef94faf8d4b6892550d32a6540c8e989
2020-02-12 11:30:37 -08:00
Alin Iorga b6d6c44428 Prevent recursive check for vrf supported commands
On switches that do not support vrf instance command, if the command
fails it will try again to check which commands are supported and will
generate a loop. This will prevent the L3 plugin to check for vrf
supported commands while it is checking what command are supported

Change-Id: If441bbf2c5d3863282aaede55f7f6f130c67844e
2020-02-06 16:38:59 -08:00
Zuul 61aef1b0ff Merge "Wrap L3 synchronize function in try catch" 2020-01-31 00:36:56 +00:00
Alin Iorga 9b721aa315 Synchronize requirements with neutron
This commit is removing support fro python2 in networking-arista and
synchrinizing the package requirements with neutron. Because of this
some code changes have been performed in order for the pep8 test to pass

Change-Id: I829d7eec72cb22d1142782894b9833769f432a66
2020-01-30 15:10:14 -08:00
Alin Iorga bcaa26f6a6 Wrap L3 synchronize function in try catch
When an exception happens in synchronize thread, it will die and not
recover. Wrapping in try/catch to protect against any error. Also added
some logging to know step in processing

Change-Id: Ic0c9016daebd547ffa23408444c43849b953d98b
2020-01-28 23:37:11 +00:00
Nader Lahouti ccde7a48be Added missing format character
Change-Id: I09ba010a998179ea1534f1d6fbb4b79cedcf3ab7
2020-01-14 09:25:58 -08:00
Alin Iorga 06d6342a44 Add option to create default route to router VRFs
This change adds the option to create default route for routers that
have a default gateway defined. This is controled by setting
vrf_default_route option in the configution

Change-Id: I16ae7feacb04730111a4b5eb61d2c3ae0fb3f041
2020-01-06 17:23:13 +00:00
Alin Iorga 19642cd335 Update L3 plugin to handle new syntax for deprecated vrf forwarding
Change-Id: I30e77ea2f8b4fa29ce309cb075e6ed780af6d7bc
2019-12-02 23:27:03 +00:00
Alin Iorga 5db5ff746f Update L3 plugin to handle switches that support vrf instance
L3 plugin will be able to handle both swtiches that support only the
newer syntax with vrf instance and the old vrf definition syntax.

Change-Id: I2e9b88c4e6d18eb3880f44532c93cc8cb9b2f2f4
2019-11-26 18:38:58 +00:00
Alin Iorga 4077e846d8 Update create_network test wrapper to set mtu as 1450 if does not exist.
Change-Id: I3b80697173b133e0c6924c6b22b28cfae28ddc77
2019-11-08 15:24:54 -08:00
Mitchell Jameson 84a118e718 Improve performance of sync under heavy load
This change includes 3 fixes:
1. Sync workers sleep for [0,1) seconds after every sync
2. Dependent resources are always synced in the same sync cycle
3. Sync lock is released on failure if at least one successful sync has occurred

Change-Id: I1ab75dcce69b68acf63c24d31a3e106ecc506fb3
2019-09-19 23:41:12 -07:00
Mitchell Jameson 9c1cfc27a5 Declare that the arista plugin provides L2 connectivity
This allows the arista mech driver to bind ports without
a fixed IP (see https://review.opendev.org/#/c/678027/)

Change-Id: I0f0859da7311a22f878fa673ca67898d7e154313
2019-09-19 16:47:18 -07:00
Nader Lahouti d7d6ffa96e Get next segment from NetworkSegment DB
Query one more time from NetworkSegment for a dynamic segment added
to the table instead of relying on what reserve_provider_segment returns

Change-Id: Iee958314366b9651f79544d80a7a55cf09c73a28
2019-06-28 18:30:42 -07:00
Nader Lahouti e100142df3 Removed creation of INTERNAL-TENANT-ID
With previous patch the INTERNAL-TENANT-ID was used, instead of blank project_id,
for creating L3 HA network on CVX. This patch removes the use of
INTERNAL-TENANT-ID and instead it uses the project_id from HA router for
creating network, or port resources on CVX.

Change-Id: I632ce29f934d2e3cc96032e2baeee7e96f20d8f3
2019-06-14 12:56:52 -07:00
Zuul b483967a8c Merge "Create network when project_id is an empty string" 2019-06-06 23:19:14 +00:00
Nader Lahouti 094b199a71 Create network when project_id is an empty string
If L3 HA is enabled in neutron, by creating a router, a HA network with
no project_id is created. With this patch Arista ML2 driver uses an internal
project_id, i.e. 'INTERNAL-TENANT-ID', to set the project_id of the network when
creating it on the CVX.

Change-Id: Ifb9ce0a4594706945cef47321d902aa07a5944dd
2019-06-06 15:37:38 -07:00