bbe1347e4e
To work around the ZMQ issues (publisher binds to a port, thus only one publisher can work on a given IP), we had a lot of junk code in our repo. Removed all redundant mechanisms (use_multiproc, is_neutron_server) and modified to have 2 types of configurable ZMQ drivers: 1. zmq_remote_pubsub_driver - Has TCP publisher and IPC subscriber, This should be used in the publisher service. 2. zmq_pubsub_driver - Has IPC publisher and TCP subscriberi, This should be used in all other uses. The way to set the one to use is via configuration, thus it is up to the deployment to make sure this is configured correctly. Change-Id: Ibf7894e608187e87bdeb7774749bfa0cc15eae56
6.0 KiB
6.0 KiB
Dragonflow Manual Deployment
Dragonflow mainly has several components:
- Dragonflow neutron plugins (set up in neutron-server configuration)
- Dragonflow local controller running on each compute node
- Dragonflow metadata service running on each compute node
- Dragonflow publisher service running aside neutron server (if zeromq pub/sub driver is enabled)
- Dragonflow l3 agent running on each network node
- Dragonflow northbound database (depends on which database you set up in dragonflow configuration)
Source Code
https://github.com/openstack/dragonflow
Dependencies
- Open vSwitch 2.5+
- Northbound Database (Etcd or Zookeeper or Redis)
Basic Configurations
- Generate the plugin configuration
bash tools/generate_config_file_samples.sh
cp etc/dragonflow.ini.sample /etc/neutron/dragonflow.ini
- Modify the configuration
/etc/neutron/neutron.conf
[DEFAULT]
metadata_proxy_shared_secret = secret
dhcp_agent_notification = False
notify_nova_on_port_data_changes = True
notify_nova_on_port_status_changes = True
allow_overlapping_ips = True
service_plugins = df-l3,qos
core_plugin = neutron_lib.plugins.ml2.plugin.Ml2Plugin
/etc/neutron/plugins/ml2/ml2_conf.ini
[ml2]
tenant_network_types = geneve
extension_drivers = port_security,qos
mechanism_drivers = df
[ml2_type_flat]
flat_networks = *
[ml2_type_geneve]
vni_ranges = 1:10000
/etc/nova/nova.conf
[neutron]
service_metadata_proxy = True
metadata_proxy_shared_secret = secret
/etc/neutron/dragonflow.ini
[df]
metadata_interface = tap-metadata
enable_selective_topology_distribution = True
apps_list = l2,l3_proactive,dhcp,dnat,sg,portsec,portqos
integration_bridge = br-int
tunnel_type = geneve
[df_dnat_app]
ex_peer_patch_port = patch-int
int_peer_patch_port = patch-ex
external_network_bridge = br-ex
[df_l2_app]
l2_responder = True
[df_metadata]
port = 18080
ip = 169.254.169.254
Northbound Database
Dragonflow supports etcd, redis, zookeeper and ramcloud. You need to deploy one of them in your environment and expose the necessary TCP port.
Next you need to change the configuration, for example, etcd:
/etc/neutron/dragonflow.ini:
[df]
nb_db_class = etcd_nb_db_driver
remote_db_hosts = [{etcd_ip}:{etcd_port}]
Pub/Sub Driver
Dragonflow supports etcd, redis and zeromq. You need to change the configuration, for example, etcd:
/etc/neutron/dragonflow.ini:
[df]
enable_df_pub_sub = True
pub_sub_driver = etcd_pubsub_driver
publisher_rate_limit_count = 1
publisher_rate_limit_timeout = 180
monitor_table_poll_time = 30
Dragonflow Plugin (on neutron-server node)
Installation
- Install dragonflow dependencies: pip install -r requirements.txt
- Install dragonflow: python setup.py install
Service Start
neutron-server is the only service for this part.
Dragonflow Publisher Service (on neutron-server node)
Installation
mkdir -p /var/run/zmq_pubsub
chown -R neutron:neutron /var/run/zmq_pubsub
Service Start
python /usr/local/bin/df-publisher-service --config-file /etc/neutron/neutron.conf --config-file /etc/neutron/dragonflow.ini
Dragonflow local controller (on compute node)
Installation
Install dragonflow dependencies: pip install -r requirements.txt
Install dragonflow: python setup.py install
Initialize ZeroMQ: :
mkdir -p /var/run/zmq_pubsub chown -R neutron:neutron /var/run/zmq_pubsub
Initialize OVS: :
ovs-vsctl add-br br-ex ovs-vsctl add-port br-ex {external_nic} ovs-vsctl add-br br-int ovs-vsctl add-port br-int {internal_nic} ovs-vsctl --no-wait set bridge br-int fail-mode=secure other-config:disable-in-band=true ovs-vsctl set bridge br-int protocols=OpenFlow10,OpenFlow13 ovs-vsctl set-manager ptcp:6640:0.0.0.0
Configuration
/etc/neutron/dragonflow.ini:
[df]
local_ip = {compute_node_ip}
Service Start
python /usr/local/bin/df-local-controller --config-file /etc/neutron/neutron.conf --config-file /etc/neutron/dragonflow.ini
Dragonflow Metadata Service (on compute node)
Service Start
python /usr/local/bin/df-metadata-service --config-file /etc/neutron/neutron.conf --config-file /etc/neutron/dragonflow.ini
Dragonflow L3 Service (on network node)
Installation
- Install dragonflow dependencies: pip install -r requirements.txt
- Install dragonflow: python setup.py install
Configuration
/etc/neutron/l3_agent.ini:
[DEFAULT]
external_network_bridge =
interface_driver = openvswitch
ovs_use_veth = False
Service Start
python /usr/local/bin/df-l3-agent --config-file /etc/neutron/neutron.conf --config-file /etc/neutron/l3_agent.ini --config-file /etc/neutron/dragonflow.ini