diff --git a/doc/source/test_plans/tenant_networking/plan.rst b/doc/source/test_plans/tenant_networking/plan.rst index e7e9c21..eb327c3 100644 --- a/doc/source/test_plans/tenant_networking/plan.rst +++ b/doc/source/test_plans/tenant_networking/plan.rst @@ -105,16 +105,43 @@ This section describes installed software. | virtual routers | | e.g. legacy or HA or DVR | +-----------------+-------+---------------------------+ +.. _openstack_tenant_networking_test_plan_l2_dense: + +Test Case 1: single node L2 instance-to-instance performance +------------------------------------------------------------ + +Description +^^^^^^^^^^^ + +This test case is executed on a single pair of instances launched on *one +compute node* and plugged into the same tenant network. The measurement is +done during 60 seconds, average values are calculated. + +List of performance metrics +^^^^^^^^^^^^^^^^^^^^^^^^^^^ + +======== ================ ================= =========================================== +Priority Value Measurement Units Description +======== ================ ================= =========================================== +1 Latency ms The network latency +1 TCP bandwidth Mbits/s TCP network bandwidth +1 UDP bandwidth packets per sec Number of UDP packets with 32 bytes payload +2 UDP delay jitter ms Packet delay variation +2 UDP packet loss % Percentage of lost UDP packets +2 TCP retransmits packets per sec Number of retransmitted TCP packets +======== ================ ================= =========================================== + + .. _openstack_tenant_networking_test_plan_l2: -Test Case 1: L2 instance-to-instance performance +Test Case 2: L2 instance-to-instance performance ------------------------------------------------ Description ^^^^^^^^^^^ -This test case is executed on a single pair of instances launched on different -compute nodes and plugged into the same tenant network. The measurement is +This test case is executed on a single pair of instances launched on *different +compute nodes* and plugged into the same tenant network. The measurement is done during 60 seconds, average values are calculated. List of performance metrics @@ -134,7 +161,7 @@ Priority Value Measurement Units Description .. _openstack_tenant_networking_test_plan_l2_concurrent: -Test Case 2: L2 concurrent performance +Test Case 3: L2 concurrent performance -------------------------------------- Description @@ -166,16 +193,44 @@ Priority Value Measurement Units Description ======== ================ ================= =========================================== +.. _openstack_tenant_networking_test_plan_l3_east_west_dense: + +Test Case 4: single node L3 east-west instance-to-instance performance +---------------------------------------------------------------------- + +Description +^^^^^^^^^^^ + +This test case is executed on a single pair of instances launched on *one +compute node* and plugged into different tenant networks. Networks are +connected by a single router. The measurement is done during 60 seconds, +average values are calculated. + +List of performance metrics +^^^^^^^^^^^^^^^^^^^^^^^^^^^ + +======== ================ ================= =========================================== +Priority Value Measurement Units Description +======== ================ ================= =========================================== +1 Latency ms The network latency +1 TCP bandwidth Mbits/s TCP network bandwidth +1 UDP bandwidth packets per sec Number of UDP packets with 32 bytes payload +2 UDP delay jitter ms Packet delay variation +2 UDP packet loss % Percentage of lost UDP packets +2 TCP retransmits packets per sec Number of retransmitted TCP packets +======== ================ ================= =========================================== + + .. _openstack_tenant_networking_test_plan_l3_east_west: -Test Case 3: L3 east-west instance-to-instance performance +Test Case 5: L3 east-west instance-to-instance performance ---------------------------------------------------------- Description ^^^^^^^^^^^ -This test case is executed on a single pair of instances launched on different -compute nodes and plugged into different tenant networks. Networks are +This test case is executed on a single pair of instances launched on *different +compute nodes* and plugged into different tenant networks. Networks are connected by a single router. The measurement is done during 60 seconds, average values are calculated. @@ -196,7 +251,7 @@ Priority Value Measurement Units Description .. _openstack_tenant_networking_test_plan_l3_east_west_concurrent: -Test Case 4: L3 east-west concurrent performance +Test Case 6: L3 east-west concurrent performance ------------------------------------------------ Description @@ -230,16 +285,45 @@ Priority Value Measurement Units Description ======== ================ ================= =========================================== +.. _openstack_tenant_networking_test_plan_l3_north_south_dense: + +Test Case 7: single node L3 north-south instance-to-instance performance +------------------------------------------------------------------------ + +Description +^^^^^^^^^^^ + +This test case is executed on a single pair of instances launched on *one +compute node* and plugged into different tenant networks. Each networks is +connected to own router, thus traffic goes via external network. The +destination instance is reached by floating IP. +The measurement is done during 60 seconds, average values are calculated. + +List of performance metrics +^^^^^^^^^^^^^^^^^^^^^^^^^^^ + +======== ================ ================= =========================================== +Priority Value Measurement Units Description +======== ================ ================= =========================================== +1 Latency ms The network latency +1 TCP bandwidth Mbits/s TCP network bandwidth +1 UDP bandwidth packets per sec Number of UDP packets with 32 bytes payload +2 UDP delay jitter ms Packet delay variation +2 UDP packet loss % Percentage of lost UDP packets +2 TCP retransmits packets per sec Number of retransmitted TCP packets +======== ================ ================= =========================================== + + .. _openstack_tenant_networking_test_plan_l3_north_south: -Test Case 5: L3 north-south instance-to-instance performance +Test Case 8: L3 north-south instance-to-instance performance ------------------------------------------------------------ Description ^^^^^^^^^^^ -This test case is executed on a single pair of instances launched on different -compute nodes and plugged into different tenant networks. Each networks is +This test case is executed on a single pair of instances launched on *different +compute nodes* and plugged into different tenant networks. Each networks is connected to own router, thus traffic goes via external network. The destination instance is reached by floating IP. The measurement is done during 60 seconds, average values are calculated. @@ -261,7 +345,7 @@ Priority Value Measurement Units Description .. _openstack_tenant_networking_test_plan_l3_north_south_concurrent: -Test Case 6: L3 north-south concurrent performance +Test Case 9: L3 north-south concurrent performance -------------------------------------------------- Description @@ -298,8 +382,8 @@ Priority Value Measurement Units Description .. _openstack_tenant_networking_test_plan_qos: -Test Case 7: Neutron QoS testing --------------------------------- +Test Case 10: Neutron QoS testing +--------------------------------- Description ^^^^^^^^^^^ diff --git a/doc/source/test_results/tenant_networking/neutron_vxlan_dvr_200/index.rst b/doc/source/test_results/tenant_networking/neutron_vxlan_dvr_200/index.rst index fa1b3c4..fee40d1 100644 --- a/doc/source/test_results/tenant_networking/neutron_vxlan_dvr_200/index.rst +++ b/doc/source/test_results/tenant_networking/neutron_vxlan_dvr_200/index.rst @@ -38,8 +38,10 @@ Reports .. toctree:: :maxdepth: 2 + perf_l2_dense/index perf_l2/index full_l2/index + perf_l3_east_west_dense/index perf_l3_east_west/index full_l3_east_west/index perf_l3_north_south/index diff --git a/doc/source/test_results/tenant_networking/neutron_vxlan_dvr_200/perf_l2/index.rst b/doc/source/test_results/tenant_networking/neutron_vxlan_dvr_200/perf_l2/index.rst index de0bfff..1d3c13b 100644 --- a/doc/source/test_results/tenant_networking/neutron_vxlan_dvr_200/perf_l2/index.rst +++ b/doc/source/test_results/tenant_networking/neutron_vxlan_dvr_200/perf_l2/index.rst @@ -62,7 +62,7 @@ Ping **Stats**: ============= ======== ======== ======== -Metric Min Avg Max +Metric Min Avg Max ============= ======== ======== ======== ping_icmp, ms 0.27 0.56 1.55 ============= ======== ======== ======== @@ -70,7 +70,7 @@ ping_icmp, ms 0.27 0.56 1.55 **SLA**: ========================= =========== ================== ======== -Expression Concurrency Node Result +Expression Concurrency Node Result ========================= =========== ================== ======== stats.ping_icmp.avg < 2.0 1 node-25.domain.tld OK ========================= =========== ================== ======== @@ -94,7 +94,7 @@ TCP **Stats**: ================= ======== ======== ======== -Metric Min Avg Max +Metric Min Avg Max ================= ======== ======== ======== bandwidth, Mbit/s 5559.96 6875.94 7930.98 retransmits 26 @@ -103,7 +103,7 @@ retransmits 26 **SLA**: ========================== =========== ================== ======== -Expression Concurrency Node Result +Expression Concurrency Node Result ========================== =========== ================== ======== stats.bandwidth.avg > 5000 1 node-25.domain.tld OK stats.retransmits.max < 10 1 node-25.domain.tld FAIL @@ -129,16 +129,18 @@ UDP **Stats**: -============ ======== ======== ======== -Metric Min Avg Max -============ ======== ======== ======== -packets, pps 184290 206668 223370 -============ ======== ======== ======== +============ ========= ========= ========= +Metric Min Avg Max +============ ========= ========= ========= +loss, % 0.019 +jitter, ms 0.003 +packets, pps 184290 206668 223370 +============ ========= ========= ========= **SLA**: ========================== =========== ================== ======== -Expression Concurrency Node Result +Expression Concurrency Node Result ========================== =========== ================== ======== stats.packets.avg > 100000 1 node-25.domain.tld OK ========================== =========== ================== ======== diff --git a/doc/source/test_results/tenant_networking/neutron_vxlan_dvr_200/perf_l2_dense/23d521f3-d5eb-444a-9dc2-d05ee6e9461d.svg b/doc/source/test_results/tenant_networking/neutron_vxlan_dvr_200/perf_l2_dense/23d521f3-d5eb-444a-9dc2-d05ee6e9461d.svg new file mode 100644 index 0000000..f1d280a --- /dev/null +++ b/doc/source/test_results/tenant_networking/neutron_vxlan_dvr_200/perf_l2_dense/23d521f3-d5eb-444a-9dc2-d05ee6e9461d.svg @@ -0,0 +1,4 @@ + +Pygal000.10.10.20.20.30.30.40.40.50.50.60.6time, s0.66614.07692307699.807692307690.209080591892.2820512821346.2435004920.292041123170.487179487285.1585632670.3389584408248.692307692250.6127211580.288920885326.897435897287.4560358290.2011097834405.102564103352.1125122290.3299471971483.307692308257.2478192010.2800556204561.512820513293.9836474660.3668631712639.717948718230.0660988050.2000741049717.923076923352.875096005ping_icmp, ms \ No newline at end of file diff --git a/doc/source/test_results/tenant_networking/neutron_vxlan_dvr_200/perf_l2_dense/4f806542-e1fc-4d45-a23f-9c10e77270b3.svg b/doc/source/test_results/tenant_networking/neutron_vxlan_dvr_200/perf_l2_dense/4f806542-e1fc-4d45-a23f-9c10e77270b3.svg new file mode 100644 index 0000000..af14836 --- /dev/null +++ b/doc/source/test_results/tenant_networking/neutron_vxlan_dvr_200/perf_l2_dense/4f806542-e1fc-4d45-a23f-9c10e77270b3.svg @@ -0,0 +1,4 @@ + +Pygal002000020000400004000060000600008000080000100000100000120000120000140000140000160000160000time, s17943013.73076923089.8076923076917847025.367014341612.431385284217801037.003259452413.688571502116207048.639504563257.252806965616479060.275749674149.81901019916175071.911994784958.127371291117367083.548239895725.549850166616705095.184485006543.6423996502166190106.82073011745.9927912749167030118.45697522843.6970599205177910130.09322033913.9618728538161670141.7294654558.3460123725163020153.36571056154.6564441243162720165.00195567155.4763481795162720176.63820078255.4763481795161630188.27444589358.4553329132164180199.91069100451.4861484444168520211.54693611539.6248697799175520223.18318122620.4937751598166800234.81942633644.3256530295165140246.45567144748.862455468164480258.09191655850.6662443893165330269.72816166948.3431828997166070281.3644067846.320752897164470293.0006518950.6935745245163720304.63689700152.7433346623170710316.27314211233.6395701774165420327.90938722348.0972116832161920339.54563233457.6627589932165340351.18187744548.3158527645166820362.81812255544.2709927591164500374.45436766650.6115841189163930386.09061277752.1694018237165720397.72685788847.277307628171110409.36310299932.5463647705172590420.9993481128.5015047651171930432.6355932230.3052936864170900444.27183833133.1202976091169570455.90808344236.7552055869170200467.54432855335.0334070711167850479.18057366441.4559888364169290490.81681877437.5204493717166300502.45306388545.692159788166360514.08930899645.528178977162830525.72555410755.1757166926165570537.36179921847.6872596556163300548.99804432953.8912003395161250560.63428943959.4938780497160720572.2705345560.9423752138161410583.90677966159.056595887160990595.54302477260.2044615642163130607.17926988354.3558126375164110618.81551499351.6774593906166710630.45176010444.571624246165010642.08800521549.2177472252167520653.72425032642.3578832971164550665.36049543750.4749334431166180676.99674054846.0201214101169130688.63298565837.9577315345169630700.26923076936.5912247759packets, pps \ No newline at end of file diff --git a/doc/source/test_results/tenant_networking/neutron_vxlan_dvr_200/perf_l2_dense/94599950-242d-4c96-8c5b-cd725edf1970.svg b/doc/source/test_results/tenant_networking/neutron_vxlan_dvr_200/perf_l2_dense/94599950-242d-4c96-8c5b-cd725edf1970.svg new file mode 100644 index 0000000..c299227 --- /dev/null +++ b/doc/source/test_results/tenant_networking/neutron_vxlan_dvr_200/perf_l2_dense/94599950-242d-4c96-8c5b-cd725edf1970.svg @@ -0,0 +1,4 @@ + +Pygal00200020004000400060006000800080001000010000120001200014000140001600016000180001800020000200002200022000240002400000.083333333330.16666666670.250.33333333330.41666666670.50.58333333330.66666666670.750.83333333330.91666666671time, s18081.188212.1538461538114.99244702617670.8221422.4537157757122.26573218919190.0253332.753585397795.339533573418577.6710543.0534550196106.19283685720129.489953.353324641578.68856166118142.0326263.6531942634113.91404685620400.5241473.953063885373.884779083119516.7541584.252933507289.548626074514378.9291494.5528031291180.61090003714194.39316104.852672751183.88159647914189.14795115.152542373183.97456201114109.99298125.452411995185.37749640213948.72665135.752281617188.23576393914131.35529146.052151239184.99887314514330.29175156.35202086181.47294406116008.75854166.651890482151.72397383918691.06293176.951760104104.18309108517310187.251629726128.6609061816471.00449197.551499348143.53117505121803.8559207.8513689749.012273582114183.04443218.151238592184.08274008516820.52612228.451108214137.33629005918999.38583238.75097783698.71840808917190.07492249.050847458130.78644576219079.97131259.3507170897.290119461922691.44058269.65058670133.280815294823013.4964279.95045632327.572731633419039.82162290.25032594598.001728351813602.63824300.550195567194.36979876513418.0069310.850065189197.64218548913302.42157321.149934811199.69080775713420.00961331.449804433197.60668955913230.03769341.749674055200.97373209813009.92966352.049543677204.87490387513030362.349413299204.51917921117990.01694372.64928292116.60835714470.00504382.949152542178.99668034624087.42905393.2490221648.5384615384620840.7402403.54889178666.082435529413360.69107413.848761408198.65804521113260.36453424.14863103200.43622229513219.83337434.448500652201.15459231513419.81888444.748370274197.61007012419809.62753455.04823989684.357768827222800.82703465.34810951831.342061383113417.33932475.64797914197.65401746614012.7182485.947848761187.10158444914699.93591496.247718383174.92140948214920.13931506.547588005171.01854742314679.90875516.847457627175.27636878614879.89426527.147327249171.73184659514839.45847537.447196871172.44852633314580.63126547.747066493177.03595276314409.92355558.046936115180.06155825813140.01083568.346805737202.56935868213309.86023578.646675359199.5589657314790.1535588.94654498173.32240233322189.71252599.24641460242.173390995822381.40106609.54628422438.775923373914857.38754619.846153846172.130753242012.1538461538435.461538462022.4537157757435.461538462032.7535853977435.461538462043.0534550196435.461538462053.3533246415435.461538462063.6531942634435.461538462073.9530638853435.461538462084.2529335072435.461538462094.5528031291435.4615384620104.852672751435.4615384620115.152542373435.4615384620125.452411995435.4615384620135.752281617435.4615384620146.052151239435.4615384620156.35202086435.4615384620166.651890482435.4615384620176.951760104435.4615384620187.251629726435.4615384620197.551499348435.4615384620207.85136897435.4615384620218.151238592435.4615384620228.451108214435.4615384620238.750977836435.4615384620249.050847458435.4615384620259.35071708435.4615384620269.650586701435.4615384620279.950456323435.4615384620290.250325945435.4615384620300.550195567435.4615384620310.850065189435.4615384620321.149934811435.4615384620331.449804433435.4615384620341.749674055435.4615384620352.049543677435.4615384620362.349413299435.4615384620372.64928292435.4615384620382.949152542435.4615384620393.249022164435.4615384620403.548891786435.4615384620413.848761408435.4615384620424.14863103435.4615384620434.448500652435.4615384620444.748370274435.4615384620455.048239896435.4615384620465.348109518435.4615384620475.64797914435.4615384620485.947848761435.4615384620496.247718383435.4615384620506.547588005435.4615384620516.847457627435.4615384620527.147327249435.4615384620537.447196871435.4615384620547.747066493435.4615384620558.046936115435.4615384620568.346805737435.4615384620578.646675359435.4615384620588.94654498435.4615384620599.246414602435.4615384620609.546284224435.4615384620619.846153846435.461538462bandwidth, Mbit/sretransmits \ No newline at end of file diff --git a/doc/source/test_results/tenant_networking/neutron_vxlan_dvr_200/perf_l2_dense/index.rst b/doc/source/test_results/tenant_networking/neutron_vxlan_dvr_200/perf_l2_dense/index.rst new file mode 100644 index 0000000..54efb3d --- /dev/null +++ b/doc/source/test_results/tenant_networking/neutron_vxlan_dvr_200/perf_l2_dense/index.rst @@ -0,0 +1,146 @@ +.. _openstack_l2_performance_dense: + +OpenStack L2 Performance within single compute node +*************************************************** + +In this scenario Shaker launches 1 pair of instances in the same tenant +network. Both instances are hosted on the same compute node. The traffic goes +within the tenant network (L2 domain). + +**Scenario**: + +.. code-block:: yaml + + deployment: + accommodation: + - pair + - double_room + - compute_nodes: 1 + template: l2.hot + description: In this scenario Shaker launches 1 pair of instances in the same tenant + network. Both instances are hosted on the same compute node. The traffic goes within + the tenant network (L2 domain). + execution: + tests: + - class: flent + method: ping + sla: + - '[type == ''agent''] >> (stats.ping_icmp.avg < 2.0)' + time: 10 + title: Ping + - class: iperf3 + sla: + - '[type == ''agent''] >> (stats.bandwidth.avg > 5000)' + - '[type == ''agent''] >> (stats.retransmits.max < 10)' + title: TCP + - bandwidth: 0 + class: iperf3 + datagram_size: 32 + sla: + - '[type == ''agent''] >> (stats.packets.avg > 100000)' + title: UDP + udp: true + title: OpenStack L2 Performance + +Ping +==== + +**Test Specification**: + +.. code-block:: yaml + + class: flent + method: ping + sla: + - '[type == ''agent''] >> (stats.ping_icmp.avg < 2.0)' + time: 10 + title: Ping + +.. image:: 23d521f3-d5eb-444a-9dc2-d05ee6e9461d.* + +**Stats**: + +============= ========= ========= ========= +Metric Min Avg Max +============= ========= ========= ========= +ping_icmp, ms 0.200 0.317 0.666 +============= ========= ========= ========= + +**SLA**: + +========================= =========== ================== ========= +Expression Concurrency Node Result +========================= =========== ================== ========= +stats.ping_icmp.avg < 2.0 1 node-17.domain.tld OK +========================= =========== ================== ========= + +TCP +=== + +**Test Specification**: + +.. code-block:: yaml + + class: iperf3 + interval: 1 + sla: + - '[type == ''agent''] >> (stats.bandwidth.avg > 5000)' + - '[type == ''agent''] >> (stats.retransmits.max < 10)' + title: TCP + +.. image:: 94599950-242d-4c96-8c5b-cd725edf1970.* + +**Stats**: + +================= ========= ========= ========= +Metric Min Avg Max +================= ========= ========= ========= +bandwidth, Mbit/s 13009.930 16494.578 24087.429 +retransmits +================= ========= ========= ========= + +**SLA**: + +========================== =========== ================== ========= +Expression Concurrency Node Result +========================== =========== ================== ========= +stats.bandwidth.avg > 5000 1 node-17.domain.tld OK +stats.retransmits.max < 10 1 node-17.domain.tld OK +========================== =========== ================== ========= + +UDP +=== + +**Test Specification**: + +.. code-block:: yaml + + bandwidth: 0 + class: iperf3 + datagram_size: 32 + interval: 1 + sla: + - '[type == ''agent''] >> (stats.packets.avg > 100000)' + title: UDP + udp: true + +.. image:: 4f806542-e1fc-4d45-a23f-9c10e77270b3.* + +**Stats**: + +============ ========= ========= ========= +Metric Min Avg Max +============ ========= ========= ========= +loss, % 0.000 +jitter, ms 0.004 +packets, pps 160720 166747 179430 +============ ========= ========= ========= + +**SLA**: + +========================== =========== ================== ========= +Expression Concurrency Node Result +========================== =========== ================== ========= +stats.packets.avg > 100000 1 node-17.domain.tld OK +========================== =========== ================== ========= + diff --git a/doc/source/test_results/tenant_networking/neutron_vxlan_dvr_200/perf_l3_east_west/index.rst b/doc/source/test_results/tenant_networking/neutron_vxlan_dvr_200/perf_l3_east_west/index.rst index 9955b20..43a88eb 100644 --- a/doc/source/test_results/tenant_networking/neutron_vxlan_dvr_200/perf_l3_east_west/index.rst +++ b/doc/source/test_results/tenant_networking/neutron_vxlan_dvr_200/perf_l3_east_west/index.rst @@ -71,7 +71,7 @@ ping_icmp, ms 0.54 0.71 1.24 **SLA**: ========================= =========== =================== ======== -Expression Concurrency Node Result +Expression Concurrency Node Result ========================= =========== =================== ======== stats.ping_icmp.avg < 2.0 1 node-164.domain.tld OK ========================= =========== =================== ======== @@ -95,7 +95,7 @@ TCP **Stats**: ================= ======== ======== ======== -Metric Min Avg Max +Metric Min Avg Max ================= ======== ======== ======== bandwidth, Mbit/s 5405.46 5812.68 7309.81 retransmits 13 @@ -104,7 +104,7 @@ retransmits 13 **SLA**: ========================== =========== =================== ======== -Expression Concurrency Node Result +Expression Concurrency Node Result ========================== =========== =================== ======== stats.bandwidth.avg > 5000 1 node-164.domain.tld OK stats.retransmits.max < 10 1 node-164.domain.tld FAIL @@ -130,11 +130,13 @@ UDP **Stats**: -============ ======== ======== ======== -Metric Min Avg Max -============ ======== ======== ======== -packets, pps 138870 153702 165970 -============ ======== ======== ======== +============ ========= ========= ========= +Metric Min Avg Max +============ ========= ========= ========= +loss, % 0.005 +jitter, ms 0.004 +packets, pps 138870 153702 165970 +============ ========= ========= ========= **SLA**: diff --git a/doc/source/test_results/tenant_networking/neutron_vxlan_dvr_200/perf_l3_east_west_dense/42f40fed-1f50-41cb-9bf7-8f7043164832.svg b/doc/source/test_results/tenant_networking/neutron_vxlan_dvr_200/perf_l3_east_west_dense/42f40fed-1f50-41cb-9bf7-8f7043164832.svg new file mode 100644 index 0000000..be5f787 --- /dev/null +++ b/doc/source/test_results/tenant_networking/neutron_vxlan_dvr_200/perf_l3_east_west_dense/42f40fed-1f50-41cb-9bf7-8f7043164832.svg @@ -0,0 +1,4 @@ + +Pygal000.10.10.20.20.30.30.40.40.50.5time, s0.58214.07692307699.807692307690.265058628492.2820512821276.857817080.3230504012170.487179487227.994804740.3758615133248.692307692183.4969406290.2151502314326.897435897318.9098961890.3539047578405.102564103201.997378940.2492223199483.307692308290.201257050.4619511053561.512820513110.9591202550.3988570076639.717948718164.1212763020.2302001067717.923076923306.229093254ping_icmp, ms \ No newline at end of file diff --git a/doc/source/test_results/tenant_networking/neutron_vxlan_dvr_200/perf_l3_east_west_dense/81bd6b54-c9ef-46b8-8325-b13004b9d651.svg b/doc/source/test_results/tenant_networking/neutron_vxlan_dvr_200/perf_l3_east_west_dense/81bd6b54-c9ef-46b8-8325-b13004b9d651.svg new file mode 100644 index 0000000..bf24b06 --- /dev/null +++ b/doc/source/test_results/tenant_networking/neutron_vxlan_dvr_200/perf_l3_east_west_dense/81bd6b54-c9ef-46b8-8325-b13004b9d651.svg @@ -0,0 +1,4 @@ + +Pygal00100001000020000200003000030000400004000050000500006000060000700007000080000800009000090000100000100000110000110000120000120000130000130000time, s13232013.730769230824.824598478413573025.367014341612.57396449713553037.003259452413.29247675413360048.639504563220.226120033813338060.275749674121.016483516513475071.911994784916.094674556213474083.548239895716.130600169113596095.184485006511.7476754015135190106.82073011714.5139475909135580118.45697522813.1128486898131410130.09322033928.0938292477131610141.7294654527.3753169907129250153.36571056135.853761623131060165.00195567129.3512256974131600176.63820078227.4112426036131480188.27444589327.8423499577132500199.91069100424.1779374472132700211.54693611523.4594251902131090223.18318122629.2434488588131730234.81942633626.9442096365134720246.45567144716.2024513948136140258.09191655811.1010143702135170269.72816166914.5857988166134540281.3644067816.849112426135210293.0006518914.4420963652134970304.63689700115.3043110735135440316.27314211213.6158072697135950327.90938722311.7836010144133720339.54563233419.7950126796136260351.18187744510.6699070161135960362.81812255511.7476754015136020374.45436766611.5321217244135700386.09061277712.6817413356136500397.7268578889.80769230769131210409.36310299928.8123415046133120420.9993481121.9505494505132800432.6355932223.1001690617130440444.27183833131.578613694127310455.90808344242.8233305156126210467.54432855346.775147929126680479.18057366445.0866441251124350490.81681877453.4573119189125470502.45306388549.4336432798124300514.08930899653.6369399831126240525.72555410746.6673710904121030537.36179921865.3846153846122620548.99804432959.6724429417123520560.63428943956.4391377853123830572.2705345555.325443787123220583.90677966157.5169061708125220595.54302477250.331783601128100607.17926988339.9852071006129400618.81551499335.3148774303128430630.45176010438.7996618766126750642.08800521544.8351648352131190653.72425032628.8841927303130130665.36049543732.6923076923130480676.99674054831.4349112426130730688.63298565830.5367709214129930700.26923076933.4108199493packets, pps \ No newline at end of file diff --git a/doc/source/test_results/tenant_networking/neutron_vxlan_dvr_200/perf_l3_east_west_dense/c83bcfac-5181-4dd7-a808-250f230e144b.svg b/doc/source/test_results/tenant_networking/neutron_vxlan_dvr_200/perf_l3_east_west_dense/c83bcfac-5181-4dd7-a808-250f230e144b.svg new file mode 100644 index 0000000..f6d613a --- /dev/null +++ b/doc/source/test_results/tenant_networking/neutron_vxlan_dvr_200/perf_l3_east_west_dense/c83bcfac-5181-4dd7-a808-250f230e144b.svg @@ -0,0 +1,4 @@ + +Pygal002000200040004000600060008000800010000100001200012000140001400016000160001800018000200002000000.10.20.30.40.50.60.70.80.91time, s15015.9835813.3076923077123.35708002414819.5266724.5853976532127.44040076816163.0630535.863102998799.515244147417419.1474947.140808344273.407759916612900.5432158.4185136897167.32611921713640.0222869.6962190352151.95618278614079.9522480.9739243807142.81231939314140.0337292.2516297262141.56353683517370103.52933507274.42928149214519.97757114.807040417133.66647380413948.91739126.084745763145.53585468518151.95084137.36245110858.176577103619567.96646148.64015645428.744952636317631.14929159.91786179969.001341463515410.13718171.195567145115.16467000715920.63904182.47327249104.55398265716119.38477193.750977836100.42308924519399.45221205.02868318132.24749038114440.44113216.306388527135.31962404717980.00336227.58409387261.750473851614117.43164238.861799218142.0333169416630.36346250.13950456389.802490922117872.81036261.41720990963.978460509914118.00385272.694915254142.02142377312611.77063283.9726206173.32820427120207.59583295.25032594515.450373884718832.20673306.52803129144.037583479920450317.80573663610.412047671216680329.08344198288.770804653116489.88724340.36114732792.722263473317227.07748351.63885267377.399899711720153.90396362.91655801816.566349408419419.76547374.19426336431.825282944920019.91272385.47196870919.351332731219219.9707396.74967405535.977980497318171.11969408.027379457.778156001915817.73758419.305084746106.69277056218871.78421430.58279009143.214972747520540.14206441.8604954378.5384615384620509.62448453.1382007829.1727637899118850.04044464.41590612843.666913101713969.99359475.693611473145.09778969213650486.971316819151.74879766516680.0499498.24902216488.769767568919960509.5267275120.596607597317719.93637520.80443285567.155918350712828.06396532.082138201168.83258706414942.26456543.359843546124.889316419269.94324554.63754889234.939310560613230.13306565.915254237160.47565490118529.5105577.19295958350.329068936420351.02844588.47066492812.469153302915357.68509599.748370274116.25487700218338.96637611.02607561954.289493618915292.16766622.303780965117.61664464817310.33325633.5814863175.669443881914760.11276644.859191656128.67530796313839.53094656.136897001147.80943181716930.58014667.41460234783.562542523415749.4545678.692307692108.112021849013.3076923077435.461538462024.5853976532435.461538462035.8631029987435.461538462047.1408083442435.461538462058.4185136897435.461538462069.6962190352435.461538462080.9739243807435.461538462092.2516297262435.4615384620103.529335072435.4615384620114.807040417435.4615384620126.084745763435.4615384620137.362451108435.4615384620148.640156454435.4615384620159.917861799435.4615384620171.195567145435.4615384620182.47327249435.4615384620193.750977836435.4615384620205.028683181435.4615384620216.306388527435.4615384620227.584093872435.4615384620238.861799218435.4615384620250.139504563435.4615384620261.417209909435.4615384620272.694915254435.4615384620283.9726206435.4615384620295.250325945435.4615384620306.528031291435.4615384620317.805736636435.4615384620329.083441982435.4615384620340.361147327435.4615384620351.638852673435.4615384620362.916558018435.4615384620374.194263364435.4615384620385.471968709435.4615384620396.749674055435.4615384620408.0273794435.4615384620419.305084746435.4615384620430.582790091435.4615384620441.860495437435.4615384620453.138200782435.4615384620464.415906128435.4615384620475.693611473435.4615384620486.971316819435.4615384620498.249022164435.4615384620509.52672751435.4615384620520.804432855435.4615384620532.082138201435.4615384620543.359843546435.4615384620554.637548892435.4615384620565.915254237435.4615384620577.192959583435.4615384620588.470664928435.4615384620599.748370274435.4615384620611.026075619435.4615384620622.303780965435.4615384620633.58148631435.4615384620644.859191656435.4615384620656.136897001435.4615384620667.414602347435.4615384620678.692307692435.461538462bandwidth, Mbit/sretransmits \ No newline at end of file diff --git a/doc/source/test_results/tenant_networking/neutron_vxlan_dvr_200/perf_l3_east_west_dense/index.rst b/doc/source/test_results/tenant_networking/neutron_vxlan_dvr_200/perf_l3_east_west_dense/index.rst new file mode 100644 index 0000000..cfe9280 --- /dev/null +++ b/doc/source/test_results/tenant_networking/neutron_vxlan_dvr_200/perf_l3_east_west_dense/index.rst @@ -0,0 +1,147 @@ +.. _openstack_l3_east_west_performance_dense: + +OpenStack L3 East-West Performance within single compute node +************************************************************* + +In this scenario Shaker launches 1 pair of instances, both are hosted on the +same compute node. Instances are connected to one of 2 tenant networks, which +plugged into single router. The traffic goes from one network to the other (L3 +east-west). + +**Scenario**: + +.. code-block:: yaml + + deployment: + accommodation: + - pair + - double_room + - compute_nodes: 1 + template: l3_east_west.hot + description: In this scenario Shaker launches 1 pair of instances, both are hosted on the + same compute node. Instances are connected to one of 2 tenant networks, which + plugged into single router. The traffic goes from one network to the other (L3 east-west). + execution: + tests: + - class: flent + method: ping + sla: + - '[type == ''agent''] >> (stats.ping_icmp.avg < 2.0)' + time: 10 + title: Ping + - class: iperf3 + sla: + - '[type == ''agent''] >> (stats.bandwidth.avg > 5000)' + - '[type == ''agent''] >> (stats.retransmits.max < 10)' + title: TCP + - bandwidth: 0 + class: iperf3 + datagram_size: 32 + sla: + - '[type == ''agent''] >> (stats.packets.avg > 100000)' + title: UDP + udp: true + title: OpenStack L3 East-West Performance + +Ping +==== + +**Test Specification**: + +.. code-block:: yaml + + class: flent + method: ping + sla: + - '[type == ''agent''] >> (stats.ping_icmp.avg < 2.0)' + time: 10 + title: Ping + +.. image:: 42f40fed-1f50-41cb-9bf7-8f7043164832.* + +**Stats**: + +============= ========= ========= ========= +Metric Min Avg Max +============= ========= ========= ========= +ping_icmp, ms 0.215 0.346 0.582 +============= ========= ========= ========= + +**SLA**: + +========================= =========== ================= ========= +Expression Concurrency Node Result +========================= =========== ================= ========= +stats.ping_icmp.avg < 2.0 1 node-7.domain.tld OK +========================= =========== ================= ========= + +TCP +=== + +**Test Specification**: + +.. code-block:: yaml + + class: iperf3 + interval: 1 + sla: + - '[type == ''agent''] >> (stats.bandwidth.avg > 5000)' + - '[type == ''agent''] >> (stats.retransmits.max < 10)' + title: TCP + +.. image:: c83bcfac-5181-4dd7-a808-250f230e144b.* + +**Stats**: + +================= ========= ========= ========= +Metric Min Avg Max +================= ========= ========= ========= +bandwidth, Mbit/s 12611.771 16735.987 20540.142 +retransmits +================= ========= ========= ========= + +**SLA**: + +========================== =========== ================= ========= +Expression Concurrency Node Result +========================== =========== ================= ========= +stats.bandwidth.avg > 5000 1 node-7.domain.tld OK +stats.retransmits.max < 10 1 node-7.domain.tld OK +========================== =========== ================= ========= + +UDP +=== + +**Test Specification**: + +.. code-block:: yaml + + bandwidth: 0 + class: iperf3 + datagram_size: 32 + interval: 1 + sla: + - '[type == ''agent''] >> (stats.packets.avg > 100000)' + title: UDP + udp: true + +.. image:: 81bd6b54-c9ef-46b8-8325-b13004b9d651.* + +**Stats**: + +============ ========= ========= ========= +Metric Min Avg Max +============ ========= ========= ========= +loss, % 0.000 +jitter, ms 0.007 +packets, pps 121030 131170 136500 +============ ========= ========= ========= + +**SLA**: + +========================== =========== ================= ========= +Expression Concurrency Node Result +========================== =========== ================= ========= +stats.packets.avg > 100000 1 node-7.domain.tld OK +========================== =========== ================= ========= +