fuel-plugin-calico/doc/source/TestReportforCalicoFuelPlug...

117 lines
7.9 KiB
ReStructuredText

======================================================
Test Report for the Calico Fuel Plugin ver 2.0-2.0.2-1
======================================================
Revision history
================
+---------+---------------+-------------------------------------------------+------------------------------------------------------+
| Version | Revision date | Editor | Comment |
+---------+---------------+-------------------------------------------------+------------------------------------------------------+
| 1.0 | 23.01.2015 | Irina Povolotskaya (ipovolotskaya@mirantis.com) | Created the template structure. |
+---------+---------------+-------------------------------------------------+------------------------------------------------------+
| 2.0 | 15.06.2015 | Emma Gordon (emma@projectcalico.org) | Wrote the test report. |
+---------+---------------+-------------------------------------------------+------------------------------------------------------+
| 3.0 | 02.05.2015 | Emma Gordon (emma@projectcalico.org) | Updated report with results of new mandatory tests |
| | | | for all Fuel plugins. |
+---------+---------------+-------------------------------------------------+------------------------------------------------------+
| 4.0 | 03.08.2015 | Emma Gordon (emma@projectcalico.org) | Updated with new test cases. |
+---------+---------------+-------------------------------------------------+------------------------------------------------------+
| 5.0 | 19.02.2016 | Neil Jerram (neil@projectcalico.org) | First RST version, for plugin version 2.0. |
+---------+---------------+-------------------------------------------------+------------------------------------------------------+
| 6.0 | 14.03.2016 | Dave Langridge (dave@projectcalico.org) | Added results for plugin version 2.0.2. |
+---------+---------------+-------------------------------------------------+------------------------------------------------------+
Document purpose
================
This document provides test run results for the Calico Fuel Plugin version 2.0
on Mirantis OpenStack 7.0; specifically with MOS 7.0 GA plus mu-3.
Test environment
================
As described in the test plan.
Test coverage and metrics
=========================
Test Coverage - 100%
Tests Passed - 100%
Tests Failed - 0%
Test results summary
====================
System Testing
--------------
+-------------------------------------------+-------+
| Parameter | Value |
+-------------------------------------------+-------+
| Total quantity of executed test cases | 15 |
+-------------------------------------------+-------+
| Total quantity of not executed test cases | 0 |
+-------------------------------------------+-------+
| Quantity of automated test cases | 0 |
+-------------------------------------------+-------+
| Quantity of not automated test cases | 15 |
+-------------------------------------------+-------+
Detailed test run results
-------------------------
+----------+--------------------------+--------+--------+---------+-------------------------------+
| # | Test case ID | Passed | Failed | Skipped | Comment |
+----------+--------------------------+--------+--------+---------+-------------------------------+
| 1 | Build Plugin | pass | | | |
+----------+--------------------------+--------+--------+---------+-------------------------------+
| 2 | Install Plugin | pass | | | |
+----------+--------------------------+--------+--------+---------+-------------------------------+
| 3 | Verify Calico option in | pass | | | |
| | Fuel web UI | | | | |
+----------+--------------------------+--------+--------+---------+-------------------------------+
| 4 | Deploy OpenStack with | pass | | | |
| | Calico | | | | |
+----------+--------------------------+--------+--------+---------+-------------------------------+
| 5 | Verify BGP Sessions | pass | | | |
+----------+--------------------------+--------+--------+---------+-------------------------------+
| 6 | Create VMs | pass | | | |
+----------+--------------------------+--------+--------+---------+-------------------------------+
| 7 | Test connectivity | pass | | | |
+----------+--------------------------+--------+--------+---------+-------------------------------+
| 8 | Test security | pass | | | |
+----------+--------------------------+--------+--------+---------+-------------------------------+
| 9 | Test initial route | pass | | | |
| | reflector configuration | | | | |
+----------+--------------------------+--------+--------+---------+-------------------------------+
| 10 | Test route reflector | pass | | | |
| | configuration changes | | | | |
+----------+--------------------------+--------+--------+---------+-------------------------------+
| 11 | External connectivity | pass | | | |
+----------+--------------------------+--------+--------+---------+-------------------------------+
| 12 | Modifying env with | pass | | | |
| | enabled plugin (remove | | | | |
| | /add controller nodes) | | | | |
+----------+--------------------------+--------+--------+---------+-------------------------------+
| 13 | Modifying env with | pass | | | |
| | enabled plugin (remove | | | | |
| | /add compute nodes) | | | | |
+----------+--------------------------+--------+--------+---------+-------------------------------+
| 14 | Uninstall of plugin with | pass | | | |
| | deployed environment | | | | |
+----------+--------------------------+--------+--------+---------+-------------------------------+
| 15 | Uninstall of plugin | pass | | | |
+----------+--------------------------+--------+--------+---------+-------------------------------+
| Total | | 15 | 0 | 0 | |
+----------+--------------------------+--------+--------+---------+-------------------------------+
| Total, % | | 100 | 0 | 0 | |
+----------+--------------------------+--------+--------+---------+-------------------------------+
Known issues
============
No issues were found during the testing.