Add list of tools for Openstack testing

Change-Id: I51df92d6ffabf12e96aafb8f6275075a697c82bb

doc/source/index.rst

@@ -17,6 +17,7 @@ Contributions to this documentation are warmly encouraged; please see
    use-cases
    specs
    eris/index
+   testing/tools-list
 
 
 Indices and tables

doc/source/testing/tools-list.rst

@@ -0,0 +1,155 @@
+***************************
+Tools for testing Openstack
+***************************
+
+`Rally <https://rally.readthedocs.io/en/latest/overview/overview.html#use-cases>`__
+===================================================================================
+
+-  Deployment of Openstack
+-  Verification of deployment
+-  Benchmarking: Simulate real user load
+-  Profiler for scaling and performance issues
+-  Report generation: Processing and aggregation of results
+
+De-facto control plane performance testing, allows to create different
+kind of tests including functional, concurrency, regression, load, scale
+capacity and chaos testing.
+
+`Yardstick <https://wiki.opnfv.org/display/yardstick/Yardstick>`__
+==================================================================
+
+-  Deployment
+-  Run test scenarios using a runner
+-  Report generation
+
+Inspired by Rally, was developed mainly from the prespective of
+VNF(Virtual Network Function), but is a generic framework for testing
+scenarios in Openstack for performance, scalability and
+availability/reliability.
+`Architecture <https://docs.opnfv.org/en/stable-fraser/submodules/yardstick/docs/testing/user/userguide/03-architecture.html>`__
+
+`HA-Failure-Test <https://github.com/avdhoot07/HA-Failure-TEST>`__
+==================================================================
+
+-  High Availability testing of Openstack components
+-  Set of Tempest scripts to test HA of components in HA cluster.
+-  Stop service(s), perform sanity and verify
+
+`Tempest <https://docs.openstack.org/tempest/latest/overview.html#tempest-the-openstack-integration-test-suite>`__
+==================================================================================================================
+
+-  Integration testing for live OpenStack
+-  Test OpenStack publicly available API and scenarios that demonstrate
+   a working cloud
+-  Load testing possible as well
+
+Mainly used for functional testing but non-funtional testing possible as
+well.
+
+`Shaker <https://pyshaker.readthedocs.io/en/latest/index.html>`__
+=================================================================
+
+-  Deploy instances and network in different topologies or network
+   configurations using Heat
+-  Run test scenarios
+-  Report generation
+
+Network load generation, testing and benchmarking. Based on 'iperf(3)'
+and 'netperf' -> network testing topologies
+
+`Cloud99 <https://github.com/cisco-oss-eng/Cloud99>`__
+======================================================
+
+-  Monintoring: Nodes and services
+-  Disruptions: in services, node, containers can be parallel,
+   sequential or round robin
+-  Runner: Perform actual tests with disruptions
+-  All 3 runs as seperate threads and parallel
+
+Makes use of Rally
+
+`Browbeat <https://github.com/cloud-bulldozer/browbeat>`__
+==========================================================
+
+-  Create Rally work loads
+-  Run Shaker for network config., benchmarking and testing
+-  CI and deployment: Can be used for CI or deploying data analysis
+   tools.
+
+`Harbinger <https://harbinger-dpm.readthedocs.io/en/latest/what/index.html>`__
+==============================================================================
+
+-  Manager for data plane testing frameworks in Openstack
+-  Can similtaneously execute multiple testing frameworks (Shaker,
+   Yardstick)
+
+`Enos <https://github.com/BeyondTheClouds/enos>`__
+==================================================
+
+-  Deployment Openstack on VMs or bare metal
+-  Setup with different configurations
+-  Benchmarking:
+
+   -  Rally scenario for control plane
+   -  Shaker scenario of data plane
+
+-  Report generation: Get metrics/reports in Grafana
+
+`chaostoolkit-openstack <https://pypi.org/project/chaostoolkit-openstack/>`__
+=============================================================================
+
+-  Driver to perform set of actions and probes.
+
+A minimal chaostoolkit driver for Openstack compute resources.
+
+`OS-Faults <https://github.com/openstack/os-faults>`__
+======================================================
+
+-  Library for initiating or terminating service/node/container/network
+   as a way for introducing fault injections.
+-  Allows for both hardware and software level faults
+
+Used by Rally to introduce faults.
+
+`Jepsen <https://github.com/jepsen-io/jepsen>`__
+================================================
+
+-  Introduction of disruptions/faults
+-  Testing
+-  Report generation
+
+Not specific to Openstack but general library for distributed systems,
+written in Clojure
+
+`OPNFV Doctor <https://wiki.opnfv.org/display/doctor/Doctor+Home>`__
+====================================================================
+
+-  Fault management and maintenance in VIM(Virtualized Infrastructure
+   Manager) e.g OpenStack
+-  Fault monitoring (Hardware, Hypervisor, Host OS faults)
+-  Fault notification
+-  Failure recovery (Switch to STBY config.)
+
+`Stepler <https://stepler.readthedocs.io/>`__
+=============================================
+
+-  Destructive testing
+-  Test the availability of Openstack cluster incase of node/service
+   failure(s)
+
+Make use of os-faults
+
+`KloudBuster <https://github.com/openstack/kloudbuster>`__
+==========================================================
+
+-  Benchmarking of data plane and storage services in Openstack
+
+A fully integrated framework which is easy to use with basic knowledge
+of Openstack but isn't flexible or programmable to do everything.
+
+`NFVbench <https://opnfv-nfvbench.readthedocs.io/en/latest/testing/user/userguide/index.html>`__
+================================================================================================
+
+-  Measure network performance in Openstack
+-  Data plane performance testing
+