119 Commits

Author SHA1 Message Date
Eduardo Olivares
05bc405446 HA tests included in the faults-neutron workflow
The faults-neutron will include the HA faults tests, which covers some
important networking HA scenarios

Change-Id: I92a623e295aa2bdb718eedbc53fae8b92c75727b
2022-02-10 11:00:16 +01:00
Federico Ressi
b35fba7ed4 Migrate some test cases from scenario to sanity test suite
Change-Id: I346dfc66c2f40076bf681112dad76933434f675a
2022-02-09 12:18:43 +01:00
Federico Ressi
ad94fe92b1 Handle maxfail pytest option from InfraRed plugin
This allows to specify PyTest options depending on the workflow step
For instance in the faults workflow step below option is used:
  --maxfail 1

The option can be forced for all speps with below InfraRed plugin option:

 --pytest-maxfail <N>

For more details about pytest options please have a look to pytest help page:

  tox -e py3 -- --help

Change-Id: I3146819b5f80fa4768ea38032cc8e69dc7b44f18
2022-01-26 10:30:57 +01:00
Federico Ressi
947e354740 Speedup documentation page generation
Change-Id: I51ac8c30d1c1d0d34632d7c17998115242922e69
2022-01-21 12:21:35 +01:00
Federico Ressi
2ac4100069 Update run_tests.py environment variable names
Change-Id: I5f6ad7369f10df04f02aa96b22ab8236a0e060ef
2022-01-07 14:06:45 +00:00
Federico Ressi
728a927816 Stop setting locale env variable in tox
Change-Id: I485c599978df154c123307f752cfdc37d28de21a
2022-01-03 15:25:15 +01:00
Federico Ressi
ffaadf6436 Fix problem with setuptools and newer pythons
Change-Id: I70e4fecfe715822c2cae7753dc4c1956704b2d6d
2021-12-22 13:10:53 +00:00
Federico Ressi
e5008111ad Update pre-commit hooks configuration
Update pre-commit hooks configuration:
- use pre-commit 2.16.0
- use python pylint 2.12.2

Change-Id: Ic91148ba5cec708341b02fead011947f01b375b5
2021-12-21 14:46:44 +01:00
Federico Ressi
2e7e8b71e5 Create first dummy sanity test case
Change-Id: I74a03d4ab25eada23b7d323aa4b2f8c2a62149ef
2021-12-16 12:55:19 +01:00
Federico Ressi
d063af1b81 Stop running faults test cases after the first failure
Change-Id: I71653c6786000bff5f79a7951f2ff6157a99ce1a
2021-10-28 13:56:04 +02:00
Federico Ressi
d65d80efdc Add podman 1.6.0 source files and update requirements
New requirements:
 - podman
 - python-dateutil>=2.8.0
 - varlink

Change-Id: I7c5ec418fd8f9c7d0d36fce033fe588a59e36f5d
2021-10-27 16:34:09 +02:00
Federico Ressi
03b9eec659 Use local upper-constraints.txt
- Remove support for constrains file from infrared plugin
- Use file stored on tobiko repository by default

Change-Id: I0f835d753fb9d3a1670e8eb9b196e02e989d4262
2021-10-27 14:33:56 +02:00
Federico Ressi
17d5e32be9 Trigger the new devstack-tobiko-neutron jobs
Change-Id: I47ae03ca91eb27c17dc323d3d38322bbe5b7aa4a
2021-10-19 12:59:04 +00:00
Federico Ressi
332ec6130a Use older constraints file for linters requirements
Change-Id: Ic50b709dbfd9c245d2e3603bc61dff7e2b8921eb
2021-10-11 10:38:40 +02:00
Omer
221d90a5e3 Add Octavia faults workflow
So far Octavia didn't have a workflow which contained both scenario
and faults tests, which made it difficult to test octavia fault tests
on CI.

This test adds such a workflow named as faults-octavia.

Change-Id: I60ac1c2952e4247b10f0f903676cd31c004e4150
2021-09-29 11:29:39 +00:00
Roman Safronov
d652328de4 Create workflows for OVN migration
This patch adds 2 workflows for creating and checking resources
relevant for ML2OVS to ML2OVN migration scenario.

Change-Id: I4a425fbdbe48759780de1456c3fbf8123157cfb4
2021-07-15 13:19:08 +00:00
Federico Ressi
2c41194aee Avoid running 'commands_pre' in 'bindep' tox envinvironment
Change-Id: Ia18ad06034dacd1972c2dda8f22e9f5e48d81ffd
2021-07-09 15:19:55 +02:00
Federico Ressi
0a47393604 Fix problem with PS1 env variable expansion
Change-Id: I321a13f2c4bb556f315331f6d6c38c5fbe3ede5d
2021-07-06 14:40:52 +02:00
Jeremy Stanley
1f7ad83f71 Correct the tox option for skipping sdist generation
The tox option to skip source distribution building is skipsdist,
but this seems to be often misspelled skipdist instead, which gets
silently ignored and so does not take effect. Correct it
everywhere, in hopes that new projects will finally stop copying
this mistake around.

See https://tox.readthedocs.io/en/latest/config.html#conf-skipsdist
and https://github.com/tox-dev/tox/issues/1388 for details.

Change-Id: Ieee8041dd177b28d74a0f175fb6df340d158c3c9
2021-06-30 09:57:17 +00:00
Federico Ressi
6a56f0f0fb Let rename old podman varlink package as podman1
This allows to import old varlink based podman client
ase podman1 while keeping safe to install the new
client podman-py package as podman.

To archive such result it first temporarly rename existing podman
dir, then install podman package on its place, renames it as
podman1, and finally restore pre-existing podman directory
if any initially found.

Change-Id: If834cc383f11e656f17e49d5e6fa401ac8bee829
2021-05-19 21:05:44 +00:00
Federico Ressi
ff3a2af827 Create Tobiko Contributor Guide
Change-Id: Ieb517f7a451940518f6a7ca0a263f8ce3ebdd620
2021-03-03 12:56:54 +01:00
Slawek Kaplonski
820c86464b Remove installation of tobiko in the doc/source/conf.py file
Docs configuration file doc/source/conf.py shouldn't install
dependencies, like tobiko project itself as it seems that
this causes failures of the docs builds on the readthedocs.

So this patch removes it from that file and adds sphinx_rtd_theme
to the docs requirements file.
It also moves installation of tobiko project to the tox.ini file to make
Zuul docs job happy.

Change-Id: I0b227f87ade2d9561dd8aee988a565cbef31c7ae
2021-02-17 15:29:26 +01:00
Federico Ressi
cba8d571bf Fix reboot when target host si not reachable
Change-Id: I2467feac8e2a2bd6406b476c50f7fe64e9f27ca1
2021-02-01 10:10:26 +00:00
Federico Ressi
3f8f4b6346 Workaround Tox problem due to rarely defined PS1 variable on OSP installations
Change-Id: I00842d0ce2c55961a65960973a994218c3214570
2021-01-28 04:45:05 +00:00
Federico Ressi
190451d1ed Use pytest-cov plugin for getting coverage
Change-Id: Ifb5db0e8b1e12cf7d14045c2ccc7fc5ebfeaa40b
2021-01-27 21:11:21 +00:00
Federico Ressi
db64a23d0d Use pytest timeout and log capturing
Change-Id: I4d3394274c410ff8c424fe166a1657b2540f47fd
2021-01-27 21:10:27 +00:00
Federico Ressi
ee0740b8b1 Let lower-constraints job not using upper-constraints file
lower-constraints Tox environment where incorrectly using
the upper upper constraints file from OpenStack requirements
project

Change-Id: I2d1db74899e1892b041c76109d8bcf7f4c116d56
2021-01-13 12:33:00 +00:00
Federico Ressi
d44b3051bf Add check requirements job
Change-Id: I06e035a5570ffd25563f0483e6859ea55825b6f1
2021-01-05 13:35:44 +01:00
Federico Ressi
3ce3c741e5 Switch to pytest test runner
Change-Id: I8132e07ad624fe9faa01265d700b5eb37b94815f
2020-12-18 13:51:08 +00:00
Federico Ressi
71e79acb59 Fix testenv use of posargs in tox.ini
Change-Id: I0699a92d84cf67c42ccd695ade98e1a985039b58
2020-10-21 06:20:56 +02:00
Federico Ressi
7d20c11226 Skip functional test cases requiring Keystone credentials
Change-Id: Ib2143b49f8028ec6e4476dece8f8072cd9690967
2020-09-23 12:03:27 +00:00
pinikomarov
4767016bdc InstanceHa seperate from HA tests
Change-Id: I373ec078e03107c7ec528886e76e5141eaf618fb
2020-08-30 23:02:08 +03:00
pinikomarov
154c0981f5 add workflows create and check for octavia specific test scenarios
Change-Id: I95ceb3fcfaa11c177d904891b5aabb898f938d86
2020-08-21 00:55:46 +03:00
Federico Ressi
999df2811b Add nova tox env to run nova scenario test cases
Change-Id: I170f3f1a03c85b05f94bf729e35b68e1d1800fc8
2020-07-07 15:33:03 +02:00
Federico Ressi
97bbd72ebe Use --allow-missing-config for installing pre-commit hook
Change-Id: I9aa6d3835958b0ff69052a5a3b14469585edd8da
2020-07-04 09:53:53 +00:00
Federico Ressi
346939ccb7 Add ansible-lint pre-commit hook
Change-Id: I569725e26829acd9512675c9af45b726f2dc84eb
2020-07-03 10:56:33 +00:00
Federico Ressi
c1378755b1 Add pylint pre-commit hook
Change-Id: Id933664460ef15dc2c8a968309de232626aeb5b9
2020-07-03 10:56:27 +00:00
Federico Ressi
7b22fc3468 Add mypy pre-commit hook
Change-Id: Idbac0310d7bdc90db8021c0b01c936cff26111de
2020-07-03 10:56:17 +00:00
Federico Ressi
cecb2b1cde Add flake8 pre-commit hook
Change-Id: I1893f9031091fb02e62633d2ee387aff2b967237
2020-07-03 12:55:43 +02:00
Federico Ressi
5252001658 Introduce pre-commit hooks for linters verifications
Change-Id: Icd098df8adf72bf53955b0f07d9ed606c7803296
2020-07-03 06:15:47 +00:00
Federico Ressi
48389e8716 Add extra-requirements to lower-constraints tox environment
Change-Id: I4666677d68f615a1c68652d4990931bec3fc708e
2020-06-25 12:02:56 +02:00
Zuul
187fd10ddb Merge "Add validations-libs as an extra requirement" 2020-06-18 20:56:53 +00:00
Federico Ressi
3e2fc6c388 Add validations-libs as an extra requirement
Change-Id: I5bc1ce84a2963a0dd0e3d9e13008544c5cfe3e8f
2020-06-18 14:27:43 +00:00
Federico Ressi
aa32375454 Add lower-contraints job
Change-Id: I273e7ae3d82374f087c1b57a2a37886310a08e2f
2020-06-18 16:26:03 +02:00
Federico Ressi
ec3e1f7b6d Stop considering OpenStack upstream requirements good for InfraRed Tox
environment.

Change-Id: I537f7287e4f18a1e86ff19195dc68757c25345a1
2020-05-22 14:01:50 +00:00
Federico Ressi
0cdab8b7bc Allow jobs to pick arbitrary version of InfraRed
Change-Id: I7c39a1a2ba5ebf887f121ebc046c53b154c8f16c
2020-05-20 11:17:28 +02:00
Federico Ressi
c827a57b49 Move IR requirements file to IR plugin folder
Change-Id: I2cdf43882a07b7f83a21b17aca795285e8fd5fdf
2020-05-18 15:06:59 +02:00
Federico Ressi
48795f0a47 Add pylint Tox environment
Change-Id: If0b632e909a115f6af1a7fe7aef3a29f969c8100
2020-05-15 13:20:29 +02:00
Federico Ressi
a0ca79f017 Add infrared_plugin to ansible lints
Change-Id: Iabddb09048bd9aa7b1c028935fcf54fea9288387
2020-05-13 17:43:41 +02:00
Federico Ressi
92248c8506 Refactor test execution scripts
- Acreate a new tools/run_tests.py script to
  execute test cases
- Move report generation to such script and
  remove 'report' tox environment
- Running test cases generates report files
  (.log, .html, .xml) into 'report/{envname}'
  directory
- Test cases failures will returns exit code 1
  Other script test runner failures returns
  exit code 2

Big refactory to tox.ini file to try semplifying it:

- create the new 'py3' tox environment for running unit
  tests as default platform python 3 interpreter
- use same as py3 '{envdir}' for scenario, functional,
  neutron and faults tox environments

Change-Id: Id09425245cc86b84b41e6b3b1c1db759cc686f3a
2020-05-06 17:41:35 +02:00