233 Commits

Author SHA1 Message Date
Martin Kopec
0fb2a056c9 Fix load() missing argument Loader
This patch replace yaml.load() by yaml.safe_load() which will
fix the TypeError our jobs currently face:
TypeError: load() missing 1 required positional argument: 'Loader'

Change-Id: I3d238eabf374be895782ebc9e4907db93157a5d4
2021-10-21 21:06:55 +00:00
Martin Kopec
1c2f076100 Temporarily disable most of the jobs
refstack jobs are broken and require a fix (see follow up patches)
on refstack-client side which can't be merged without a fix
on ansible-role-refstack-client.

python jobs are broken too and require a fix in refstack-client
(already proposed) which can't be merged without other mentioned
fixes.

This will be reverted as soon as the issue is resolved.

Change-Id: Ic00064ed0769aaad3730f1db6889ca180860370b
2021-10-21 19:29:12 +00:00
lpiwowar
9b8892c2dd Change documentation configuration
This patch makes sure that the html documentation is generated with
alabaster theme.

Change-Id: Id2f13d44100a1eeb97670ea49f600d29119258e9
2021-10-12 16:22:44 +02:00
lpiwowar
80549788ea Publish docs to docs.opendev.org
docs.opendev.org will provide easier access to the doc pages
in comparison to the Gitea (opening the doc files in the repo).

Change-Id: Ib3ee1c006eca682823bd7f2920bf85ad2ce24fd8
2021-10-12 16:22:38 +02:00
Martin Kopec
08a64544e1 Remove unnecessary rm command from setup_env
The removal of the dowloaded .tar.gz file is happening
on line 188 which makes the second removal of the .tar.gz
file redundant - the second call was also not matching the
name of the file.

Change-Id: Ia86d8ad368336e1af6ab4838510dcad453e12059
2021-10-07 20:39:04 +00:00
Martin Kopec
2fff054f62 Switch testing to Yoga testing runtime
Upating the tetsing template to Yoga testing runtime:
https://governance.openstack.org/tc/reference/runtimes/yoga.html

Change-Id: I3e31a76e1ec55c60bac97e767652ef82f6b96143
2021-10-07 18:43:19 +00:00
Martin Kopec
0ab5f7ac61 Use UPPER_CONSTRAINTS_FILE when installing deps
Let's use UPPER_CONSTRAINTS_FILE when installing dependencies
by setup_env. The UPPER_CONSTRAINTS_FILE is set to
https://releases.openstack.org/constraints/upper/master
Using a constraint file is safer in general - it will shield
us from too recent releases of the dependencies (direct and
indirect ones as well).

Change-Id: I4a8a9647b7a78302009e3b6d60462d3c8d438cd8
2021-10-07 18:35:38 +00:00
lpiwowar
0851f4fdec Update default tempest tag
The currently used tempest tag points to the version of tempest that
causes failure of some object_storage tests. The failure occurs when
swift is used on ceph. In such a case tempest expects that swift's
API endpoint for listing active capabilities is at /info when
actually the correct endpoint is /swift/info. This issue fixes
commit [1] that should therefore be used as a new default
tempest tag.

[1] https://review.opendev.org/c/openstack/tempest/+/692375

Change-Id: Id213499a54d793fab198a9bc2d96dd4cc3c89ce6
2021-08-26 10:54:50 +02:00
Martin Kopec
fa73ef2524 Update Readme
* remove old links
* mention new options of setup_env script
* mention OpenStack Marketing Programs and interop repo
* mention ansible-role-refstack-client

Change-Id: Ia62b400d38eeeebd22e79b33616a04877b9ea33b
2021-06-18 13:50:09 +00:00
Martin Kopec
7fbf6dad17 Update zuul jobs for Xena cycle
Use Xena zuul job template which contains also py39 job
and add jobs to run refstack-client also on stable/wallaby
release.
Also per Xena testing runtime we need to support at least
py36 and py38:
https://governance.openstack.org/tc/reference/runtimes/xena.html

Depends-On: https://review.opendev.org/c/openstack/devstack/+/790353
Change-Id: Id65875ab48ce1b25bd929cb784a86a093c586e73
2021-05-09 08:50:01 +00:00
Martin Kopec
d9924541d8 Remove concurrency workaround
After we bumped tempest version used in refstack to the commit
from Oct 2019 [1], we can remove concurrency workaround which
was needed only until the tempest version used in refstack
doesn't contain this commit [2] which is from Mar 2019.

[1] https://review.opendev.org/c/osf/refstack-client/+/782592
[2] https://review.opendev.org/c/openstack/tempest/+/641349

Change-Id: I17d5df4635b0451e4442ef693f4293ee3851ff6d
2021-04-18 20:44:15 +00:00
Martin Kopec
a842efbf56 Update default tempest tag to Oct 2019
In order to support manila_tempest_plugin tests which are a part
of share file system target program we need to update tempest's
tag to the commit when a workaround to handle skip exception
was added [1]. Without the change some of the manila_tempest_plugin
tests in share file system program are failing because tests skips
are treated as errors.

[1] https://review.opendev.org/c/openstack/tempest/+/687999

Change-Id: I692ac5749da553435e8d04f8179aa6151038b1f4
2021-03-23 19:31:53 +00:00
Martin Kopec
6bbd88fed8 Update default tempest tag to Oct 2018
Let's update the default's tempest tag one month more so that
tempest contains follow_redirects parameter [1] in its RestClient
needed to run dns add-on tests. Without the change some of the
designate_tempest_plugin tests were failing with TypeError:
__init__() got an unexpected keyword argument 'follow_redirects'

[1] https://review.opendev.org/c/openstack/tempest/+/580146

Change-Id: I5fde40ff2ed3e6e258a18ba431ab9aef2009c891
2021-03-20 19:31:09 +00:00
Martin Kopec
dab344ad3f Allow tests from plugins
Allow refstack-client run also tests from tempest plugins
by not filtering out all tests whoose names don't start
with tempest.

Change-Id: Ic880967287f7cf7064d2440fde2c35c781477873
2021-03-20 19:21:33 +00:00
Zuul
629db97d31 Merge "Inclusive jargon in tox.ini" 2021-01-14 10:43:17 +00:00
Thierry Carrez
028d13d74b Remove warning about deprecated signer function
Use of signer/verifier functions has been deprecated since
cryptography 2.0, and a deprecation warning is shown on
every use of the 'refstack-client sign' command.

Remove that warning by using the sign function instead
of the signer function, as described in:

https: //github.com/pyca/cryptography/blob/1.9/docs/hazmat/primitives/asymmetric/rsa.rst#signing
Change-Id: Id9d5ed33b601771cd75df421a15ed2894fcd4d92
2021-01-13 15:05:02 +01:00
Thierry Carrez
832b712812 Fix output of sign command
The 'refstack-client sign' command currently fails to produce
data that is directly copy-pastable into the RefStack website:

- the 'Public key' might contain the key comment, if the public key
  is read from a .pub file that includes one

- The 'Self-signature' is enclosed in b'...'

This fixes the proposed output by stripping the key comment of the
comment (if any) and converting the signature bytes into a string.

Change-Id: If782d81d18c44fa3e5e4c8e529a68b217f6fb84b
2021-01-13 15:04:30 +01:00
Martin Kopec
c212ff55d2 Inclusive jargon in tox.ini
tox deprecated its whitelist_externals option in
3.18 release. The patch bumps the min version of tox
to 3.18 and renames the option from whitelist_externals
to allowlist_externals.

Change-Id: I06bf94861056e06722da839f7c5c8c60be2fc6ee
2021-01-09 15:53:31 +00:00
Martin Kopec
1fce1e362e Inclusive jargon
Following tempest's example where arguments such as --blacklist-file,
--black-regex and --whitelist-file are deprecated by [1], let's do
the change here as well.

A few occurrences cannot be renamed atm as refstack-client uses an older
tempest version which doesn't contain the change [1] yet. After we update
the tempest version used in this project, the rest occurrences will be
renamed as well.

[1] https://review.opendev.org/c/openstack/tempest/+/768583

Change-Id: I514fb688f6895338a877cbc706ddd8d6fc5f906d
2021-01-04 15:08:48 +00:00
Martin Kopec
2fc66e3502 Add openstack cover job
The patch adds a new job which runs cover tox environment
to show code coverage by unit tests.

Change-Id: I888cd729b9a1dbe65a3380da357eafc1cc961b36
2020-12-18 20:32:26 +00:00
Martin Kopec
f018caa06e Unite tempest_dir in _get_next_stream_subunit_output_file
The method have used tempest_dir value given by the argument as well
as self.tempest_dir value which was confusing and lead to a unit test
failure in the case when tempest_dir was a valid path to an existing
tempest environment.

Usually self.tempest_dir and tempest_dir were the same, the values
were different only in a unittest which was editing the tempest dir
path for test purposes.

The docstring suggests that the method should use the value from the
argument, therefore the patch removes the self.tempest_dir occurrence.

Change-Id: I80dc38e6f0dcff1956f2881894d51a1c35577b33
2020-12-18 20:31:26 +00:00
Martin Kopec
8078ab8d76 Update gate jobs
ansible-role-refstack-client [1] has been created in order to make
running refstack-client in automated jobs easier. The role does
basically the same (and more) as the tempestconf-refstack-devstack.yaml
playbook used in zuul jobs to gate changes within refstack-client repo.

After devstack jobs were defined within the role repo by [2] we no
longer need the playbook and the generate-tempestconf-refstack role.
We can reuse the jobs [2] from ansible-role-refstack-client.

The refstack-client-devstack-tempestconf job together with the
playbook and the generate-tempestconf-refstack role can be removed
as python-tempestconf was the only consumer of those, it got removed
from there by the Depends-On patch.

[1] https://opendev.org/x/ansible-role-refstack-client
[2] https://review.opendev.org/c/x/ansible-role-refstack-client/+/765671

Depends-On: https://review.opendev.org/c/osf/python-tempestconf/+/766865
Change-Id: I618c8e59e67f0eed574671d5485bc11f7abec465
2020-12-18 11:13:07 +00:00
Martin Kopec
bd55664f19 Remove a part of test_verbose unit test
The part of the test which tests passing --silent and --verbose
arguments together doesn't belong to refstack_client as it doesn't
contain any code dealing with this arg combination. The arg
combination is parsed outside of the refstack_client scope where
it should be also tested.

Change-Id: I8bceb2e171eaafb8a9866fd6bcef1ee2f647fd4c
2020-12-14 11:03:31 +00:00
Zuul
b93f14f4e6 Merge "Initialize verbose flag properly" 2020-12-11 12:26:43 +00:00
Zuul
b52bee1c36 Merge "Update min tox version to 2.0" 2020-11-20 09:32:25 +00:00
Zuul
c9ba649e26 Merge "Support DNF based OS" 2020-11-20 05:11:23 +00:00
Zuul
b576c974fd Merge "Replace GitHub repositories with OpenDev repositories" 2020-11-19 16:48:12 +00:00
Manik Bindlish
474d3bbc4d Update min tox version to 2.0
The commands used by constraints need at least tox 2.0.
Update to reflect reality, which should help with local running of
constraints targets.

Change-Id: I35e4facae2d35838a73cdb6100968e98b550ea43
2020-11-19 15:52:22 +00:00
Martin Kopec
f069afca67 Fix pep8, flake8 and unit test failures
The patch edits the code so that it complies with W605 rule
wherever it makes sense. W504 rule is added to a ignore list.
High version cap of pyflakes and flake8 packages is increased
as well.

Change-Id: I51558ee9c808e03b4164d0832fc525c5556dddd1
2020-11-18 15:42:33 +00:00
Christian Berendt
4a6ceb8acf Replace GitHub repositories with OpenDev repositories
Change-Id: I7cce77dae30b1331c093a560946dc5ff31eb986a
2020-06-30 13:56:37 +02:00
Ghanshyam Mann
a2b4ce30b8 Update jobs for interop repos renaming
Interop repos are going under rename from
openstack namespace to osf namespace (Depends-On),
which need update the zuul job to start using the
new location.

Update .gitreview as well.

Disable py27 and py35 jobs, they don't work anymore as is.

Depends-On: https://review.opendev.org/#/c/734669/
Change-Id: Ib6871eaf0735e756f051d14513869fbe7cc6e826
2020-06-13 18:57:48 +02:00
Artem Goncharov
d4e4da0ffc Support DNF based OS
Since some time RedHat based OS are moving from yum to dnf. Extend check
of the supported underlying package manager to add "dnf" command
(interface is same as yum).

Change-Id: I5041d32be58a591db7eda7747ba2173527dffbf2
2020-02-20 13:18:06 +01:00
Artem Goncharov
d037611e99 Initialize verbose flag properly
When running refstack-client without verbose mode enabled exception
occurs, since the argparse argument is not properly initialized. Do this
by setting default to 0.

Change-Id: I1c5abc8d0ee0b14d3b7294b0e77274c270c5055c
2020-02-20 12:55:14 +01:00
Zuul
86c1618fee Merge "Bump guideline version to 2019.11" 2020-01-17 07:07:46 +00:00
Martin Kopec
4b976c1e15 Bump guideline version to 2019.11
Jobs testing refstack-client use an old guideline version.
The patch bumps the version of the guideline to the newest one.

Change-Id: I8b9b67fd5ab51fb1c859c41d6583a758b1650a7c
2020-01-16 10:00:48 +00:00
Zuul
b4908817ef Merge "Bump version of virtualenv download" 2020-01-16 04:58:34 +00:00
Martin Kopec
9ab6f81e36 Change default python to 3.6.0
As setuptools has dropped support for python2 and python2 has reached
EOL 1st Jan 2020, this patch changes default python for preparing an
env to 3.6.0.

Change-Id: Id00ee1265048425e29de70aee65c70a1d5cf9264
2020-01-14 14:46:12 +00:00
Jonathan Rosser
ccdcb2ed5c Bump version of virtualenv download
This updates the virtualenv release to the latest current which allows
setup_env to complete without error when setuptools 45.0.0 is present
in the venv

Change-Id: I2138409d2adce578764781a1ba481fcbc319c451
Closes-Bug: 1859633
2020-01-14 14:41:29 +00:00
Zuul
59534d08fb Merge "Bump guideline version to 2019.06" 2019-09-17 13:02:58 +00:00
Zuul
a3a8a246c5 Merge "Check python version when installing deps via yum" 2019-09-17 13:02:57 +00:00
Zuul
268fd3b688 Merge "Use correct python to install venv" 2019-09-17 13:02:56 +00:00
Zuul
3e06de64a0 Merge "Change openstack-dev to openstack-discuss" 2019-09-16 15:32:20 +00:00
Martin Kopec
6228a6a297 Bump guideline version to 2019.06
Jobs testing refstack-client use an old guideline version.
The patch bumps the version of the guideline to the newest one.

Change-Id: Ic569fa228d2481e0233130f392de7f74231d8e34
2019-09-16 10:25:10 +00:00
Martin Kopec
bed0a57de9 Check python version when installing deps via yum
It seems that newer yum will not install all packages provided if one of
them is not found.
setup_env script installs for example python-devel and python3-devel
where one of them is for installation with python2 and the other
for python3.
In order to avoid situations when required packages are not installed
because one of the packages is not available, the patch adds logic
which will install deps based on the python version.

Change-Id: Ib119b283fac3cda340813f48b10c0a3cc4573891
2019-09-16 10:22:38 +00:00
Martin Kopec
9d4e39e930 Use correct python to install venv
The review adds logic which will choose python3 by default. If there is
no python3 it will fall back to python2.

Change-Id: If6dd7e7e3b09f20caf73ccdd36ac55220b13c129
2019-09-16 10:21:14 +00:00
Martin Kopec
fb9f35d13f Improve python3 compatibility
The review:
 * adds a python3 job in order to test the refstack-client with
   python3 as well.
 * adds a job which runs unit tests by python3.7
 * changes default python3 (when -p 3 is specified) in setup_env script
   to version 3.6.0
 * converts downloaded list of tests from bytes to str in order to unify
   the types used for python2 and python3 compatibility.
 * edits -p argument in the setup_env script so that it also accepts a full
   version of Python a user wants to run with, before there were 2 options:
    * python2.7.8
    * python3.6.0
 * sets object-storage.operator_role to Member in tempest.conf in order to run
   tempest.api.object_storage.test_container_services.ContainerTest tests

Change-Id: I961f0f093bd7d40fde7e448ea12ef9907c61d126
2019-09-09 16:38:21 +00:00
OpenDev Sysadmins
21c7d84649 OpenDev Migration Patch
This commit was bulk generated and pushed by the OpenDev sysadmins
as a part of the Git hosting and code review systems migration
detailed in these mailing list posts:

http://lists.openstack.org/pipermail/openstack-discuss/2019-March/003603.html
http://lists.openstack.org/pipermail/openstack-discuss/2019-April/004920.html

Attempts have been made to correct repository namespaces and
hostnames based on simple pattern matching, but it's possible some
were updated incorrectly or missed entirely. Please reach out to us
via the contact information listed at https://opendev.org/ with any
questions you may have.
2019-04-19 19:34:27 +00:00
Martin Kopec
5be0ac7a6f Set concurrency to 0
until refstack-client uses tempest tag which contains
default value for concurrency it needs to be set here.

Change-Id: Ic33639f39a21d5827c9ffe14fc76a47a36c7b47f
2019-03-07 09:03:14 +00:00
huang.zhiping
5f95355189 Add tox python3 overrides
Change-Id: I898d708ed89cc44acd480811137076354169277b
2019-01-22 02:34:11 +00:00
Martin Kopec
1037f945f4 Fix generate-tempestconf-file role
The role has been using python-tempestconf master branch when
gating refstack-client or python-tempestconf patches.
This patch adds a new argument to setup_env script which can
be used to specify a path to python-tempestconf source code.
This argument is used, when running the setup_env script from
the role, to point the script to the zuul source of
python-tempestconf code which contains the newest commits.

Change-Id: I65f9043a7bb0e6f045b6442679dd99dbd6aeb2de
2019-01-07 13:03:59 +00:00