1162 Commits

Author SHA1 Message Date
vass
bfcb8a9df3 fetch-sphinx-tarball: use remote_src true
Since ansible copies files as a tempfile to the remote host by default
setting remote_src: true when the files are on the same host gives better
error messages since otherwise the source path is not reflecting the real path.

See: http://paste.openstack.org/show/792400/
Where the file in "dest:" field of unarchive is copied to a tempfile
instead of just unarchiving the tarball directly.

Change-Id: Id7478a5a3171fdd2d3bc7531e66a09414e711d3a
2020-04-20 13:28:04 +02:00
James E. Blair
a4cf5ca07e tox: Don't inline python warnings
The sphinx regex is picking up python warnings.  We can disambiguate
the two because sphinx doesn't emit a space before the message but
the python warnings module does.  This adjusts the regex to do that
and adds a test file that includes warnings output.

If we need/want to make this more robust, we could also simply filter
the sphinx output for messages that start with " ?\w+Warning:".

We could also decide that we want to include python warnings.

Change-Id: Ib58cc1a2d4f673a0ce3d2a9cae306004559f5b52
2020-04-08 14:13:48 -07:00
Mohammed Naser
db27d024ee fetch-javascript-output: add metadata.type
This adds a 'site' metadata type to the role so that we can pull
it down later based on type instead of a user friendly "name"

Change-Id: I4c59feac26971162a29fb998a21c422ccb4efc1a
2020-04-07 12:09:26 -04:00
Zuul
14a409be73 Merge "Add support for RedHat platforms on ensure-podman" 2020-04-07 16:03:17 +00:00
vass
6dabffe402 Rename install-go to ensure-go for consistency
The old role will be kept and include ensure-go for backwards-compatability.

Change-Id: I4e6345563817057a6c47c124b9ec8b0c62b057d6
2020-04-06 21:10:11 +02:00
Zuul
483ea85f63 Merge "Rename install-if-python to ensure-if-python for consistency" 2020-04-06 18:02:36 +00:00
Sorin Sbarnea
69c53666de Add support for RedHat platforms on ensure-podman
- makes ensure-podman work on additional platforms
- prevents regression on new platforms fedora-30 and centos-8
- enables validation of podman engine

Change-Id: I5842ad22d94522f707ef743622b8950839d96dff
2020-04-06 18:52:07 +01:00
Zuul
31ef54f2ec Merge "Rename install-pdk-dependencies to ensure-pdk-dependencies for consistency" 2020-04-06 17:20:15 +00:00
Zuul
a1a8f83010 Merge "Rename install-yarn to ensure-yarn for consistency" 2020-04-06 16:56:18 +00:00
Zuul
34f00bf9da Merge "Rename install-nodejs to ensure-nodejs for consistency" 2020-04-06 16:50:51 +00:00
Zuul
f6e50846a7 Merge "Rename install-javascript-packages to ensure-javascript-packages for consistency" 2020-04-06 16:17:57 +00:00
Zuul
a625f48c00 Merge "Rename install-devstack to ensure-devstack for consistency" 2020-04-06 16:08:52 +00:00
Zuul
de77d239fa Merge "Rename install-podman to ensure-podman for consistency" 2020-04-06 15:20:36 +00:00
Zuul
eb1ce40503 Merge "Rename install-openshift to ensure-openshift for consistency" 2020-04-06 15:20:35 +00:00
Zuul
cc3e004d11 Merge "Rename install-kubernetes to ensure-kubernetes for consistency" 2020-04-06 14:56:09 +00:00
Zuul
9f2ec10c22 Merge "Rename install-docker to ensure-docker for consistency" 2020-04-06 14:30:17 +00:00
Ian Wienand
82b466aa68 ensure-tox: update Python version documentation
Change bed3643b28f2b30b7f49895d8e34418077ddb3ee modified the
tox_prefer_python2 default to false; update the README.rst.

Change-Id: Ie8f9ecbb2da06f1e3a3602a4cc0975ea21c2f822
2020-04-06 17:04:00 +10:00
vass
c0b358fedb Rename install-if-python to ensure-if-python for consistency
The old role will be kept and include ensure-if-python for backwards-compatability.

Change-Id: Ief86799bcd91358d3ce8b6badda272a26ee04002
2020-04-04 15:41:29 -04:00
vass
16fe7bbd3f Rename install-pdk-dependencies to ensure-pdk-dependencies for consistency
The old role will be kept and include ensure-pdk-dependencies for backwards-compatability.

Change-Id: Ia269db36655685fe3f4dc54c60ae4bc09a913f52
2020-04-04 15:41:29 -04:00
vass
0b4ed70366 Rename install-yarn to ensure-yarn for consistency
The old role will be kept and include ensure-yarn for backwards-compatability.

Change-Id: I7631c7e588bc953d6e3b22759abe66a73ffca728
2020-04-04 15:41:29 -04:00
vass
ac72b44911 Rename install-nodejs to ensure-nodejs for consistency
The old role will be kept and include ensure-nodejs for backwards-compatability.

Change-Id: Ib4cf74d6c1e8774f6fc37d6a30f690eb8f9f3d08
2020-04-04 15:41:29 -04:00
vass
ff44b6cd4e Rename install-javascript-packages to ensure-javascript-packages for consistency
The old role will be kept and include ensure-javascript-packages for backwards-compatability.

Change-Id: Ibb896edf0652a19be13018b4abddb4a81c51f07b
2020-04-04 15:41:29 -04:00
vass
84c06a37c4 Rename install-devstack to ensure-devstack for consistency
The old role will be kept and include ensure-devstack for backwards-compatability.

Change-Id: Ia5fe33649a66a24ce6bb9de3cccbd5ef612dfb2f
2020-04-04 15:41:29 -04:00
vass
2cb9f249a8 Rename install-podman to ensure-podman for consistency
The old role will be kept and include ensure-podman for backwards-compatability.

Change-Id: I21cfdfef4a88f66f51d139abed04f70b3228a22d
2020-04-04 15:41:29 -04:00
vass
276a5e919a Rename install-openshift to ensure-openshift for consistency
The old role will be kept and include ensure-openshift for backwards-compatability.

Change-Id: I6ff81fbd04f25207c87834b36e4d636eb9d44a93
2020-04-04 15:41:29 -04:00
vass
fcf3202ba4 Rename install-kubernetes to ensure-kubernetes for consistency
The old role will be kept and include ensure-kubernetes for backwards compatability.

Change-Id: Ic0c18a833f4a07e123f8313673bd9c864d7d2919
2020-04-04 15:41:29 -04:00
vass
c80b593fb6 Rename install-docker to ensure-docker for consistency
The old role will be kept and include ensure-docker for backwards compatability.

Change-Id: Icb76a954b04631c405b09eb54343fd852a511b83
2020-04-04 15:41:29 -04:00
Andreas Jaeger
55e31dd996 tox-parse_output: Ignore .tox directory
We get many false positives on the .tox directory, ignore it.

Even better would be to only handle files under version control but that
is more involved, so use the simple heuristic for .tox for now since
that catches 90+ per cent of the cases.

Change-Id: Ibb17958454a4d6bf156020fe4d9f588f3c666cc7
2020-04-04 17:25:49 +02:00
Zuul
d3ee7ffff9 Merge "Add test cases for tox line comment parsing" 2020-04-03 20:02:32 +00:00
Zuul
8b1470e0b1 Merge "Ignore absolute paths after stripping work dir" 2020-04-03 20:00:06 +00:00
Zuul
983b5718a7 Merge "Strip source dir from file comments" 2020-04-03 20:00:05 +00:00
Zuul
758c530e04 Merge "Don't silently ignore exceptions when parsing tox output" 2020-04-03 20:00:00 +00:00
Zuul
0c554f7e20 Merge "Support multiple matchers when parsing tox output" 2020-04-03 19:59:59 +00:00
Zuul
b6b07fb2d8 Merge "Add phoronix-test-suite job" 2020-04-03 19:46:12 +00:00
Tobias Henkel
99ea9c94a0
Add test cases for tox line comment parsing
Tox line comment parsing had a few side effects at first so add
testing to it.

Change-Id: I9eb2aa00d6e467bd170fad80598728aec6949ee6
2020-04-03 19:34:24 +02:00
Tristan Cacqueray
59c5820fa6 Add phoronix-test-suite job
This change adds new jobs to run and combine phoronix test suite results.

Co-Authored-By: Nicolas Hicher <nhicher@redhat.com>
Change-Id: If94cdbd91c8d80393a71cd5c36690563de9edcd6
2020-04-03 13:03:07 +00:00
Tobias Henkel
92bb7ff535
Ignore absolute paths after stripping work dir
After stripping the work dir there should not be any absolute path
left that can be related to the repo. Thus filter them so they don't
produce mapping warnings in zuul.

Change-Id: Iadeac9b1faea63aa6009e2cfbc215853695abbe6
2020-04-02 19:39:58 +02:00
Tobias Henkel
7df5e55ebc
Strip source dir from file comments
Some programs like sphinx emit absolute paths in error messages. Those
cannot be processed by zuul so filter them if they're part of
zuul.project.

Change-Id: Ie8af91017c26f39c3aa9ca098d4230f0688351ce
2020-04-02 19:39:58 +02:00
Tobias Henkel
ecb2c55640
Don't silently ignore exceptions when parsing tox output
We shouldn't catch exceptions during parsing without having any
log. This makes debugging impossible. Since errors are now ignored we
can stop silently catching any exception and take the chance to harden
the parsing when we hit exceptions in the future.

Change-Id: Ie58acc4c7fbfcb7e44eef49883fb69f3bccef994
2020-04-02 19:39:58 +02:00
Tobias Henkel
00900e69ab
Support multiple matchers when parsing tox output
The regex used to filter for line comments needs to be fine tuned for
different linters. Instead having a huge complicated regex add support
for more specialized regexes. Start with a regex that matches spinx
output.

Change-Id: I516086bba315b8bb03a1103e1b33f1a819853be7
2020-04-02 19:39:58 +02:00
Zuul
e8957d6d2e Merge "Do not end host if correct go version is installed" 2020-04-02 10:24:14 +00:00
Zuul
3e38894cc5 Merge "golangci-lint: add job" 2020-04-01 23:56:18 +00:00
Zuul
fbb9589854 Merge "local-log-download : role with script to download all log files" 2020-04-01 22:49:46 +00:00
Mohammed Naser
23236c12fa golangci-lint: add job
This patch adds a roles and jobs to run golangci-lint against a
a Golang project.  It's a very popular tool for linting go code.

It also adds a simple framework which allows us to create dynamic
tests for file comments by defining a simple YAML file.

Change-Id: Ic8358541adaf7c3279383f0279cd3da7b446a6e0
2020-04-01 17:30:55 -04:00
Tobias Henkel
b758ca594a
Keep error status in tox run
The line comments needs to run after the tox run so we set failed_when
to true. However this task won't be shown as failed in the log
then. Instead ignore errors to let the playbook continue and keep the
erorr status.

Change-Id: I6f2a4043de982aa3de6e0cc4eb489914fd5805c2
2020-04-01 21:42:03 +02:00
vass
146fe1f93f Do not end host if correct go version is installed
Otherwise ansible will skip the test of the playbook
if the correct go version is already installed.

Change-Id: Iaa481e91738ececbdb7db7fbbdf56b27ad5995db
2020-04-01 19:34:11 +02:00
Monty Taylor
47a04533a2 Check that a file exists for inline comments
keystoneauth has some unit tests which output lines like:

  stdin:5:1: K333  'from oslo import utils' must be used instead of 'from oslo import utils'.

The stdin isn't a file, but we try to report it back.
Pass in zuul_work_dir and use it to check that the "file"
is a file that exists.

Change-Id: I2c2aeb4e68f7d50f15ea6c6128fec6050d476c64
2020-04-01 11:58:38 -05:00
Monty Taylor
71838cf556 Add tox_envlist to the inline comment
To make it clear which tox command a given comment came from
in the case where more than one job has messages, prepend the
tox_envlist parameter to the inline message.

Change-Id: I70228baa285c4e676dc1348c354d4bbf3a3825bc
2020-04-01 11:16:12 -05:00
Monty Taylor
2fa3d6d3b2 Strip ansi codes from pep8 message
Sometimes pep8 messages have ANSI color codes, as here:

https://review.opendev.org/#/c/697636/10/cinder/tests/unit/volume/drivers/vmware/test_fcd.py@567

Which is pretty noisy in a gerrit comment. Strip them.

Change-Id: I494ec23d05b9df54e31ff8a2c568309b0a01f98a
2020-04-01 09:01:06 -05:00
Monty Taylor
e404589b84 Add flag for toggling inline comments for linters
Sometimes there are linters that are producing output where
people do not care about it enough to want to see it.

Change-Id: I0d58a3f6a4c51e1419b645a7ce1a81e6adee57d3
2020-04-01 09:01:06 -05:00