162 Commits

Author SHA1 Message Date
Zuul
ee2df08000 Merge "Make check_approval not require openstack_governance" 2020-01-10 14:15:49 +00:00
Zuul
2e99e0f951 Merge "Add wrapper script that can be used to update deliverables" 2020-01-09 18:41:47 +00:00
Sean McGinnis
bcb61fece9 Fix library shortname identification in announce script
Git repo origins are now removed in CI jobs, so our detection of project
short name from looking at the git remote now fails. This resulted in
release announcements linking to "null" instead of the actual project
location [0].

This updates the script logic to detect if that is the case and fall
back to getting the repo name from the directory, which should be safe
in a CI job since there is no manipulation of the clones repo directory
name.

Also cleans up an unused variable that was left from a previous
refactoring.

[0] http://lists.openstack.org/pipermail/release-announce/2019-December/008306.html

Change-Id: I84e2cf258e9bc4541b7edde55a22a4be24bdb232
Signed-off-by: Sean McGinnis <sean.mcginnis@gmail.com>
2019-12-20 12:33:40 -06:00
Thierry Carrez
53fba5642b Make check_approval not require openstack_governance
Since the job will have to run on the Zuul executor, it needs to
only rely on stdlib, yaml and requests (which are already installed
on the executor).

Change-Id: Id4e5a88d352e95402d0899deceade6fed8146619
2019-12-17 18:21:29 +01:00
Thierry Carrez
09e8ffb3b1 Introduce tool to check PTL/liaison approval
This is the first step into automating PTL/liaison approval.
This tool will check that PTL/liaisons either authored the change or
approved it.

Change-Id: I1bbb371997e9e92f39eff47adb4d3d176af35de7
2019-12-05 17:35:06 +01:00
Hervé Beraud
2064f3e29f Remove unused imports in tools and commands
For some non obvious reasons pep8 check doesn't detect these unused imports.

Change-Id: Ie98af5a0fcf4fb8bcd05051de75a84755fbc0b88
2019-11-27 17:45:34 +01:00
wangfaxin
8d3a0b0384 Fix ssh host addr link.
Change-Id: I2298ef11e15ce7ade4c232899df1c1d2225c9c5d
2019-11-20 18:16:54 +08:00
Tony Breeds
7045ff71b0 Add wrapper script that can be used to update deliverables
At various stages we want to update lots of deliverables.  This acts as
a tool to consolidate what we mean to supplement the docs and etherpad

Story: 2005707
Task: 31033

Change-Id: Ied1f6d06a33baf3d3ef3d789bbe5c7f70d967d62
2019-11-18 12:24:00 +11:00
Sean McGinnis
44d6736a5e
Be explicit about python3 executable
Per best practices, explicitly use the python3 executable rather than
assuming the platform with have a "python" executable that maps to
python3.

https://www.python.org/dev/peps/pep-0394/

Change-Id: I39b8a1013a891f4570f374d8faa3cfa2ecaf3347
Signed-off-by: Sean McGinnis <sean.mcginnis@gmail.com>
2019-10-16 09:45:29 -05:00
Sean McGinnis
73d6e8b1a0
Update lib release instructions for freeze
This updates the instructions for client and non-client lib freeze to
make sure all changes are captured in a final release. Also adds a
helper tool to separate out the two types of libs since they have
different deadlines.

Change-Id: I29ea73bcc5a9649d7d9c502ebc0a05c840e41484
Signed-off-by: Sean McGinnis <sean.mcginnis@gmail.com>
2019-09-19 16:04:06 -05:00
Sean McGinnis
123864e507
Fix bashate errors
Running our default tox environments locally, the bashate tests fail
with several errors due to line length and indentation levels.

Change-Id: I15ec6a9cb1dbdb2200294c5aa2d2eb6074f00a25
Signed-off-by: Sean McGinnis <sean.mcginnis@gmail.com>
2019-07-08 11:46:30 -05:00
melissaml
e700061762 Rename review.openstack.org to review.opendev.org
There are many references to review.openstack.org, and while the
redirect should work, we can also go ahead and fix them.

Change-Id: I0d46b1a4e00c1775ea5e38d39e87bed99f6bbb2e
2019-05-12 04:33:25 +08:00
Sean McGinnis
8b1a9ada18 Add script to transition entire series to EM or EOL
Probably mostly useful for extended maintenance, but this adds a script
that can add a $series-em tag to all deliverables of a series as we
claimed we would do in the extended maintenance policy changes [0].

[0] https://docs.openstack.org/project-team-guide/stable-branches.html#extended-maintenance

Change-Id: Ibeec88bf4e81b97c523f416669e07a10aa86a53b
Signed-off-by: Sean McGinnis <sean.mcginnis@gmail.com>
2019-04-11 06:44:55 -05:00
Doug Hellmann
915a9a9d33 add a tool to show changes in rc-based repos
Simplify the instructions by providing a special script and then
update the instructions to refer to it.

Change-Id: Ibbcd422c06dc4aeb3df503f3c0f084b39d3bf0f7
Signed-off-by: Doug Hellmann <doug@doughellmann.com>
2019-03-27 13:54:24 -04:00
Zuul
e1b557915a Merge "Fix announce email paths" 2019-03-27 11:00:33 +00:00
Sean McGinnis
ba0843c051
Fix announce email paths
Our announce email included a few errors in the paths provided. If the
git remote.origin.url ended with ".git" the tarball path was wrong. We
were also using the package name for git and doc paths incorrectly. This
fixes the name used so the resulting links are correct.

Story: #2005279
Task: #30131

Change-Id: I7a64761778b7391c0f3188b1177f03a7e712bd2a
Signed-off-by: Sean McGinnis <sean.mcginnis@gmail.com>
2019-03-25 11:20:13 -05:00
Ian Wienand
8c030f0eaf Replace openstack.org git:// URLs with https://
This is a mechanically generated change to replace openstack.org
git:// URLs with https:// equivalents.

This is in aid of a planned future move of the git hosting
infrastructure to a self-hosted instance of gitea (https://gitea.io),
which does not support the git wire protocol at this stage.

This update should result in no functional change.

For more information see the thread at

 http://lists.openstack.org/pipermail/openstack-discuss/2019-March/003825.html

Change-Id: I648dbeadf4ff11e3d9f23521be530b36186927d9
2019-03-25 08:27:17 -04:00
Doug Hellmann
3f24d9dd78 look at teams in the branch being scanned
Teams come and go, so we want to iterate over the set of teams in the
branch that we are scanning for unreleased changes instead of assuming
the group from ocata is correct.

Change-Id: Iacf3933cbfc14f9a3e7b404171247108c27083f3
Signed-off-by: Doug Hellmann <doug@doughellmann.com>
2019-03-14 08:43:57 -04:00
Előd Illés
e577664cdd Put the lists under a directory
With this script now the txt files with the lists are stored under
<releas>-<date>-<time> directory.

Also small modification to show the links and commit messages of the
open changes in one line.

Change-Id: I3563445e7693448b3308ef4df8739532d1fc3f99
2019-03-12 20:06:17 +01:00
Jean-Philippe Evrard
196c4f2df2 Use env python instead of /usr/bin/python
If running with tox venv, the python version (where all the
requirements are installed) might be different than /usr/bin/python.

We should use the one in the env.

Change-Id: Ic69282b289fefeafa5a63b6da284f44c4b3c4b15
2019-03-04 20:20:59 +01:00
Zuul
8262f18660 Merge "Allow user to generate urls for the given results." 2019-02-07 10:29:40 +00:00
Zuul
b94c3c119d Merge "Skip repos if not handled by release management" 2019-02-06 22:12:03 +00:00
Hervé Beraud
6b3259ee21 Allow user to generate urls for the given results.
Introduce the flag `--url` who allow user to generate urls
for the given result.

Introduce the option `--distgit` to allow user to specify
the base url to use to generate urls.

Change-Id: I10d4f92f64a68f283c70c2c880c27a069f123762
2019-02-01 15:10:23 +01:00
Zuul
a806227734 Merge "Improve script by counting results found." 2019-02-01 13:52:19 +00:00
Hervé Beraud
062f3a2ddc Improve script by counting results found.
Display the number of results at the end of the output.

Change-Id: Ic603c8557dbf8c8436d64f3910c0e0cf3d86ea84
2019-02-01 10:52:23 +01:00
Thierry Carrez
c1b2b78b07 Skip repos if not handled by release management
Leverage the newly-introduced 'release-management' key from
projects.yaml to skip repositories in deliverables that are
not handled by the release-management team.

No longer maintain a local list of repository exceptions.

Change-Id: I0e5eab7a2aeb3bd09acf7bf01356a9f664530b0f
2019-01-31 16:43:18 +01:00
Hervé Beraud
bd589e76e3 Allow users to format output results to the yaml format.
Allow users to format output results to the yaml format
by using the flag --yaml.

Passing this flag prefixing each results with dash in the stdout.

Change-Id: I460c17704c5311d6fb422d5e56be8080344ab986
2019-01-31 16:34:10 +01:00
Thierry Carrez
50258742c9 Add script to facilitate MembershipFreeze handling
This script will compute a list of deliverables present in
governance but unknown to release management, for manual
processing.

Change-Id: Ibebf777911416d978ecea5ba8d7b25b211e7ae52
2019-01-16 22:34:21 +01:00
Doug Hellmann
510e8c9a5d add a script to get a list of unreleased changes for a team
Change-Id: I061cea61dd5d0a7711faae9e06809993caf36de9
Signed-off-by: Doug Hellmann <doug@doughellmann.com>
2018-11-19 12:57:18 -05:00
Sean McGinnis
32afc4160d Update tooling to support cycle-with-rc model
This updates commands and tools to work with the cycle-with-rc model.

Change-Id: I8df85df1c84ae6d8fb37a5206e155f84f8fac947
Signed-off-by: Sean McGinnis <sean.mcginnis@gmail.com>
2018-10-24 08:41:13 -05:00
Előd Illés
8f3f2bb96c Script to list unreleased and open changes
This script helps to check unreleased and open changes of every teams
(and every repositories that has stable:follow-policy tag) for doing a
'final release' before moving the projects to Extended Maintenance
state.

Change-Id: Ifc0099a2392f85f16e76aaa416c6fd8abe9a26af
2018-09-21 14:45:30 +02:00
Zuul
5397fbf1b9 Merge "Fix py3 issues with aclissues script" 2018-08-17 09:23:00 +00:00
Sean McGinnis
47c4ede8e2 Add pruning in validation cloning
The gate keeps a local cache of repos that will not reflect things like
the manual deletion of refs such as incorrect branches. In order for the
validation to pass before the cache is rebuilt, we need to prune the
repo to pick up those deletions.

Change-Id: I25848275f90ec440e85765f87a23cd1413aab6cb
Signed-off-by: Sean McGinnis <sean.mcginnis@gmail.com>
2018-08-16 12:05:19 -05:00
Sean McGinnis
7cb17cc296
Fix py3 issues with aclissues script
This code was using the remove iteritems() call. Updated to just call
items() instead.

Change-Id: I29bff1a6a4e9be8e11d5411de227da0c3fa83447
Signed-off-by: Sean McGinnis <sean.mcginnis@gmail.com>
2018-08-14 09:39:00 -05:00
Sean McGinnis
3ccab7c6d0
Remove unused --etherpad opt from list_weeks
Change I3cc38afd80eb41200c7269a3039e87f01156eaab switched this tool to
generate a yaml file for driving the release schedule page. That also
removed the ability to generate an etherpad formatted output, but the
option was not removed. This cleans up the unused option.

Change-Id: I2e1b8dcb92239e891ac27af8a503f901c835c808
Signed-off-by: Sean McGinnis <sean.mcginnis@gmail.com>
2018-08-06 16:35:48 -05:00
Sean McGinnis
1aa9607e0a
Fix bashate errors
A few errors were causing the bashate job to fail. This corrects those
errors and also addresses the reported warnings for a clean build.

Change-Id: Ibc5c4f006d264e2f0a4c1b8186b5e313d2905561
Signed-off-by: Sean McGinnis <sean.mcginnis@gmail.com>
2018-07-30 14:56:05 -05:00
Sean McGinnis
4ac5e3f89a
Use --force when checking out commits
The clone_repo script clones the repo if needed and then checks out the
commit, branch, or master. If a previous checkout has left untracked
files, this will fail to protect those files from being overwritten.

In our automation we do not need to care about untracked files and need
to make sure we have the right point in the tree, so force the checkout
to make sure these untracked files are ignored.

Change-Id: Ia1ec2869aa7a899e987ef43a11f0af627efeea65
Signed-off-by: Sean McGinnis <sean.mcginnis@gmail.com>
2018-07-25 09:17:15 -05:00
Sean McGinnis
7f2ab71663 Remove Rally from aclfixer exceptions
ACLs are being updated for rally, so we can stop
including them as an exception for acl checks.

Depends-on: https://review.openstack.org/575130
Change-Id: I13abbf1e4d75afcc540d3e82904cbc0391154b4a
2018-06-29 14:13:11 +02:00
Thierry Carrez
fa30fbe25e Report ACL violations as issues by default
By default, the tool should report ACL violations rather than
fix them in place. Add a --patch option to explicitly ask to
fix the ACL files in place.

Rename tool to aclissues.py to better reflect what it does by
default (report issues instead of fixing them).

Change-Id: I04744746b6492a1f3ab0790ebb565235f292caf9
2018-06-27 18:29:47 +02:00
Thierry Carrez
8ba7eb9608 Remove manila from aclfixer exceptions
Manila repositories were fixed in:
https://review.openstack.org/578381

Depends-On: https://review.openstack.org/578381
Change-Id: I935be2d91d3ee0df5db27e1d3c1d36cd94f7b6a8
2018-06-27 18:29:21 +02:00
Thierry Carrez
082bec74fc aclfixer.py: Remove swift-bench from exceptions
ACL for swift-bench was fixed in:
https://review.openstack.org/#/c/575071/

Change-Id: I06c525f8ae97b9217340d6df740ec66bc67263b5
2018-06-22 14:31:37 +02:00
Thierry Carrez
8306df6759 aclfixer.py: Document standing exceptions
Deliverables under TC governance should have their release
process handled by the Release Management team. However, there
are a number of exceptions to the rule: deployment tools may
have their artifacts released using an ecosystem-specific
toolchain. Some teams might be in the process of leaving TC
governance and adjusting their ACLS would be counter-productive.

Change-Id: Ia304de2eea2364a990b17343879fe26b904706e1
2018-06-20 16:20:29 +02:00
Thierry Carrez
d0cb7b9698 aclfixer.py: Remove murano-apps from exceptions
ACL for murano-apps was fixed in:
https://review.openstack.org/#/c/575074/

Change-Id: I39e94544a01e102c357d27271572016f57b632f3
2018-06-20 16:17:29 +02:00
Thierry Carrez
5a183c9e87 aclfixer.py: Remove heat-cfntools from exceptions
The heat-cfntools repository ACL was fixed in:
https://review.openstack.org/#/c/575072/

Change-Id: I338d7f8e87d334cc1239fa3bc721aa53136c6bd3
2018-06-20 16:17:29 +02:00
Thierry Carrez
951f017934 aclfixer.py: Remove exceptions for TripleO repos
Once the depends-on mergesm we no longer need an exception
for tripleo-ci and dib-utils repositories.

Depends-On: https://review.openstack.org/573728
Change-Id: Ia9ec0027cd9a4e9671f86c4bed53496d61909793
2018-06-20 16:17:29 +02:00
Sean McGinnis
4686746bfd Remove DragonFlow from aclfixer exceptions
ACLs are being updated for dragonflow, so we can stop
including them as an exception for acl checks.

Depends-on: https://review.openstack.org/573772
Change-Id: I3ca69f604533f4b3746b7c412c9f1a1ccb6a8646
2018-06-13 09:41:40 -05:00
Thierry Carrez
a304aa7f7a aclfixer.py: Redundant entry for diskimage-builder
Remove redundant entry for diskimage-builder, which is part
of the Infrastructure team.

Change-Id: I98b1ed95a3297d309a9abd8f455c4063566cdb47
2018-06-08 16:09:48 +02:00
Thierry Carrez
ad388cc755 aclfixer.py: Remove QA repos from exception list
QA repos are fixed in the depends-on change.

Depends-On: https://review.openstack.org/572750
Change-Id: I27f8a448197a702dfbc5e90640a6427e4f983048
2018-06-06 14:21:18 +02:00
Thierry Carrez
83f5fb5f92 Remove PowerStackers, yaql from aclfixer exceptions
ACL for PowerStackers was fixed.
ACL for yaql is fixed in the Depends-On.

Depends-On: https://review.openstack.org/572065
Change-Id: Id03dfef052a88c161fb043b81907e51041649156
2018-06-04 11:44:04 +02:00
Thierry Carrez
7edce62dec Update list of broken ACLs to fix
aclfixer.py keeps track of ACL fixes we still need to do.
Since last check, EC2API was fixed.

A new violation was detected in puppet-pacemaker but is
fixed in the Depends-On.

Depends-On: https://review.openstack.org/571770
Change-Id: I8701e4fdbb6578912ebf6fdb8d75ba3189be31fb
2018-06-01 17:58:28 +02:00