Commit Graph

93 Commits

Author SHA1 Message Date
Zuul
03ee1a5039 Merge "update list_library_unreleased_changes.sh to include client libraries" 2018-01-31 13:11:25 +00:00
Doug Hellmann
59eb078704 update list_library_unreleased_changes.sh to include client libraries
Change-Id: Ib0a3172960c389a34c470536ed47ef44d6b71271
Signed-off-by: Doug Hellmann <doug@doughellmann.com>
2018-01-29 19:32:51 -05:00
Doug Hellmann
186a2bed5a add a script to build zuul commands to reenqueue jobs
This script only generates the commands as a convenience, we still
need someone with infra-root privileges to run them.

Change-Id: I9870230509ad9f532f486b0682786d136ded798a
Signed-off-by: Doug Hellmann <doug@doughellmann.com>
2018-01-26 16:27:08 -05:00
Thierry Carrez
517d2bcdce Alpha-order the specific stable section
ACL files changes are now checked for normalization.
Fix aclmanager so that it inserts the stable specific
section at the right place in the file.

Change-Id: Ieeb226645616d7db108336084022eb18347f1409
2018-01-09 18:22:03 +01:00
Thierry Carrez
8728ab60b8 Ignore release-test in aclmanager
The openstack/release-test repository ACL gets picked up by
aclmanager when it updates ACL. Add it to the exceptions list,
and make sure that the list is actually used.

Change-Id: I7735898f53eafca15a8b4bb19459c576dc254d4e
2018-01-09 16:11:01 +01:00
Doug Hellmann
1f1b9faacb fix command handling in tox-log-command.sh
Exit with an error if the pipeline produces an error and run the correct
command rather than the part of the command name used for the output
filename.

Change-Id: I0754ab219983cad3eb8dae327a5435d094f8cf85
Signed-off-by: Doug Hellmann <doug@doughellmann.com>
2017-12-06 16:39:25 -05:00
Doug Hellmann
248aca1a48 log yamllint output to its own file
Adjust the tox log wrapper so it works with the full path to the
script for running yamllint, then add it to the step for running
yamllint so the results are logged to a separate file.

Change-Id: I98561e17e4fa76aeee9adfd57d9e71a7f229e536
Signed-off-by: Doug Hellmann <doug@doughellmann.com>
2017-12-05 23:38:14 -05:00
Doug Hellmann
134df26a30 add -v option to clone_repo.sh
Do not show set -x output by default, but provide an option to enable
it.

Change-Id: Idba91c635ce179ce07945a6dc519e72e667b9463
Signed-off-by: Doug Hellmann <doug@doughellmann.com>
2017-11-13 12:17:36 -05:00
Doug Hellmann
178cc689aa log the output of list-changes to a separate file for easier reading
Having the rather complex output of list-changes mixed in with the
main job log can make it difficult to read. Continue to include the
data in the main log file but also write it to a separate file that is
easier to consume.

Change-Id: If4d3b56c76b2bf513b2d44ffedf5825f562f4bfb
Signed-off-by: Doug Hellmann <doug@doughellmann.com>
2017-10-25 19:08:51 -04:00
Sean McGinnis
2d2efc4f73 Default clone_repo to master if branch not found
Behavior change from set -e causes attempt to checkout an invalid
branch to fail. Explicitly fall back to master if the requested
branch name checkout fails.

Change-Id: I5d1f6a997375743bb3498e7fae1fbad19c307d33
2017-10-20 06:16:11 -05:00
Doug Hellmann
b57a8522ae remove redundant git operation
git fetch and git remote update do the same work, and there is no need
to do it twice. Keep the fetch command since we can explicitly tell it
to pull down tags.

Change-Id: Iac1602ebe7a1a67ad5fecb599cde21f2a312fff4
Signed-off-by: Doug Hellmann <doug@doughellmann.com>
2017-10-17 17:53:06 -04:00
Doug Hellmann
0246da6a2a fix branch/series handling in list_library_unreleased_changes.sh
The old logic was passing "master" as the series to list-deliverables,
which is wrong because the series name for the master branch will
always be a release series and not "master".

Change-Id: I3e595ac84332e0903941deed23d3a19dd23f2f93
Signed-off-by: Doug Hellmann <doug@doughellmann.com>
2017-10-17 15:24:30 -04:00
Doug Hellmann
34756ddbdf replace the use of zuul-cloner with a shell script
Under zuulv3 the behavior has changed significantly to now require
specifying which repositories need to be cloned for each job, and
zuul-cloner only copies the repositories that are already
available. As soon as zuulv3 is released, our jobs relying on the old
fallback behavior of checking out from a cache when present but using
the upstream server in other situations will fail.

The new script tools/clone_repo.sh handles the cases we have in the
tools and jobs within this repository, and should also be usable from
the tag-releases job.

zuul is removed from the list of requirements so it is no longer
installed when jobs run under tox.

list_unreleased_changes.sh is updated to drop the use of the
virtualenv, which was only present for zuul-cloner.

The other updates in the patch are to change the tools to use the new
script.

Change-Id: Ic559d27881a9a89fb0dcb5295a4d7ed7c578112f
Signed-off-by: Doug Hellmann <doug@doughellmann.com>
2017-10-17 15:24:30 -04:00
Doug Hellmann
87d5618d51 update import_branch_points.sh to use edit-deliverable
Change-Id: I9795058d0d035e40b1359caee1d7dca7721629a3
Signed-off-by: Doug Hellmann <doug@doughellmann.com>
2017-08-01 16:31:11 -04:00
Doug Hellmann
08e0000034 add deliverable argument to discover_branch_points.py
Change-Id: Ibdc7f32fd1ccdfc63858e2243adffc3cd54204ce
Signed-off-by: Doug Hellmann <doug@doughellmann.com>
2017-08-01 16:31:11 -04:00
Doug Hellmann
8367ba7320 teach edit-deliverable to add stable branch data
Refactor edit-deliverable to use sub-commands and then add one for
adding the stable branch to a deliverable based on the version.

Change-Id: I939592591ddbf54bc4a2ef239912a09fd5c42d7e
Signed-off-by: Doug Hellmann <doug@doughellmann.com>
2017-08-01 16:31:11 -04:00
Doug Hellmann
62241c3755 use edit-deliverable in script to set the release notes URLs
Change-Id: Iff9aedb2faf888a5440e54b0a889140676e50f7b
Signed-off-by: Doug Hellmann <doug@doughellmann.com>
2017-07-31 17:34:38 -04:00
Doug Hellmann
baf36c6230 remove obsolete tool script for adding team names
Change-Id: I819957b86294c515a8ea1526f12ac44fd2a50ad1
Signed-off-by: Doug Hellmann <doug@doughellmann.com>
2017-07-31 17:26:33 -04:00
Doug Hellmann
8477f4fde9 add wrapper for yamllint
We don't need to run the linter over every single old deliverable file
every time. Just check the "modern" series that are most likely to
be open, and the _independent projects.

Change-Id: I5207600838c37b241d0ab178080be75a8f31a725
Signed-off-by: Doug Hellmann <doug@doughellmann.com>
2017-07-31 17:11:02 -04:00
Doug Hellmann
f87b521e7a add the pike release date to the history importer
Update the tool for importing existing repositories so it knows when the
pike release is.

Change-Id: Ie41ba303d53f819d924567baf2f3700e134c0218
Signed-off-by: Doug Hellmann <doug@doughellmann.com>
2017-05-25 16:07:50 -04:00
ChangBo Guo(gcb)
d1284d6750 Don't need 'git review -s' when clone repository
There is no need to initialize gerrit related stuff, and 'git review -s'
uses ssh way to connect gerrit, which doesn't work for some users. So
just drop it.

Change-Id: I68a8f32569d8d41cd9b413a5c5a2e5577b5fdbd0
2017-05-22 11:08:03 +08:00
Doug Hellmann
c15c197f6e make tag_history_from_git.py work under py3
Change-Id: Id114c9d6b9f946f552226c2f112dd9584b3d451b
Signed-off-by: Doug Hellmann <doug@doughellmann.com>
2017-05-16 10:43:49 -04:00
Thierry Carrez
105dd6d1e8 aclmanager: do not keep old stable sections around
When patching ACL files, rather than just add a section for
stable/$newseries, we should also delete old stable/$series
sections. Otherwise around $newseries release time,
stable/$series would be owned by release managers again.

Change-Id: I1fdc8e370f0f56df54ba27736046d7d6893ca240
2017-03-21 16:47:39 +01:00
Jenkins
2f40d76edf Merge "decode command output in discover-branch-points" 2017-03-13 12:18:02 +00:00
Jenkins
facf3b2c84 Merge "remove unused tool with launchpadlib dependency" 2017-03-13 12:14:34 +00:00
Jenkins
56ab3fbfda Merge "add a summary report for inactive projects" 2017-03-06 16:33:00 +00:00
Jenkins
247d1e5f4d Merge "script to report on unreleased changes of deliverables with no releases" 2017-03-06 16:30:04 +00:00
Jenkins
c6b5af4a0b Merge "import list_stable_unreleased_changes.sh from release-tools" 2017-03-06 16:29:59 +00:00
Jenkins
2870614b98 Merge "import list_library_unreleased_changes.sh" 2017-03-06 14:35:27 +00:00
Jenkins
bd125c895d Merge "import a version of list_unreleased_changes.sh" 2017-03-06 14:35:19 +00:00
Doug Hellmann
e7a1bce84e decode command output in discover-branch-points
Change-Id: I2d9027afbec86a260f99d38c78b71cefc50d44f6
Signed-off-by: Doug Hellmann <doug@doughellmann.com>
2017-03-03 15:00:04 -05:00
Doug Hellmann
42e8a6fd7f remove unused tool with launchpadlib dependency
The only reason we have a dependency on launchpadlib and
lazr.restfulclient is for the old tool that imported project history
from launchpad. We no longer need the tool, so we can remove it and the
dependency as part of our python 3 port.

Change-Id: Ie87e6172c953df10cb70d34c9bc23ad30e97ce4d
Signed-off-by: Doug Hellmann <doug@doughellmann.com>
2017-03-03 14:59:59 -05:00
Doug Hellmann
f978087581 make tag history importer more robust
If we get a validation error, report it and skip the version.

Change-Id: Id2117405d10efaaa74cf23faa8720e9f66c5eb00
Signed-off-by: Doug Hellmann <doug@doughellmann.com>
2017-03-01 08:42:19 -05:00
Jenkins
10d3a3e147 Merge "add tool for verifying late releases are on the right branch" 2017-02-25 18:32:49 +00:00
Tony Breeds
f0ce5c0ebc Add a series argument to tag_history_from_git
When importing history for an independant project currently
tag_history_from_git will create the file in
deliverables/UNKNOWN/$project.yaml.  Add a series argument so the file
can be created in the correct directory.

Change-Id: I22c840d1b46624bfdef8add09718c4dc4e489917
2017-02-23 10:44:25 -05:00
Tony Breeds
86f8077fca Add release date for ocata
Change-Id: I6e5e30100a09835444895ab9c6bafc0d3de8f7b3
2017-02-23 10:42:02 -05:00
Doug Hellmann
4ee77e9dcd reduce meaningless changes when updating release notes links
If the existing link matches the expected link, leave it in place
regardless of where it is in the file.

If the link needs to be updated, try to insert the link after the
"team" entry, assuming that will be closer to the top of the file
than "releases" and avoiding the need to figure out if "branches" comes
before or after "releases".

Change-Id: I4161bb048deba91ccf8170ea5f0b7208bd9a80a3
Signed-off-by: Doug Hellmann <doug@doughellmann.com>
2017-02-16 14:14:18 -05:00
Doug Hellmann
2c1d1be7e4 use https for release notes urls
Change-Id: I5479680a384666c9dee25fe10740426a420011f3
Signed-off-by: Doug Hellmann <doug@doughellmann.com>
2017-02-16 14:14:18 -05:00
Doug Hellmann
76fd047daf add a summary report for inactive projects
Change-Id: I1ab01685e8bd547840650f2608d9ea0c29dc8f56
Signed-off-by: Doug Hellmann <doug@doughellmann.com>
2017-02-08 17:47:47 -05:00
Doug Hellmann
14e3d6e749 script to report on unreleased changes of deliverables with no releases
The script creates a separate output file for each team because
combining all of the data into one makes it to big to post on a
pastebin.

Change-Id: Ie5bfb0df225378e658ebb3c5d57d55d0dff7aca6
Signed-off-by: Doug Hellmann <doug@doughellmann.com>
2017-02-08 17:44:26 -05:00
Doug Hellmann
d987f2ca11 import list_stable_unreleased_changes.sh from release-tools
Change-Id: Ibef585f5a6fb427a073fe069ab47db992a80f120
Signed-off-by: Doug Hellmann <doug@doughellmann.com>
2017-02-08 15:48:50 -05:00
Doug Hellmann
ecde878e31 import list_library_unreleased_changes.sh
Change-Id: I8fd0895ff830a5a0d7e7076ba167d19abf46d194
Signed-off-by: Doug Hellmann <doug@doughellmann.com>
2017-02-08 15:31:24 -05:00
Doug Hellmann
2db25fc9e8 import a version of list_unreleased_changes.sh
Use a version of list_unreleased_changes.sh that does not rely on the
release-notes command from the release-tools directory.

Change-Id: Ifab8585a3707927d224ee223a551167cced05261
Signed-off-by: Doug Hellmann <doug@doughellmann.com>
2017-02-08 15:30:37 -05:00
Doug Hellmann
1a66ac1929 add tool for verifying late releases are on the right branch
We had at one case where the release validation logic failed to catch a
release from master after the stable/ocata branch was created for
mox3. This script looks at the other "late" releases, created after a
branch, and verifies that they are all on the correct branch.

Change-Id: Ie148a34efa029e6715db099f7e5c9575ed94238d
Signed-off-by: Doug Hellmann <doug@doughellmann.com>
2017-02-07 11:08:44 -05:00
Doug Hellmann
31ea2d605e add more detailed output to aclmanager
Print the names of the files we expect to be updating for each project
as they are found, since some repositories may use the same file for
permission settings.

Change-Id: I1a18d6916b99c6c5ce55306a6d9d13ecac4973bd
Signed-off-by: Doug Hellmann <doug@doughellmann.com>
2017-01-10 11:46:50 -05:00
Doug Hellmann
b0e5ba6e7e update aclmanager to use default series argument
Instead of requiring the series argument, look at the default that the
rest of the scripts use. There is still a command line option for
overriding the default.

Change-Id: I7168b4786ac8f275da1ff0cd177268b3a4c20c17
Signed-off-by: Doug Hellmann <doug@doughellmann.com>
2017-01-09 10:06:07 -05:00
Doug Hellmann
319f8cd41e fix aclmanager groups subcommand
Update the portion of aclmanager that modifies the gerrit groups to pull
the list of repositories properly.

Change-Id: Ib4b78de738517e9d6bd9176a9e4ad61203f22036
Signed-off-by: Doug Hellmann <doug@doughellmann.com>
2017-01-09 09:57:03 -05:00
Doug Hellmann
c22f58ae3b move aclmanager.py from release-tools repo
The aclmanager script needs to be able to get a list of repositories
with the cycle-with-milestone release model, and the data for that lives
in this repository now instead of the governance repository. Rather than
having a tool that relies on this data live in release-tools, move it
here.

Change-Id: I7c2c54c4949829aea92e569e3ac9ec9007d932ed
Signed-off-by: Doug Hellmann <doug@doughellmann.com>
2017-01-09 09:40:59 -05:00
Doug Hellmann
e06d8ad2f4 update list_weeks tool to build YAML file
Instead of building the RST table, build a YAML input data file to be
used with the new schedule rendering template. The results will have to
be edited by hand, but we at least get the dates and fixed events
included for free.

Change-Id: I3cc38afd80eb41200c7269a3039e87f01156eaab
Signed-off-by: Doug Hellmann <doug@doughellmann.com>
2017-01-04 11:40:06 -05:00
Doug Hellmann
d4dfecad2f provide a tool to import existing stable branch info
Find the versions for which the stable branches were created and update
the deliverable files with the historical info.

Change-Id: Idb233e0ec78f2b7ea0f07d596d6452786f725315
Signed-off-by: Doug Hellmann <doug@doughellmann.com>
2016-12-06 09:20:48 -05:00