The Gatekeeper, or a project gating system
Go to file
Tobias Henkel 2b3a041e61
Don't call the merger for non-live items
When processing changes with dependencies in pipelines using the
independent pipeline manager we enqueue non-live items that represent
the dependent changes but don't run tests. Currently we perform a
merge operation also with every non-live item. Especially when
rebasing large stacks in Gerrit this can lead to a huge overhead of
merges. In this case we perform 1 + 2 + ... + n merges where n is the
size of the stack in Gerrit. E.g. a rebase of a stack of 20 changes we
perform 210 merge operations.

Those merges are needed to get the changed config of every item ahead
because we need the resulting config changes to produce a correct
layout. Fortunately the merger already returns a list of file changes
per item. We can leverage this to populate the changed files of all
non-live changes ahead when we receive the merge result of the live
change. This makes it possible to skip the merges of the non-live
changes ahead and have one merge operation per change.

In the rebase example above this optimization reduces the number of
performed merges from 210 to 20.

Change-Id: I82848367bd6f191ec5ae5822a1f438070cde14e1
2019-03-17 10:03:56 +01:00
doc Add missing doc for 'execute_time' in MQTT schema 2019-03-13 16:02:31 +01:00
etc Fix indent error for layout.yaml-sample. 2018-06-20 12:20:23 +08:00
playbooks Build zuul containers with dockerfile not pbrx 2019-01-24 16:11:31 +00:00
releasenotes/notes Merge "Remove default zookeeper hosts" 2019-03-12 01:16:11 +00:00
tests Don't call the merger for non-live items 2019-03-17 10:03:56 +01:00
tools Add dockerized test setup 2019-02-15 07:54:28 +01:00
web web: support more than one job in the filter 2019-03-14 17:16:15 +00:00
zuul Don't call the merger for non-live items 2019-03-17 10:03:56 +01:00
.coveragerc Revert "Revert "Switch to stestr"" 2018-05-17 08:33:40 -07:00
.dockerignore Add web/node_modules to dockerignore 2019-01-27 11:23:45 +01:00
.gitignore Fix ignored but tracked .keep file 2018-12-02 09:12:25 +01:00
.gitreview Updated .gitreview location 2012-12-16 20:34:13 +00:00
.mailmap Fix pep8 E127 violations 2012-09-26 14:23:10 +00:00
.stestr.conf Revert "Revert "Switch to stestr"" 2018-05-17 08:33:40 -07:00
.zuul.yaml Run tox-py35 jobs on xenial 2019-03-14 15:54:22 +01:00
COPYING Update README and add GPL license 2018-03-19 09:25:52 -07:00
Dockerfile docker: add state folder 2019-02-23 09:20:41 -05:00
LICENSE Initial commit. 2012-05-29 14:49:32 -07:00
MANIFEST.in Revert "Revert "web: rewrite interface in react"" 2018-10-06 10:42:31 -05:00
README.rst Add instructions for reporting vulnerabilities 2018-12-05 16:12:30 +00:00
TESTING.rst Revert "Revert "web: rewrite interface in react"" 2018-10-06 10:42:31 -05:00
bindep.txt Replace build-essential with gcc/g++ 2019-01-22 15:57:36 +00:00
requirements.txt Switch to LRU based sha to PR cache 2019-02-19 09:31:54 -08:00
setup.cfg Add line to setup.cfg limiting to python >=3.5 2018-10-12 14:54:51 -05:00
setup.py Partial sync with OpenStack requirements. 2013-09-25 15:30:37 -07:00
test-requirements.txt Cap mypy 2018-12-07 15:00:17 -08:00
tox.ini Add ignore_basepython_conflict option to tox.ini 2018-11-06 08:17:49 -06:00

README.rst

Zuul

Zuul is a project gating system.

The latest documentation for Zuul v3 is published at: https://zuul-ci.org/docs/zuul/

If you are looking for the Edge routing service named Zuul that is related to Netflix, it can be found here: https://github.com/Netflix/zuul

If you are looking for the Javascript testing tool named Zuul, it can be found here: https://github.com/defunctzombie/zuul

Getting Help

There are two Zuul-related mailing lists:

zuul-announce

A low-traffic announcement-only list to which every Zuul operator or power-user should subscribe.

zuul-discuss

General discussion about Zuul, including questions about how to use it, and future development.

You will also find Zuul developers in the #zuul channel on Freenode IRC.

Contributing

To browse the latest code, see: https://git.zuul-ci.org/cgit/zuul/tree/ To clone the latest code, use git clone https://git.zuul-ci.org/zuul

Bugs are handled at: https://storyboard.openstack.org/#!/project/openstack-infra/zuul

Suspected security vulnerabilities are most appreciated if first reported privately following any of the supported mechanisms described at https://zuul-ci.org/docs/zuul/user/vulnerabilities.html

Code reviews are handled by gerrit at https://review.openstack.org

After creating a Gerrit account, use git review to submit patches. Example:

# Do your commits
$ git review
# Enter your username if prompted

Join #zuul on Freenode to discuss development or usage.

License

Zuul is free software. Most of Zuul is licensed under the Apache License, version 2.0. Some parts of Zuul are licensed under the General Public License, version 3.0. Please see the license headers at the tops of individual source files.

Python Version Support

Zuul v3 requires Python 3. It does not support Python 2.

As Ansible is used for the execution of jobs, it's important to note that while Ansible does support Python 3, not all of Ansible's modules do. Zuul currently sets ansible_python_interpreter to python2 so that remote content will be executed with Python 2.