Zuul has a content-addressable blobstore in ZooKeeper. We use it for storing secrets, because they can be quite large, and many of them are the same for many (or every) queue item, so we rely on the deduplication inherent in content-addressable storage to keep ZK traffic and storage minimal. The same (with a few tweaks) could be true for repo state objects as well. The repo state is a dictionary of connection -> project > refs. Queue items with exactly the same set of involved projects should end up with identical repo states (assuming they were started around the same time and a branch has not since advanced). But queue items may not have exactly the same projects; they may share a common set, but then one might have one extra project. To promote reuse while accommodating this, we will store per-project repo states in the blob store. The queue items will then store a list of blobstore keys. When we need to deal with the repo state for a queue item, we will load in all of the project-repo-states specified by that list of keys and combine them. Likewise, when we update a repo state with the results of a merger operation, we will split the repo state when storing it in the blob store. Change-Id: I2b276a072b48b91dec66d2f8e601a2b5c9128429
Zuul
Zuul is a project gating system.
The latest documentation for Zuul v3 is published at: https://zuul-ci.org/docs/zuul/
If you are looking for the Edge routing service named Zuul that is related to Netflix, it can be found here: https://github.com/Netflix/zuul
If you are looking for the Javascript testing tool named Zuul, it can be found here: https://github.com/defunctzombie/zuul
Getting Help
There are two Zuul-related mailing lists:
- zuul-announce
-
A low-traffic announcement-only list to which every Zuul operator or power-user should subscribe.
- zuul-discuss
-
General discussion about Zuul, including questions about how to use it, and future development.
You will also find Zuul developers on Matrix <https://matrix.to/#/#zuul:opendev.org>.
Contributing
To browse the latest code, see: https://opendev.org/zuul/zuul To clone the latest code, use git clone https://opendev.org/zuul/zuul
Bugs are handled at: https://storyboard.openstack.org/#!/project/zuul/zuul
Suspected security vulnerabilities are most appreciated if first reported privately following any of the supported mechanisms described at https://zuul-ci.org/docs/zuul/user/vulnerabilities.html
Code reviews are handled by gerrit at https://review.opendev.org
After creating a Gerrit account, use git review to submit patches. Example:
# Do your commits
$ git review
# Enter your username if prompted
Join us on Matrix to discuss development or usage.
License
Zuul is free software. Most of Zuul is licensed under the Apache License, version 2.0. Some parts of Zuul are licensed under the General Public License, version 3.0. Please see the license headers at the tops of individual source files.
Python Version Support
Zuul requires Python 3. It does not support Python 2.
Since Zuul uses Ansible to drive CI jobs, Zuul can run tests anywhere Ansible can, including Python 2 environments.