By default our apache mod mem cache tuneables are too conservative to
cache the zuul status.json. Bump the numbers to something reasonable for
the status.json file. This means increasing the total cache size and the
max object/stream sizes.
Change-Id: Icf6ad2591e67d5916efbd65ddf93379d2c3ffc69
Zuul is growing the ability to toggle yappi profiling on and off via
SIGUSR2. This will be an optional requirement so we need to install it
ourselves if we want it. Install it here.
Change-Id: I97086b9301e1801d4af2156e81dff3c385472333
There's no need to actually serve to-the-second accurate status.json
content. Cache it in Apache.
Closes-bug: 1326170
Change-Id: If3bc44b781ce4e12ac95d3929242ec0c912f0010
Doing this in python is teh suck on large status pages. Apache is
pretty good at it.
Partial-bug: 1326170
Change-Id: Iccee19dd6179f5a5f928fef43068d2450828fa0d
what i meant was that we can just copy the same mechanism we're using to
run the minifier, instead of using the file object with ensure=>link
Fixed bug #1325117
Change-Id: I10cf4b4772e8d3fff869bfd638b2895b6e8980ea
Python logrotate does not compress. Use logrotate utility to do log
rotation so that older logs can be compressed saving disk space.
Change python logging to use normal file handlers as it will no longer
be doing the rotation for us. Keep all the file names the same.
Change-Id: I7302e4b197e99fd49fd9d5678702333b17a46efa
Turns out that while keystoneclient does not require a tenant_name be
set swiftclient does require it so the fix to not pass a tenant_name to
zuul did not work.
Alex_Gaynor pointed out the reason using the normal tenant_name doesn't
work with Rax object store is that the tenant_name for object store in
Rax is different than the normal tenant_name. Use that different and
correct tenant_name instead.
Change-Id: I13d6b8dfc190d35178e7fc979d7feb58e7e1f8dd
When I1895c74f73e92bcacde132b71ec5798e8307db01 merges zuul's app.js
will be renamed to jquery.zuul.js.
When I1c6e12629db3e121b3513b0b1054ed1274ceb51f merges zuul requires
another file: zuul.app.js.
Change I2698207391307bc1021330cb123b756cb7f729ea moved inline css
into a styles/ directory.
Update the zuul module for these changes.
Change-Id: I98e788f03bf9e85a51ff38c42d7cba368319bd9e
This change adds credentials as set up by fungi (2014-04-05T03:16:46)
http://eavesdrop.openstack.org/irclogs/%23openstack-infra/%23openstack-infra.2014-04-05.log
This allows zuul to send signed URL's for workers to push files to on
a per-job basis.
This change will require a zuul restart, not just a reload!
Note this is unreverts the revert in
c1b98eaff618b8c739cc02f089ef6fe6c02cbcc3 but is slightly edited hence
the lack of a proper revert commit. The reason for the revert has been
debugged and was due to rax identity service not providing a catalog
entry for swift when a tenant name is provided.
Change-Id: I04d3207002f7422b9851515ee88a74b19dd2f248
This reverts commit 176f15cd48ceea7e990fc61362875a23524f963a.
Puppet and zuul aren't ready for this. The swift client throws an
exception. We need to restart zuul to fix a more pressing issue hence
this revert. Will debug when able to.
Change-Id: Ie4487d84b7f1495c7ec6fd31e4b5b90d6699a31d
Set the description of the zuul-merger.init to 'Zuul Merger' to
differentiate from the main zuul-server daemon.
Change-Id: I9ee914df0f98157b2710cbc2f9c29f7b41726273
If you attempt to include both Zuul and Jenkins master modules in a
single manifest, you will get an error about A2mod[rewrite] resource
already being declared, like so:
Duplicate declaration: A2mod[rewrite] is already declared in file
/home/ubuntu/os-ext-testing/puppet/modules/os_ext_testing/manifests/master.pp
at line 30; cannot redeclare at
/root/config/modules/zuul/manifests/init.pp:236 on node undef
This isn't noticed by upstream, because no server runs both a Jenkins
master and a Zuul server. However, in smaller systems, where both
Jenkins and Zuul can be installed on the same host, the problem becomes
apparent.
This patch fixes that issue by adding guards around the a2mod
declarations in the Zuul init.pp and Jenkins master.pp manifests.
Change-Id: I2a298eb09ec8da33caed9349f465b2d163e2c299
Closes-bug: #1281676
The following items were missing from an automated zuul install:
* A pre-populated known hosts file
* The git user/email for creating commits (.gitconfig existed
on zuul.o.o, but switch to using zuul's config file instead).
Also, make sure that the mergers specify the zuul server as the
gearman server address rather than localhost.
Change-Id: I47a473f60c4b5b2daaa910aa61cdf6e0c6fe1528
Remove obsolete config options from zuul module.
The server and merger classes are constructed so that they
may coexist on a single server. Also, the init section is
constructed so that it will install everything needed for
both services but without activating them (leaving maximum
flexibility for the operator).
Change-Id: I7b86fbbe4611c5edfb463a0a6944e0717f664188
Zuul was packing git refs weekly, do this daily instead to handle the
number of refs created by gate resets in large gate queues.
Change-Id: I8fc8c78436ebf79b457d392f1ce8de31b15c762c
The Zuul service opens a lot of TCP connections and files resulting in
many open file descriptors. The default limit of 2048 is bumped into
regularly. Bump the limit to 8192 when starting the Zuul service to give
it breathing room to grow into.
Change-Id: I9a3aee664c1c6c6139b012fc3dc0631725f59741
Ad a cron job to pack refs in zuul repos. Zuul creates _a lot_
of refs, packing them should make client git repo access more
efficient. Up to a point at least -- ultimately we may still
need to delete them later.
Change-Id: Iaf5180069b38833d6e25f6880e4868d5e2319b75
The pip vs. easy_install interactions continually get the systems
into a weird state. pip install $path_to_repo, on the other hand,
works like a charm.
Left out two graphite installs because they are doing path manipulation
and I want to do further testing before touching that.
Change-Id: I373b29aca03f1ebd20e533ebaaf5de9ef2db017e
We have a cgit server now, which means we should replace
all references to github with references to git.openstack.org.
Change-Id: I68ad1ce514fb4326c7d9940b5a84999af5b58562
Will take effect when Zuul is running this change:
I74702fd7d37358e6f4caa7e7ac0a3ede73184077
This change also adds that feature to the Zuul config and enables
it for OpenStack. It also adds the ability to specify HTML in a
commentlink (and uses it).
Change-Id: Idb4ad8e6079165d681271987a92cab5d8b7c81be
Previously, installing zuul resulted in the erros:
/usr/bin/python: No module named pip
This commit ensures that python-pip is always installed
before zuul is installed so that it can install
correctly.
Change-Id: I6d73a67e1fbb9eb077f39f99c45ceb4a00bc652b
Previously, the file resource did not have an
owner specfied, meaning that it defaulted to root:root.
This resulted in the following failure when starting the
zuul service:
IOError: [Errno 13] Permission denied: '/var/lib/zuul/test'
This commit ensures propoer ownership so that zuul can start.
Change-Id: I3ee9ae49097695632114ed6692c78ebf22a08823
Now that Zuul and Jenkins use Gearman we don't need to push Jenkins auth
details down into the zuul manifests. Removes these parameters and vars.
Change-Id: I744977f002eb9fb60c3392f0281ab033ffe2bb12
(This is only used by zuul-dev currently.)
Remove co-hosted gearmand server (will require manual cleanup).
Also, listen for feature/gearman events in openstack-infra.
Change-Id: I2dd58e62ff79277f1ef5c79da54bcc7511f2ccee
Reviewed-on: https://review.openstack.org/30175
Reviewed-by: Jeremy Stanley <fungi@yuggoth.org>
Reviewed-by: Clark Boylan <clark.boylan@gmail.com>
Reviewed-by: Monty Taylor <mordred@inaugust.com>
Approved: James E. Blair <corvus@inaugust.com>
Tested-by: Jenkins
On a zuul server, install the default status page as shipped by
Zuul (and its dependencies).
Remove openstack-specific redirects (hopefully it's been long enough
now).
Change-Id: Idfa2d9a4aa261182d166a36193fe74e1d922bcd9
Reviewed-on: https://review.openstack.org/29262
Reviewed-by: Clark Boylan <clark.boylan@gmail.com>
Reviewed-by: Paul Belanger <paul.belanger@polybeacon.com>
Reviewed-by: Jeremy Stanley <fungi@yuggoth.org>
Approved: James E. Blair <corvus@inaugust.com>
Tested-by: Jenkins
And connect it to the firehose.
Change-Id: Id860ff329e33a588d669608e5402bdb3765001dd
Reviewed-on: https://review.openstack.org/28742
Reviewed-by: Khai Do <zaro0508@gmail.com>
Reviewed-by: Clark Boylan <clark.boylan@gmail.com>
Reviewed-by: Monty Taylor <mordred@inaugust.com>
Approved: James E. Blair <corvus@inaugust.com>
Tested-by: Jenkins
Change-Id: I8374f389dc0a470a9e12b2987b3bd45dd07a9b74
Reviewed-on: https://review.openstack.org/27513
Reviewed-by: Jeremy Stanley <fungi@yuggoth.org>
Reviewed-by: Khai Do <zaro0508@gmail.com>
Reviewed-by: Paul Belanger <paul.belanger@polybeacon.com>
Reviewed-by: Clark Boylan <clark.boylan@gmail.com>
Reviewed-by: Antoine Musso <hashar@free.fr>
Reviewed-by: Monty Taylor <mordred@inaugust.com>
Approved: Monty Taylor <mordred@inaugust.com>
Tested-by: Jenkins
And update the status page to use common.js.
Redirect old zuul status urls to status.o.o.
Change-Id: I98e86eb78b70d5cbe53410919642f302e9709d19
Reviewed-on: https://review.openstack.org/25664
Reviewed-by: Clark Boylan <clark.boylan@gmail.com>
Approved: James E. Blair <corvus@inaugust.com>
Tested-by: Jenkins
Let setup.py install handle it instead.
Change-Id: I7f143dcc4c19af267ef820973184c45e2020a3de
Reviewed-on: https://review.openstack.org/25551
Reviewed-by: Monty Taylor <mordred@inaugust.com>
Approved: Jeremy Stanley <fungi@yuggoth.org>
Reviewed-by: Jeremy Stanley <fungi@yuggoth.org>
Tested-by: Jenkins
And allow zuul to send to statsd.
Change-Id: Ie9f78268a673523c4ea4025bdbbe40d8d3819398
Reviewed-on: https://review.openstack.org/18658
Reviewed-by: Jeremy Stanley <fungi@yuggoth.org>
Approved: James E. Blair <corvus@inaugust.com>
Tested-by: Jenkins
Since .html extensions are uncool.
Change-Id: I66ed8b6c43e7917d793ec372fac755e02b207c63
Reviewed-on: https://review.openstack.org/18552
Reviewed-by: Jeremy Stanley <fungi@yuggoth.org>
Approved: Monty Taylor <mordred@inaugust.com>
Reviewed-by: Monty Taylor <mordred@inaugust.com>
Tested-by: Jenkins