169 Commits

Author SHA1 Message Date
Clark Boylan
45da85124f Use pip install -r not -f to install extras
The pip install -f flag is for find-links which is a list of locations
to look for python packages. What we hvae at this path for extras
installation is a list of packages themselves not locations to find
them. We need to use the -r flag for requirements lists to specify this
instead.

This change should update our zuul and nodepool images to include useful
debugging extras.

Change-Id: I647bb835d0c85c3772e1593866a54cfc5ea1db2f
2020-08-03 10:26:30 -07:00
Clark Boylan
089426420c Upgrade Gitea to v1.12.3
This is an incredibly minor update and the templates don't seem to
change at all. But its still a good idea to keep up as much as possible.

Change-Id: I7afcd741bfea056f34dacca65512c86949539340
2020-07-30 16:20:31 -07:00
Clark Boylan
fd6e0ec09e Noop update to force python-builder/base to rebuild
We want these to rebuild to push up multiarch images. I couldn't come up
with a good actual change so I added a . to a comment instead.

Change-Id: I287fee62075bc124ea7d9cc51baaeecdc0e73c6c
2020-07-17 16:17:22 -07:00
Clark Boylan
43778c9f19 Patch etherpad console logging to fix cross origin error
Etherpad 1.8.4 added console logging that breaks iframes like those used
by meetpad when logging. THis means many etherpads work fine and only
have an issue when logging is tripped.

We fix this by adding patch files based on the upstream fix,
00b6a1d9fe,
cherrypicked to 1.8.4 and then diffed. The reason we don't just use git
is that while the installation in the upstream image is a git repo there
is not git installation and adding in patch keeps our image small.

We also convert the existing css fix to using patch for consistency.

Change-Id: I7eed0d74c40141255cbff62069a83144feef6b61
2020-07-17 10:49:15 -07:00
Clark Boylan
8e0420ddf3 Update to gitea v1.12.2
This includes a number of bugfixes. The most important for us likely
being one that allows you to create a repo with a HEAD set to something
other than master, https://github.com/go-gitea/gitea/pull/12182.

I didn't see any template deltas.

Change-Id: I45fdbf22fb1749d966fc5f6f457e89d40efe5949
2020-07-13 08:32:55 -07:00
Ian Wienand
3cf11d298e Update grafana-container
There is a new release, update base container.  Add promote job that
was forgotten with the original commit
Iddfafe852166fe95b3e433420e2e2a4a6380fc64.

Change-Id: Ie0d7febd2686d267903b29dfeda54e7cd6ad77a3
2020-07-06 10:48:25 +10:00
Zuul
90d1a15ea0 Merge "Upgrade Etherpad to 1.8.4" 2020-07-02 19:50:32 +00:00
Ian Wienand
eb3e58da91 gitea-image: add a robots.txt
This looks like a very sane default robots.txt.  We can modify it as
required.

Change-Id: I8b9d3aa63538388e319f0216535f7a1d977f4885
2020-07-01 06:38:18 +10:00
Zuul
92981460d4 Merge "Set noninteractive in assemble script too" 2020-06-27 20:29:00 +00:00
Monty Taylor
857b5896dd Set noninteractive in assemble script too
We install the packages in the builder images so that things can
build.

Change-Id: I2e83158a9ba8517ff199c6efb6abf306b76b7d7d
2020-06-26 08:27:38 -05:00
Zuul
b4438eabf2 Merge "Make bindep installs non-interactive" 2020-06-26 00:18:54 +00:00
Monty Taylor
f2e9f556e8 Make bindep installs non-interactive
python-builder is for building docker images. As such, we almost
certainly don't want to be prompted for debconf questions.

Set DEBIAN_FRONTEND=noninteractive so that things like krb5-user
can be installed.

Change-Id: Ieff0555a57e7dbc1b7c4a059b1d0351d016a0c86
2020-06-25 18:18:32 -05:00
Ian Wienand
330e297318 Add a grafana/grafyaml image
This is a docker image based on the latest upstream Grafana with
grafyaml also installed inside.  It includes a small script to run a
refresh of the dashboards.

Change-Id: Iddfafe852166fe95b3e433420e2e2a4a6380fc64
2020-06-24 08:21:26 +10:00
Zuul
736b14d1b0 Merge "Small repo template cleanups in Gitea" 2020-06-22 16:14:35 +00:00
Zuul
6ca6ed8863 Merge "Update to gitea 1.12.0" 2020-06-22 16:14:08 +00:00
Clark Boylan
1770a25c8a Small repo template cleanups in Gitea
This improves the comments around why we've cleaned up some repo
functionality and also removes the activity button. The activity data
gitea is aware of is not a complete picture and is likely to be
misleading. Avoid misleading people by removing that button.

Change-Id: If7546f95421efdd897f2949e4f89a08d53289ce8
2020-06-19 15:26:06 -07:00
Clark Boylan
4f405f13f5 Update to gitea 1.12.0
Gitea 1.12.0 brings much improved git repo performance. Specifically it
caches the most recent commits helping the web views render much more
quickly.

This bumps our golang base image to 1.14-buster as gitea has changed
their default golang verison to 1.14. We also add gnupg to the package
install list as the upstream images did this.

In the templates I've tried to comment out rather than remove content
that we don't want exposed. The reason for this is it makes resolving
future template updates simpler.

For v1.12.0 release notes see:
https://github.com/go-gitea/gitea/blob/v1.12.0/CHANGELOG.md

Change-Id: I8fd6587c8962554023d878266055a2bd9d2499f9
2020-06-19 09:09:16 -07:00
Zuul
3f15016351 Merge "Be explicit about using python3 in docker images" 2020-06-15 23:37:17 +00:00
Zuul
c8f8edd478 Merge "uwsgi-base: drop packages.txt" 2020-06-15 21:29:41 +00:00
Mohammed Naser
7cd63aaded uwsgi-base: drop packages.txt
When we're building an image that is based off uwsgi-base, the
packages.txt file remains from the previous run which means that it only
install uWSGI again and not the package we're trying to build.

Change-Id: Ic71c47d53566b4ea79e03d19fd355c5c71a62802
2020-06-14 13:30:16 -04:00
Jeremy Stanley
78781ecfa0 Upgrade Etherpad to 1.8.4
Release notes for 1.8.3 and 1.8.4 mention a number of useful fixes
(there was no 1.8.1 nor 1.8.2). In particular, a workaround was
included for a known source of client-side hangs (some of our broken
"loading..." pads appear to exhibit similar log entries suggesting
this could address that long-standing problem). Unfortunately, in
the breaking changes, it's noted that plugin compatibility may be
impacted so we should test the one plugin we're using to make sure
it's still okay.

We force the skinName setting to no-skin as the default has changed
to colibris in 1.8.3. We don't want colibris, at least not yet, as it
breaks our existing headings plugin.

We also make a small change to the css in the editor so that each line
has its text fully rendered. See https://github.com/ether/etherpad-lite/issues/4106
for more details.

Change-Id: Ieae29a1d0fe28f879abd35b191291357bb5d3f2c
2020-06-11 10:26:45 -07:00
Clark Boylan
421a71e145 Be explicit about using python3 in docker images
Our docker python-base image is a python3 image where python and python3
point to the same version of python which happens to be a 3.x depending
on the specific base image.

One of the things that came up at the PTG is that we'd like to start
identifying where we use python2 in order to port to python3. That is
made a bit more difficult when we use `python` assuming it is `python3`
as we do in our docker images.

Update the images to use `python3` to make this a lot more explicit and
clear that we don't need to port these items.

Change-Id: I54e8f128f0cb8fbbdf54e3748384470262bef3a9
2020-06-09 09:30:56 -07:00
James E. Blair
6a53d47050 Exclude some regex matches in jitsi-meet web
If we match these explicit paths, don't allow the regex matches to
run.  Otherwise, we might redirect "/http-bind" to "/" which doesn't
work.

Also, restore the default meet.conf to the upstream; we're not
intending to carry any local changes to the rootfs.

Change-Id: I119d8c223291d79bd5fe0977264dec4bae126280
2020-05-13 07:40:18 -07:00
Jeremy Stanley
a48ac23520 Support hyphens and underscores for meetpad rooms
Many people put hyphens (-) and underscores (_) in their pad names,
and Jitsi-Meet seems to support them in its room names too, so add
them to our rewrite regex.

Change-Id: I819b8d56bf839cf743319e9cd823440c7d910001
2020-05-08 16:11:56 +00:00
Zuul
643b1d0541 Merge "python-builder: drop # from line" 2020-05-07 17:10:48 +00:00
Zuul
b2df0af08c Merge "Stop using jemalloc in python base image" 2020-05-05 18:50:04 +00:00
Clark Boylan
e9854d8bdc Stop using jemalloc in python base image
Initial testing seems to show that jemalloc is a probable source of our
memory leaks with zuul-scheduler and zuul-web under python3.7 and
python3.8. While this was desireable under python3.5 with zuul-executor
it doesn't seem like we want to enable this universally. For this reason
remove jemalloc from the base image. It can be added into images in
specific places if desireable but isn't a good default.

Change-Id: I671eef4ef27fdde161b52cf0a4187fac10ac8c4e
2020-05-04 16:31:36 -07:00
Monty Taylor
cee7903827 Add constraints support to python-builder
If someone drops an upper-constraints.txt into the source dir,
add it to the pip interactions.

Change-Id: I6b3c2a178d6fd9ee19918657c809ebf100a7724b
2020-05-04 15:21:33 -05:00
Mohammed Naser
254a4eb9f9 python-builder: drop # from line
If the extras includes a '#' inside of it, it means that it is
probably followed up with a comment such as license for that package and
it will fail to install because pip will try to use that literal #.

Change-Id: I31c5ffe3dda3ced4b6a412cc955c73321d4af507
2020-05-04 15:17:12 -04:00
Andreas Jaeger
90fa9170dd Fix py3 problem in accessbot.py
Change-Id: I4e3b3683b33b600cc4c1e4f09ba02c59e6f5cbb9
Fix:
TypeError: unsupported operand type(s) for +: 'dict_items' and 'dict_items'
2020-05-02 22:11:21 +02:00
Andreas Jaeger
26f1dae81b Fix accessbot/Dockerfile
The command is broken (extra ", misses redirection) and duplicates
content from accessbot.sh. Call accessbot.sh directly and use that one
instead.

Change-Id: Ieb530ef27e5995f2848a3c23a6c04a0717716e14
2020-05-02 18:02:06 +02:00
Zuul
1b2d113c0f Merge "Split eavesdrop into its own playbook" 2020-04-24 15:02:34 +00:00
Monty Taylor
9fd2135a46 Split eavesdrop into its own playbook
Extract eavedrop into its own service playbook and
puppet manifest. While doing that, stop using jenkinsuser
on eavesdrop in favor of zuul-user.

Add the ability to override the keys for the zuul user.

Remove openstack_project::server, it doesn't do anything.

Containerize and anisblize accessbot. The structure of
how we're doing it in puppet makes it hard to actually
run the puppet in the gate. Run the script in its own
playbook so that we can avoid running it in the gate.

Change-Id: I53cb63ffa4ae50575d4fa37b24323ad13ec1bac3
2020-04-23 14:34:28 -05:00
Zuul
2dcc8fc366 Merge "Add a uwsgi-base container image" 2020-04-23 16:14:20 +00:00
Zuul
b568391a4b Merge "Allow passing an arbitrary package list to assemble" 2020-04-23 16:07:41 +00:00
Zuul
e79de4587a Merge "Upgrade to gitea 1.11.4" 2020-04-23 15:37:44 +00:00
Monty Taylor
08a807e188 Add a uwsgi-base container image
For things using the builder/base pattern providing uwsgi services.

Change-Id: Iaf6d31a3d119f6b7e87b54cda1969a9994110dad
2020-04-23 13:11:44 +00:00
Monty Taylor
f3304c38d5 Allow passing an arbitrary package list to assemble
This lets you build an image to install a package or set of packages
without having to build a fake pbr install.

Change-Id: I6c171881283b89a14a532f31aedb33e223a0ea1f
2020-04-22 19:15:51 -05:00
Monty Taylor
ba3a0eb775 Allow requesting a list of extras to install
We produce lists of extras requirements to install, but installing
them takes an extra step. Allow it to be done all at once by accepting
names of extras on the install-from-bindep command line.

Change-Id: Ie75b9a668569c759f78b70617e311ed6f025039a
2020-04-22 14:39:55 -05:00
Monty Taylor
d1c49ff89e Upgrade to gitea 1.11.4
1.11.4 has been released. Nothing much of note, other than an
update to go-git v5.

Change-Id: I7c097b8033116800bbe6d55258f82dbedbf7248f
2020-04-15 08:54:37 -05:00
Zuul
d969cff10d Merge "Update link to etherpad from OpenDev" 2020-04-13 23:17:49 +00:00
Monty Taylor
7657b69387 Build and use our own etherpad image
We need to install the ep_headings plugin. We've got a hack in place
to do it in prod, but it seems like every time we npm install the
plugin in ansible, we need to restart the etherpad container
for $reasons.

It's cleaner to just build an image based on upstream with ep_headings
installed.

Change-Id: Id3b31bbabbbc5f6dcfe56486e48916384292f693
2020-04-13 08:07:09 -05:00
olaph wagoner
2b3f94a650 Fix typo on website
In the 'Join Us' section of the OpenDev home page, OpenDev is
spelt with a lower case 'd'.  This commit correctly capitalizes it.

Change-Id: I8d10cdbc89d9e509fa0c688345f5f462ccb539e6
2020-04-10 13:31:00 -04:00
Monty Taylor
3d7e824ff8 Update link to etherpad from OpenDev
We can link to etherpad.opendev.org now. This is the second to last
mention of openstack.org on opendev.org.

Change-Id: Ie50cf692c5a5cec2f6a6b19d026913d61e0b95e8
2020-04-09 13:12:49 -05:00
Jeremy Stanley
aacbe7a226 Add IRC logs and ML subscribe links to opendev.org
Folks looking at the contact section of our Web site may want to
subscribe to the mailing lists we mention there, so provide handy
hyerlinks enabling them to do that. Also add a link to the IRC
channel logs (partly to balance out the bullet list).

Change-Id: Ib3a1ca47b794f84029b3aff43c7a284fc470b7f1
2020-04-07 18:35:54 +00:00
Jeremy Stanley
8641302459 Mention new mailing lists
The OpenDev community is moving its discussions off the old
openstack-infra mailing list, so make sure to refer to the correct
new address(es).

Change-Id: I558b60ea0aa3421285d46be449f04198441cf285
2020-04-06 18:19:28 +00:00
Thierry Carrez
8ea3d6c8b7 [gitea] Point to newly-split Getting Started content
We recently added a "Get started" link to Gitea, pointing to the
generic Developer's Guide. Now that the content is split between
"Getting started" and the reference "Developer's Guide", point
to Getting started content instead.

This should be a lot less intimidating for our new users.

Depends-On: https://review.opendev.org/715961
Change-Id: Ifa496bc8de1a6a39d7b52363db3ab49b8175ed9a
2020-03-30 16:41:52 +02:00
Zuul
f892f0690e Merge "jitsi-meet: open etherpad on join" 2020-03-27 14:48:18 +00:00
Zuul
bfe1af5747 Merge "Build jitsi-meet images" 2020-03-27 14:48:16 +00:00
Zuul
e71a4e8ada Merge "Remove gitea doc links" 2020-03-27 13:46:57 +00:00