8663 Commits

Author SHA1 Message Date
Clark Boylan
eeac5467c3 Set up robots.txt on lists servers
This sets up a robots.txt on our lists servers. To start this file
prevents SEMrush bot from indexing our lists as that has been causing
lists.openstack.org to OOM with many listinfo processes started by
Apache.

We've avoided this OOM by manually configuring this robots.txt. Other
things we have ruled out are bup and input email causes qrunner's to
grow unexpectedly large. Fairly confident this bot is the trigger.

Note this fixes testing by adding 'hieradata' to set listpassword var.

Depends-On: https://review.opendev.org/724389
Change-Id: Id4f6739a8cf6a01f9796fa54c86ba1af3e31fecf
2020-04-29 17:48:13 +00:00
Ian Wienand
1d0d62c6a6 status.openstack.org: send zuul link to opendev zuul
Due to a configuration issue, zuul.openstack.org is currently throwing
SSL validation errors.  Update the status.openstack.org to the
canonical OpenStack tenant page directly.

Change-Id: Idf08e140de11126061cb6f9783d13dc64fefff60
2020-04-27 09:42:11 +10:00
Zuul
b21a8e58cf Merge "Run Zuul using Ansible and Containers" 2020-04-24 16:31:42 +00:00
Zuul
1b2d113c0f Merge "Split eavesdrop into its own playbook" 2020-04-24 15:02:34 +00:00
Monty Taylor
f0b77485ec Run Zuul using Ansible and Containers
Zuul is publishing lovely container images, so we should
go ahead and start using them.

We can't use containers for zuul-executor because of the
docker->bubblewrap->AFS issue, so install from pip there.

Don't start any of the containers by default, which should
let us safely roll this out and then do a rolling restart.
For things (like web or mergers) where it's safe to do so,
a followup change will swap the flag.

Change-Id: I37dcce3a67477ad3b2c36f2fd3657af18bc25c40
2020-04-24 09:18:44 -05:00
Zuul
e044023dc9 Merge "Split codesearch into its own playbook" 2020-04-24 13:57:03 +00:00
Zuul
81f9bfd996 Merge "Set AllowEncodedSlashes NoDecode on 8080 revproxy" 2020-04-23 20:12:15 +00:00
Monty Taylor
9fd2135a46 Split eavesdrop into its own playbook
Extract eavedrop into its own service playbook and
puppet manifest. While doing that, stop using jenkinsuser
on eavesdrop in favor of zuul-user.

Add the ability to override the keys for the zuul user.

Remove openstack_project::server, it doesn't do anything.

Containerize and anisblize accessbot. The structure of
how we're doing it in puppet makes it hard to actually
run the puppet in the gate. Run the script in its own
playbook so that we can avoid running it in the gate.

Change-Id: I53cb63ffa4ae50575d4fa37b24323ad13ec1bac3
2020-04-23 14:34:28 -05:00
Zuul
b4318aea19 Merge "Start mirroring focal, stop mirroring trusty" 2020-04-21 20:19:41 +00:00
Monty Taylor
d5c68c5131 Split codesearch into its own playbook
Make a service playbook, manifest and jobs for codesearch.

Remove openstack_project::server - it doesn't do anything.

Change-Id: I44c140de4ae0b283940f8e23e8c47af983934471
2020-04-21 13:18:28 -05:00
Monty Taylor
5468f49254 Remove unused gerrit puppet things
We ain't using em.

Change-Id: I4ce9188a6b6a7e6a670e61bb17ab07e890faebcf
2020-04-19 10:59:25 -05:00
Monty Taylor
711295e918 Remove old etherpad.openstack.org
Once the DNS is swapped over to point at etherpad.opendev.org
we can delete the old stuff.

Change-Id: I626dd22b22a23619fcf460533336f1ddfec615d9
2020-04-19 10:58:46 -05:00
Monty Taylor
efd3ad59d9 Remove unused rspec tests
We got rid of the job, let's get rid of the tests.

Change-Id: I8fed8d2d381020594de63bf1069f68122d018c47
2020-04-19 10:57:22 -05:00
Monty Taylor
1c2aa68647 Start mirroring focal, stop mirroring trusty
Focal is released next week and the rc has been cut. The repos
are out there, start mirroring them so that we can start building
images.

While we're at it - we don't do trusty anymore, so stop mirroring
it.

Change-Id: Ibfe4984b24374862b0bd03cf47c47b0d83e6cacb
2020-04-17 13:40:44 -05:00
Radosław Piliszek
3c47bdbd5d Set AllowEncodedSlashes NoDecode on 8080 revproxy
This is a follow-up on nocanon from [1].
This ensures Apache does not filter any requests originally
containing encoded slashes.

[1] I5a3a6551536e2d1e87aa074e0de7619a367b1971

Change-Id: I94fcb67a914da6ab4d6e1bfd0a2e02121d22559c
2020-04-05 16:07:28 +02:00
Zuul
89a8781307 Merge "Add a service discussion mailing list for OpenDev" 2020-04-02 21:58:54 +00:00
Radosław Piliszek
cc4c46c2e8 Do not canonicalize URLs to registry.npmjs.org
Kolla Monasca Grafana images are currently not buildable in CI
due to:
404 Not Found - GET http://mirror.bhs1.ovh.openstack.org:8080/registry.npmjs/@types%2fcolor-name

The url-escaped slash gets mangled by Apache on its way to
registry which causes 404.

This patch fixes that.

Change-Id: I5a3a6551536e2d1e87aa074e0de7619a367b1971
2020-04-02 14:29:00 +02:00
smarcet
bb3e751502 Openstack Id production deploy v3.0.9
Change-Id: I35c1136f5cb81a0d884e58546c61df53d90397a7
Signed-off-by: smarcet <smarcet@gmail.com>
2020-04-01 13:22:05 -03:00
Jeremy Stanley
c03591d776 Upgrade etherpad-dev server to Node 10.x
The Nodesource repo has Node 10.x packages for Ubuntu Xenial, so we
can give that a try. Latest versions of Etherpad require at least
8.x but running newer should be fine if we can.

Change-Id: Ib49a5ddaec5a4786ec8ec0042faee06b11603bee
2020-03-31 20:14:25 +00:00
Zuul
699c2bf331 Merge "OpenstackId production deployment 3.0.8" 2020-03-31 17:40:23 +00:00
smarcet
fe97be543d OpenstackId production deployment 3.0.8
Change-Id: I6eda033166294427dcbf2668273c5e5421a2bb37
Signed-off-by: smarcet <smarcet@gmail.com>
2020-03-31 11:45:19 -03:00
Zuul
2a2431611d Merge "Remove /tarballs proxy from mirrors" 2020-03-30 21:59:49 +00:00
Jeremy Stanley
e5f7820143 Add a service discussion mailing list for OpenDev
The OpenDev collaboratory has been sharing the openstack-infra
mailing list with OpenStack's Infrastructure team, a commingling of
communication channels which gives mixed signals about the logical
relationship between these services and projects. Create a new
discussion list for OpenDev services, named consistent with the
existing service-announce list we already have.

Change-Id: I63caca269e779acef1e04e00755b885c613c343b
2020-03-30 14:47:19 +00:00
David Shrewsbury
b0e2df07b4 Remove shrews from infra-root
Change-Id: I55d9670f216fb6d36be8ec080fcc02e40bf83a68
2020-03-26 13:38:02 -04:00
Ian Wienand
dcc23be55b Remove static site puppet
Remove the puppet related to the static server

Story: #2006598
Task: #36758

Change-Id: I744da83d811e715ff8049eacf3013cd4831e1c49
2020-03-26 10:36:16 +11:00
Ian Wienand
f55580fbf0 Remove files02.openstack.org and related puppet
All this has moved to static.opendev.org; the server can now be
removed.

Change-Id: I8ca5d7a206e950c28bb8372a85b6a62d6b9ba00c
2020-03-26 10:36:13 +11:00
smarcet
de04c6da67 Added new param to IDP config
Added user_spam_processor_to to dev/production

Change-Id: I36a41bdcd23df9540183da5a087d364778d60b48
Signed-off-by: smarcet <smarcet@gmail.com>
2020-03-25 11:32:17 -03:00
Zuul
5b6d2fb4e9 Merge "OpenStackID 3.0.6 production deployment" 2020-03-24 20:50:37 +00:00
Ian Wienand
7187b313d8 Remove /tarballs proxy from mirrors
As described in the dependent change, which removes the environment
var to set this up, this is no longer required.

Story: #2006598
Task: #39014

Change-Id: I93455dd1512aeb9111feaf516abfb60695976663
Depends-On: https://review.opendev.org/714543
2020-03-24 09:20:01 +11:00
Zuul
3af9548401 Merge "Update CLA link" 2020-03-21 18:24:50 +00:00
Zuul
06e0155cb8 Merge "Update infra-manual location" 2020-03-21 18:02:17 +00:00
Andreas Jaeger
4293e228b7 Update CLA link
link to contributor guide, the OpenDev manual does not talk about CLA
anymore.

Change-Id: Ia414513fc1645e0eec462f95af0d9247eb4c0a99
2020-03-21 18:17:57 +01:00
smarcet
055796bb4e OpenStackID 3.0.6 production deployment
Change-Id: Ib4621b38d78fb61311a65dd3878a0a61e799f367
Signed-off-by: smarcet <smarcet@gmail.com>
2020-03-21 12:47:59 -03:00
Andreas Jaeger
2c0b82e5e8 Update infra-manual location
The infra-manual now lives on docs.opendev.org, update links.

New location is: https://docs.opendev.org/opendev/infra-manual/latest

Change-Id: I7716c68cbff4f3a640d7161f59cfc034a7ccca52
2020-03-20 22:03:09 +01:00
smarcet
d138243bd5 OpenStackId production release 3.0.5
Change-Id: I8d2e2d96ba3543de6b47c5001f9bc2ebab115286
Signed-off-by: smarcet <smarcet@gmail.com>
2020-03-20 17:28:04 -03:00
Zuul
b0f81dc7b9 Merge "Update git.starlingx/git.airship redirects" 2020-03-19 01:21:21 +00:00
Zuul
51a5f5488f Merge "Update git.zuul-ci.org redirects" 2020-03-19 01:21:20 +00:00
Andreas Jaeger
eecf3e71fc Update git.starlingx/git.airship redirects
After the big OpenDev rename, these repos got renamed again. Update the
redirects for git.airshipit.org and git.starlingx.io to point to the
current location.

Update test_static.py for this, change the test repo since
airship-in-a-bottle was first renamed to in-a-bottle and later to
airship-in-a-bottle.

Change-Id: I71b786cd528aac9ae68464618db02e22cd4c0b5b
2020-03-18 18:39:48 +01:00
Andreas Jaeger
a6480bcefb Update git.zuul-ci.org redirects
zuul and nodepool now life in opendev, avoid double redirects and
redirect directly to final location.

Change-Id: Ia55d76b24f07ec64cb55055955c4549f3706a95b
2020-03-18 18:28:42 +01:00
Jeremy Stanley
4cbdc2fc4d Set up inventory and cert for Open Edge mirror
This adds the Open Edge (formerly Fortnebula) CI mirror.

Change-Id: I1ccf2a602f8a41e00bc64a9516a326cc07d9b254
Depends-On: https://review.opendev.org/711787
2020-03-07 00:24:20 +00:00
Jeremy Stanley
43ed9fc297 Moving FortNebula to OpenEdge
Sister change for Ia5caff34d3fafaffc459e7572a4eef6bd94422ea and
removing earlier references to the mirror server in preparation for
building and adding the new one.

Change-Id: I7d506be85326835d5e77a0c9c461f2d457b1dfd3
2020-03-06 20:43:56 +00:00
Zuul
a70c4a1cce Merge "Pin lodgeit to the current version" 2020-03-05 17:50:27 +00:00
Monty Taylor
b8f9cc40aa Pin lodgeit to the current version
So we can be careful about landing lodgeit changes.

Depends-On: https://review.opendev.org/711344
Change-Id: If1ae66fc94d5ceed458b93cb10f0bb061df85021
2020-03-04 23:54:41 +00:00
Zuul
1cae4d56a0 Merge "ssl cert check: add recent domains" 2020-03-04 00:57:19 +00:00
Ian Wienand
bd3b24fcc4 ssl cert check: add recent domains
Add some domains added recently
(https://review.opendev.org/#/c/710160/)

Change-Id: I8d2671494ddf9097449464df1b538e699fa5c1be
2020-03-04 00:09:46 +00:00
Clark Boylan
61caec5b77 Use LE cert on review.open*.org
We previously had two manually issued certs (one each for opendev.org
and openstack.org) but now have a single cert with all the appropriate
names in it automatically issued by LE. Use this new cert before the old
one expires.

Change-Id: I635d2bfd820fe138ee951833dd66f157b2b7c097
2020-02-28 08:10:24 -08:00
smarcet
eed9116625 OpenStackId v3.0.4 Deployment
Fixed inconsistent ORM mappings

Change-Id: I1806f0c22a21ebf495aa725998ba0e0e57bf3b4a
Signed-off-by: smarcet <smarcet@gmail.com>
2020-02-26 16:58:58 -03:00
smarcet
19662d7d3f OpenStackId v3.0.3 Deployment
Change-Id: I239f8311139d59260430baee0c6cb910c31caf3f
Signed-off-by: smarcet <smarcet@gmail.com>
2020-02-25 22:21:20 -03:00
Zuul
9566bd0e2a Merge "Revert "Generate list of 404s for docs.o.o"" 2020-02-25 23:39:02 +00:00
smarcet
88b26edf24 OpenStackId v3.0.1 deployment
Change-Id: I8a49dbde1bbcd935b380f003160040d634b2062c
Signed-off-by: smarcet <smarcet@gmail.com>
2020-02-25 15:35:17 -03:00