14886 Commits

Author SHA1 Message Date
James E. Blair
9fdd8ca3d2 Merge "Stop replicating to cgit and k8s-gitea" 2019-04-20 18:45:50 +00:00
Monty Taylor
fcab9a407a Update opendev git references in puppet modules
Not updating the gerrit git links thing, because that needs to
be a wider patch that updates the link syntax too.

Change-Id: I98013ba79e707540879e0cf2849a35c52f3371e8
2019-04-20 18:26:07 +00:00
Monty Taylor
eaa74543de Finish updating docs for opendev
The zuul and zuulv3 docs need to be merged, but that seemed like
too much for this. Also, the 3rd party CI doc is out of date, but
in this patch only removed sections that linked to docs or files
that don't exist anymore.

Change-Id: Ie5497edd762d2146165608f3227b0bac88a913df
2019-04-20 18:25:37 +00:00
Monty Taylor
06353bdb5d Remove running your own doc
This is just so massively out of date fixing it isn't worth it.

Change-Id: Ica122f4579de90c05f4b9327aa04945bbc381daf
2019-04-20 18:25:36 +00:00
Monty Taylor
ec4b5f302d Stop replicating to cgit and k8s-gitea
Change-Id: I22445b7bb842acd7a083623e74dfc9331ea3bfd2
2019-04-20 18:19:51 +00:00
James E. Blair
8b2a4dbedd Fix logstash filter location
Change-Id: I70fbe2a9ba0ab909002704ff97b5ee149040e742
2019-04-20 09:41:49 -07:00
Monty Taylor
e01ed4f066 Update some docs for opendev
There's a lot of these, so doing them in chunks. This fixes
the custom roles.

Remove the git and jjb docs, since we don't use them anymore.

Change-Id: I0c5b74f7b73315dac93bce6be0d920cddb94fb58
2019-04-20 09:41:45 -07:00
Monty Taylor
c6d129a108 Update some paths for opendev
There's a bunch in here. This is mostly big-ticket things and test
fixes. Also, change the README to rst - because why is it markdown?

Depends-On: https://review.opendev.org/654005
Change-Id: I21e5017011e1111b4d7a9e4bf0ea6b10f5dd8c1b
2019-04-20 09:31:14 -07:00
James E. Blair
9e85750550 Merge "Rename gerrit logo file" 2019-04-20 16:00:39 +00:00
James E. Blair
f756602e3c Merge "Set gerrit's gitHttpUrl to itself" 2019-04-20 15:56:36 +00:00
James E. Blair
9f040aee2e Rename gerrit logo file
Two in-flight changes altered the logo in two different ways
(overwriting the file vs changing the filename).  Reconcile by
using the new filename.

Change-Id: Iaad0b762255788011eaf0e3be3a922cebc2a2ea4
2019-04-20 08:54:35 -07:00
James E. Blair
c7d499d22b Merge "Bind to v4 and v6 in haproxy" 2019-04-20 15:49:58 +00:00
James E. Blair
7f1bd09712 Merge "redirects: add support for plain h=<sha>" 2019-04-20 15:48:49 +00:00
James E. Blair
07572767dd Merge "Redirect review.openstack.org to review.opendev.org" 2019-04-20 15:45:28 +00:00
James E. Blair
aa971d822a Merge "assets: replace logo with side-by-side logo and type" 2019-04-20 15:44:13 +00:00
James E. Blair
56a0646a56 Merge "Update known_hosts for zuul" 2019-04-20 15:43:54 +00:00
James E. Blair
708f65a5a4 Merge "Update gerrit connection in Zuul" 2019-04-20 15:43:27 +00:00
Mohammed Naser
f6161798f5 redirects: add support for plain h=<sha>
This patch adds support to handling if a sha is provided as a head
inside cgit.

Change-Id: I661e6061e86cb0ed68bbccaec4bc8950ea134c8a
2019-04-20 08:02:21 -07:00
James E. Blair
d97606cec0 Set gerrit's gitHttpUrl to itself
We used to replicate refs to the git farm, but we stopped doing that
with gitea.  Therefore, download links for patches must be served
from gerrit itself now.  We could remove this option (this is the
default), but I've left it to remind us about it in case we start
replicating again in the future.

Change-Id: I0b537afbcac17ae28a63bd2ef01102eb00b5f315
2019-04-20 07:25:57 -07:00
Mohammed Naser
11fa5826c1 assets: replace logo with side-by-side logo and type
This looks much better overall and makes the header much smaller,
the file is still called openstack.svg to simplify this change
and not mess with too many things at this stage.

Change-Id: I1c03ded750ab6041baf75f2fd5f1392bf8b5ecfd
2019-04-19 23:36:40 -04:00
James E. Blair
881c8f590f Update known_hosts for zuul
Add the review.opendev.org hostname to the known_hosts files.

Change-Id: I8b925053adaca7f47c647641466c0762b17776d9
2019-04-19 20:16:57 -07:00
OpenDev Sysadmins
1ee61397a3 OpenDev Migration Patch
This commit was bulk generated and pushed by the OpenDev sysadmins
as a part of the Git hosting and code review systems migration
detailed in these mailing list posts:

http://lists.openstack.org/pipermail/openstack-discuss/2019-March/003603.html
http://lists.openstack.org/pipermail/openstack-discuss/2019-April/004920.html

Attempts have been made to correct repository namespaces and
hostnames based on simple pattern matching, but it's possible some
were updated incorrectly or missed entirely. Please reach out to us
via the contact information listed at https://opendev.org/ with any
questions you may have.
2019-04-19 19:26:05 +00:00
James E. Blair
4cca6ddbbb Update gerrit connection in Zuul
Use the new hostname and canonical name.

Change-Id: Ia90f4bdb3dd483e43a99984fd776b0b7ec146fdc
2019-04-18 15:59:27 -07:00
James E. Blair
65563f226e Bind to v4 and v6 in haproxy
Also, add a newline between listener stanzas in the config for
readability.

Change-Id: I599ca06f933e746fae3769e7872ae9911c4b00ed
2019-04-18 15:38:15 -07:00
James E. Blair
f357e5cdab Use swift to back intermediate docker registry
Note, this does not have complete tests yet (we will need to update
the job to start a swift for that).

Change-Id: I2ee7a9e4fb503a3431366c16c380cf09327f6050
2019-04-18 08:14:37 -07:00
Clark Boylan
16fa372e0c Redirect review.openstack.org to review.opendev.org
This is part of the opendev git hosting transition. We do this on
review.opendev.org/review.openstack.org and not files.openstack.org so
that ssh connections continue to work. This will need to be applied
during the maintenance window.

This also updates the canonical urls and logo.

Change-Id: I5bf4dcd6835e379fcdd2d55393c5a844578074a9
2019-04-17 20:50:20 +00:00
Colleen Murphy
180897e49a Update zuul servers to puppet 4
This leaves ask.o.o and lists.o.o, which are still running Trusty, and
the cgit servers, which are likely to be decommissioned soon.

Change-Id: I78e7fd9e3079cc760da0aad955f6eeb32d442fc3
2019-04-17 16:53:56 +00:00
Zuul
6747cf236b Merge "Update nodepool servers to puppet 4" 2019-04-17 16:48:28 +00:00
Zuul
498151d7e2 Merge "Update grafana for new archive repo" 2019-04-17 03:38:50 +00:00
Zuul
ee4aa495c7 Merge "Add Puppet-Version: !X skip to apply tests" 2019-04-16 23:53:10 +00:00
Zuul
4f7dd4157e Merge "Added openstackid dev sendgrid support" 2019-04-16 18:08:20 +00:00
Clark Boylan
671250095d Install a docker registry GC cron
This installs a daily cron job for garbage collecting the docker
registry. Note that we need to orphan blobs by deleting their tags for
this to result in any cleaned up blobs. This will be done in a separate
change.

Change-Id: I85c87ee3b3a375e0141ef9b15a0b9e56c0938bd8
2019-04-15 12:08:17 -07:00
David Moreau Simard
df8452a21c
Add missing '^' to github replication pattern
This is required when using patterns to match projects and we missed
it in the original patch.

Change-Id: I973fd1d0a981de9bcaea80b111fba369ce6c4017
2019-04-15 08:59:29 -04:00
Ian Wienand
fb12d2620b Update grafana for new archive repo
Grafana has moved to a new package repo [1] and the apt-get update
step is failing on the current host.

The first version of puppet-grafana that has this update is 6.0.0;
this is two years later than the current version we're using so
... yeah.  It does not work with puppet3, so only run apply test with
puppet4.

It looks like upstream has moved from camptocamp/archive to
voxpupuli/archive so the comment is no longer required.

[1] https://grafana.com/blog/2019/01/05/moving-to-packages.grafana.com/

Change-Id: Ibab0ed6799563ba0f9674ef1ea575c6ac5d60341
2019-04-15 12:05:28 +10:00
Ian Wienand
6a1d4da730 Add Puppet-Version: !X skip to apply tests
Setting Puppet-Version: !X (where X would usually be 3) marks a hosts
as not wanting to run the apply tests for that puppet version.  This
is helpful for puppet4 hosts that wish to bring in new modules that
are not puppet3 compatible.

Change-Id: I081d15a53bd85152e7729c4c1da094dfee6d7073
2019-04-15 12:05:26 +10:00
David Moreau Simard
c4d757da4e
Add script to automate GitHub organization transfers
This script requires GITHUB_USERNAME and the GITHUB_PASSWORD env
variables to be set and lets users with sufficient privileges initiate
a transfer from a GitHub organization to another by specifying two
arguments, for example:
  ./github-org-transfer.py oldorg/repo neworg/repo

Change-Id: I2383d256958c028efe81b235ff8641d131bbb3a7
2019-04-12 18:01:16 -04:00
Zuul
c5698ead6a Merge "Disable gerrit replication to GitHub for ara/ara-infra/ara-web" 2019-04-12 16:48:59 +00:00
Zuul
c986fa0261 Merge "Pass SSL certs to graphite.opendev.org" 2019-04-12 00:40:11 +00:00
Zuul
bae231d959 Merge "Enable production cert generation for graphite01" 2019-04-11 23:19:21 +00:00
Zuul
73fc6dde7c Merge "yamlgroup: add regex match; exclude puppet4 for arm64 mirrors" 2019-04-11 22:54:38 +00:00
Colleen Murphy
c7f8b298ef Update nodepool servers to puppet 4
Except nb03.openstack.org, which runs on arm64 for which there are no
puppet 4 packages.

Change-Id: Ia85d20700309a9cd886886c4d4da52fb80ac595f
2019-04-11 21:35:51 +00:00
Ian Wienand
4abd0a3184 yamlgroup: add regex match; exclude puppet4 for arm64 mirrors
Two related changes that need to go together because we test with the
production groups.yaml.

Confusingly, there are arm64 PC1 puppet repos, and it contains a bunch
of things that it turns out are the common java parts only.  The
puppet-agent package is not available, and it doesn't seem like it
will be [1].  I think this means we can not run puppet4 on our arm64
xenial ci hosts.

The problem is the mirrors have been updated to puppet4 -- runs are
now breaking on the arm mirrors because they don't have puppet-agent
packages.  It seems all we can really do at this point is contine to
run them on puppet3.

This is hard (impossible?) to express with a fnmatch in the existing
yamlgroups syntax.  We could do something like list all the mirror
hosts and use anchors etc, but we have to keep that maintained.  Add
an feature to the inventory plugin that if the list entry starts with
a ^ it is considered a full regex and passed to re.match.  This
allows us to write more complex matchers where required -- in this
case the arm64 ci mirror hosts are excluded from the puppet4 group.

Testing is updated.

[1] https://groups.google.com/forum/#!msg/puppet-dev/iBMYJpvhaWM/WTGmJvXxAgAJ

Change-Id: I828e0c524f8d5ca866786978486bc04829464b47
2019-04-11 21:34:57 +00:00
Zuul
8228afb159 Merge "letsencrypt: tighten certificate permissions" 2019-04-11 19:59:29 +00:00
Zuul
8e4cd58b2e Merge "Update kerberos servers to puppet 4" 2019-04-11 17:34:09 +00:00
Zuul
338a9ac3bb Merge "opensuse: Fix mirroring source for the tumbleweed emergency update repo" 2019-04-11 17:34:07 +00:00
Clark Boylan
f5fe78bb49 Update puppet-python to "fix" broken facts
The puppet-python module had some broken facter custom facts that they
removed in 1.9.5. After upgrading to puppet-4 we notice this now. Update
to 1.9.5 from 1.9.4 to fix the error.

Error from puppet log:

  Apr 11 00:15:30 afs01 puppet-user[5184]: (Facter) error while resolving custom fact "virtualenv_version": undefined method `[]' for nil:NilClass

Change-Id: I853ed9e212885b01944dd5dc9157f2abdd9dedc3
2019-04-11 09:50:20 -07:00
smarcet
d6c2d3ab9e Added openstackid dev sendgrid support
updated openstackid dev node configuration
to use sendgrid api key from hiera

Depends-On: https://review.openstack.org/#/c/651794/
Depends-On: https://review.openstack.org/#/c/651798/
Change-Id: I9fc5e9b24886105771a1be93d8d8a6c6e1189c32
2019-04-11 11:49:27 -03:00
Zuul
65d9a8739a Merge "Skip mirroring live and jeos images for opensuse" 2019-04-11 14:09:10 +00:00
Ian Wienand
74e33f362e Pass SSL certs to graphite.opendev.org
This enables the SSL site for graphite.opendev.org

Change-Id: Ifa9e4864a9b2bad4a9e94ad1312f9e1d05b8aef3
Depends-On: https://review.openstack.org/651686
2019-04-11 13:23:41 +10:00
Ian Wienand
a88d836661 Enable production cert generation for graphite01
Testing with the staging cert has shown nothing is going crazy and
making unreasonable letsencrypt requests ... switch this to generate a
real cert.

Change-Id: I861ea295312f83c66dd9b37271969d6e7f8fc2a2
2019-04-11 10:32:30 +10:00