15425 Commits

Author SHA1 Message Date
Monty Taylor
97a79a027a Bump letsencrypt group id to match reality
It got created in the past as 3003. Just list it here like that.

Change-Id: Ic607a80c0d775856de059dedb73065c5708f556a
2020-02-25 14:17:13 -06:00
smarcet
88b26edf24 OpenStackId v3.0.1 deployment
Change-Id: I8a49dbde1bbcd935b380f003160040d634b2062c
Signed-off-by: smarcet <smarcet@gmail.com>
2020-02-25 15:35:17 -03:00
Zuul
8df5745c66 Merge "Rename gerrit hostvars to review01.openstack.org" 2020-02-25 17:26:49 +00:00
Monty Taylor
ef955dd270 Rename gerrit hostvars to review01.openstack.org
While the service is review.opendev.org, the server is actually
review01.openstack.org. The ansible inventory in production knows
it that way, as does the Nova in RAX DFW. Update the host_vars
entry and the zuul jobs so that it matches (And so that LE certs
apply)

Change-Id: I4c762c57f6826f2c5f9ed5c9cb0ae02644570c3d
2020-02-25 10:01:35 -06:00
smarcet
09f35f14bf OpenStackID v3.0.0
* migrated user storage to idp
* created users crud
* created groups crud
* migrated from eloquent to doctrine orm
* reafactoring

Change-Id: I766bbb75c0e65f504880e8c59951f63494a1e13f
Signed-off-by: smarcet <smarcet@gmail.com>
2020-02-25 09:45:06 -03:00
Zuul
bbba8524bd Merge "Removed OpenStackID stale config variables" 2020-02-24 22:29:46 +00:00
Jeremy Stanley
89ade11a95 Redirect openstackid tarball URLs to osf namespace
The blanket redirect from tarballs.openstack.org to
tarballs.opendev.org/openstack is only relevant for projects
publishing from the openstack namespace, since our new publication
jobs put content into Git-namespace-specific trees. Start a game of
Whack-a-Mole with the (hopefully few) projects in this situation.

Change-Id: I5d54532ef512df449d62299391d853d30862b7f2
2020-02-24 20:48:50 +00:00
Zuul
7fe8a64cdc Merge "Build gerrit images with bazelisk" 2020-02-24 18:20:48 +00:00
smarcet
ce6de87ea7 Removed OpenStackID stale config variables
Removed all variables related to Silverstripe
Dependency

Change-Id: Ib5e6834686c4952dd8e7220a31abe71a9278e397
Signed-off-by: smarcet <smarcet@gmail.com>
2020-02-24 14:26:30 -03:00
Zuul
a2c21661df Merge "static: move afs sites from files.openstack.org to static.opendev.org" 2020-02-24 00:39:50 +00:00
Monty Taylor
a8e1d1496d Build gerrit images with bazelisk
We need to use bazelisk to build gerrit so that we can properly
track bazel versions in the job. Use the roles developed for
gerrit-review to do that, then simplify the dockerfile to have
it simply copy the war into the target image.

Also add polymer-bridges.

Depends-On: https://review.opendev.org/709256
Change-Id: I7c13df51d3b8c117bcc9aab9caad59687471d622
2020-02-21 17:32:01 -06:00
Zuul
71e650eb5a Merge "static: move site setup to a loop" 2020-02-21 19:27:38 +00:00
Zuul
e0ca915508 Merge "static: add releases.openstack.org site" 2020-02-21 17:12:52 +00:00
Ian Wienand
3206fd02b8 static: move afs sites from files.openstack.org to static.opendev.org
This creates sites to serve

 developer.openstack.org
 docs.openstack.org
 docs.opendev.org
 docs.starlingx.io

which are all just static directories underneath /afs/openstack.org/.

This is currently done by files02.openstack.org, but will be better
served in the future by consolidating in ansible configuration on
static.opendev.org.

The following dns entries need to be made before merging to ensure the
certificates are provisioned

 _acme-challenge.developer.openstack.org
 _acme-challenge.docs.openstack.org
 _acme-challenge.docs.opendev.org
 _acme-challenge.docs.starlingx.io

Once done, we can merge and then cut-over the main DNS entries as we
like.

Since there are some follow-ons, I have not removed the puppet
configuration from files02.openstack.org.  I think it's best we
migrate everything away from that and remove it in one lot.

Change-Id: I459a36f823a8868e6cc09e2b0d85f2fe05d69002
2020-02-21 17:59:14 +01:00
Zuul
eee3f4c25b Merge "afs-release: also release project.releases" 2020-02-21 03:47:45 +00:00
Ian Wienand
52ef51ca2a static: move site setup to a loop
Remove some repeated boilerplate by moving this into a loop.  No
functional change.

Change-Id: Id99e0c8cc6f663e054d69872b3da6eeb543cf3b5
2020-02-21 14:35:35 +11:00
Ian Wienand
047eae459d static: add releases.openstack.org site
This adds the site to publish from

 /afs/openstack.org/project/releases.openstack.org

Change-Id: Ia91deb9a51441ac9974137ed39fc5a185689a11c
Task: #37724
Story: #2006598
2020-02-21 14:35:35 +11:00
Zuul
8ae783ac5a Merge "static: add default site" 2020-02-21 02:32:36 +00:00
Ian Wienand
a0c1de2b6b afs-release: also release project.releases
See https://review.opendev.org/709009

The volume is created and active

Change-Id: I7d05249d43d82f8c4509ecbbba2e012e160474da
Task: #37724
Story: #2006598
2020-02-21 13:30:22 +11:00
Zuul
902354eb00 Merge "openafs-client: use dnf for CentOS 8" 2020-02-20 22:38:00 +00:00
Zuul
a514f098ac Merge "launch-node.py : make sure new inventory comes last" 2020-02-20 22:37:59 +00:00
Ian Wienand
b2eb6c7003 static: add default site
If you currently hit https://static.opendev.org you get redirected to
the default site, which is just the first site in alphabetical order,
which happens to be governance.openstack.org.

Add a 00-static.opendev.org.conf file so this is the default site.  It
will just serve up the top-level afs directory.

Change-Id: Icdcee962b76545c12e84d4cadb0b60a68cabe38b
2020-02-21 09:15:47 +11:00
Zuul
2402b208b2 Merge "Upgrade gitea to 1.10.3" 2020-02-20 17:06:18 +00:00
Zuul
5ac2db8b5c Merge "static: Add service-types.openstack.org" 2020-02-20 02:45:51 +00:00
Zuul
b5b79c1c88 Merge "Add specs.openstack.org" 2020-02-20 01:39:41 +00:00
Ian Wienand
2f1b2f3eae static: Add service-types.openstack.org
Publishing changes done with https://review.opendev.org/#/c/708518/

Change-Id: I13934473aa85fce17a269f81f67c6332d51a9ab1
Story: #2006598
Task: #37723
2020-02-20 11:09:28 +11:00
Ian Wienand
738468b6ad Add specs.openstack.org
Old content is rsynced and publishing to be switched with
https://review.opendev.org/#/c/708500/

Change-Id: I797bb51970d9e7cd3ee5c2635bb5045c618b9d2c
Story: #2006598
Task: # 37721
2020-02-20 10:37:45 +11:00
Zuul
072ac46b47 Merge "Add curl to python-builder image" 2020-02-18 23:20:44 +00:00
Sorin Sbarnea
f861cda57c Improve 3rd-party logging guidelines
Based on #openstack-infra talks from Feb 17th, I am proposing some clarifications regarding how logging should
be done by 3rd party CI.

These should help 3rd party integrators create a better
experience for developers, making logs more accessible.

Change-Id: I2ebc788505ba1319afc038d0aa1406da3823a911
2020-02-18 09:29:24 +00:00
Zuul
3ac3ab8eb6 Merge "Add project.tarballs to periodic AFS release" 2020-02-18 02:05:29 +00:00
Zuul
d7fc4cb2c8 Merge "Allow mirror-update.opendev.org to send stats" 2020-02-17 21:21:28 +00:00
Zuul
69cd119dcd Merge "Introduce ideas repo redirect" 2020-02-17 17:53:37 +00:00
Ian Wienand
d1fa8c6482 Allow mirror-update.opendev.org to send stats
I forgot this in some of the prior changes that moved afsmon and
afs-release.py to this host, and those jobs send stats.

Change-Id: Ifacf69e7fef5b54a03d43272e9cc01b6fbe8e845
2020-02-17 17:58:49 +11:00
Zuul
bf0e2662f1 Merge "Update letsencrypt_gid documentation" 2020-02-14 19:17:23 +00:00
Zuul
5f80e934c4 Merge "Use LE certs for Apache" 2020-02-14 19:08:51 +00:00
Ian Wienand
17e31f907b Update letsencrypt_gid documentation
Added with Ie32124cd617e9986602301f230e83bb138524fdf

Change-Id: I04024832302a472c900f614ce03251766bc23d70
2020-02-13 17:21:14 +00:00
Monty Taylor
bbe8086726 Use LE certs for Apache
We're getting LE certs for the hosts now, use them in the apache
config. Also add the redirects.

Change-Id: I67d33b4c542182a2474ac0d2416357541b1c3a47
2020-02-13 10:31:59 -06:00
Monty Taylor
37a47fb259 Add curl to python-builder image
It's pretty common to use curl to grab things.

Change-Id: Ifdf69b066cc6642a06ce77a36065e867be0fe12d
2020-02-13 09:17:59 -06:00
Ian Wienand
e1628a667a afs-release: don't use paramiko
It is always something ... paramiko 2.0.0 in Bionic does not have
support for ed25519 keys which we have setup for the vos_release user.
Rather than reworking the entire chain deploying that key, switch to
calling ssh directly.

Change-Id: Iacb0812f475c178189d2233b3a2324337f3bb419
2020-02-13 21:07:43 +11:00
Zuul
30297fb10d Merge "Migrate AFS publishing to mirror-update.opendev.org" 2020-02-12 22:40:43 +00:00
Zuul
75693aa43b Merge "Remove review-dev01.openstack.org" 2020-02-12 18:12:51 +00:00
Zuul
3308e83885 Merge "Get LE certs for review.o.o" 2020-02-12 18:12:50 +00:00
Monty Taylor
99a52a9c52 Make small tweaks to launch node README
First of all, we're using RST syntax, so rename it to README.rst.

More importantly, remove menitons of puppetmaster - and puppet in
general, as they are distracting. When reading the file, my eyes
scanned and hit puppetmaster and I almost skipped the section with the
assumption it was out of date.

Change-Id: I294bf17084be7dad46e075ad2a3ef2674276c018
2020-02-12 08:42:32 -06:00
Monty Taylor
23b0667c45 Remove review-dev01.openstack.org
We've got a shiny new opendev one of these now, get rid of the
openstack.org one.

Change-Id: I9f5141a6ff23ab035ecedf100a417989453bfc1e
2020-02-12 14:40:46 +00:00
Zuul
6f32fbebe5 Merge "afsmon: install python3-pip" 2020-02-12 09:38:39 +00:00
Zuul
9d85a88119 Merge "afs-release: run every 5 minutes" 2020-02-12 06:19:45 +00:00
Ian Wienand
301514286b afsmon: install python3-pip
Production servers don't have pip installed by default; this is hidden
by gate testing because nodepool nodes do.  Install it for afsmon.

Change-Id: If18ce8c7afb6899f2b6628852e716e63808fc403
2020-02-12 16:39:11 +11:00
Ian Wienand
97c4735129 Move afsmon to mirror-update.opendev.org
This migrates the afsmon script from puppet deploying on
mirror-update.openstack.org to ansible deploying on
mirror-update.opendev.org.

There is nothing particularly special and this just a straight install
with some minor dependencies.  Since we have log publishing running on
the opendev.org server, we publish the update logs alongside the
others.

Change-Id: Ifa3b4d59f8d0fc23a4492e50348bab30766d5779
2020-02-12 14:38:48 +11:00
Monty Taylor
083cbf2911 Get LE certs for review.o.o
We have LE dns entries for review.o.o, but we're not actually
requesting the cert. Go ahead and request it - it'll make the
apache config easier to sort out.

Get the openstack.org certs for review-dev while we're at it.

Change-Id: I91d06c97993ba37204bd1fc326ae823e1b9c0c1a
Depends-On: https://review.opendev.org/707267
Depends-On: https://review.opendev.org/707255
2020-02-11 17:01:43 -06:00
Ian Wienand
f6e01bd0e4 Add project.tarballs to periodic AFS release
This is the tarball artifact volume at
/afs/openstack.org/project/tarballs.opendev.org

Change-Id: I480154e2014d9e0845a1d7150a668f7b7f6988c0
2020-02-11 16:14:45 +11:00