8537 Commits

Author SHA1 Message Date
Clark Boylan
1884a22ca7 Update certcheck domains
This removes groups.openstack.org as this service was shut down. Add new
opendev services behind ssl.

Change-Id: I14c667c8fbde07c3a52778bc2c5e93abf8f053a4
2019-06-10 13:03:35 -07:00
Clark Boylan
fd97e061ae Evaluate files vhosts after we determine ssl file paths
Previously we evaluated the vhost templates before setting
ssl_cert_file_ and ssl_key_file_ and ssl_chain_file_. This made erb
unhappy because those are the three variables we use to set paths in the
vhost. Fix this by moving the vhost after the ssl file vars are set.

Change-Id: I4ba62521c9e7da104f8799d016cbcf0214cbdfc1
2019-06-06 16:28:37 -07:00
Clark Boylan
9ea8edc341 Evaluate files website vhosts in context of website not vhost
To deal with puppet scoping fun we evaluate the template for our
files.o.o website vhosts in the context of the website define and not in
the context of httpd::vhost.

Change-Id: I90bb881eb6ad78cede3a8a2548e1dfcf24e1160b
2019-06-06 15:12:15 -07:00
Zuul
0ace6c2614 Merge "Add tarballs.opendev.org vhost" 2019-06-06 20:03:33 +00:00
Ian Wienand
6b9907dcd8 Add centos/ to centos mirror path
As a follow-on to I0e110ef51c8ed301fd8280ae7fc039e3b01db92c; this
dropped the /centos/ from the base mirror, add it back.

Also switch the mirror to the only one on the altarch-mirrors page
that is in US/TX, which from the name is in Dallas, which must be
pretty close to rax.dfw where the update server lives.

Change-Id: If4d71865f4328e73a26c7b38300767ed6b790579
2019-06-06 13:36:36 +10:00
Zuul
8b98aff89c Merge "centos-mirror-update: handle non-x86 architectures" 2019-06-06 00:57:09 +00:00
James E. Blair
3c84c65614 Add tarballs.opendev.org vhost
Change-Id: I6aa85bf92b2d5726d3c86b11b103a87f11953c51
2019-06-05 14:10:19 -07:00
Marcin Juszkiewicz
ac5acbca92 centos-mirror-update: handle non-x86 architectures
CentOS keeps non-x86 architectures in /altarch/ directory (contrary to
/centos/ one for x86-64). We have aarch64 (arm64) machines in infra and
they fail due to lack of CentOS altarch mirror.

List of wanted alternative architectures is controlled by ALTARCHS
variable (aarch64 and ppc64le enabled). As CentOS has several other
architectures too they are listed in ALTARCHS_IGNORED so we do not fetch
them.

Current CentOS mirror lands in same /mirror/centos/7/ directory. Altarch
mirrors goes to /mirror/centos/altarch/7/ one.

Change-Id: I0e110ef51c8ed301fd8280ae7fc039e3b01db92c
2019-06-03 13:07:26 +02:00
Clark Boylan
7c954dba72 Add opendev service-announce list
This way we can send a single email that our users can see if subscribed
to this list instead of sending emails to all of their discuss lists.

Change-Id: I3b978a3c4e7888f14e3986628cb29a6c86bbcf61
2019-05-30 13:53:00 -07:00
Zuul
d234442dae Merge "Remove jenkins user from status.o.o" 2019-05-29 15:13:48 +00:00
Zuul
598d9106ee Merge "Remove bugday from status.o.o" 2019-05-29 15:12:00 +00:00
Zuul
d3d13152a7 Merge "Adding new ML for the NBMP group" 2019-05-29 14:17:48 +00:00
Jeremy Stanley
b1f95745f6 Exclude old distros from yum-puppetlabs mirror
The yum-puppetlabs mirror exceeded its 100GB quota as of April 26.
Rather than increase the quota, start excluding packages for old
platforms we don't provide like RHEL5-6 and Fedora F20-27. We could
probably get even more aggressive with it, but this get the
utilization back under 50% which is plenty of headroom for now.

Change-Id: I9665b3a2a89f991f9433fe7f45bc1bb0e0c7632b
2019-05-28 23:15:37 +00:00
Jean-Philippe Evrard
5568a461bf Exclude tmp files artifacts from syncing
It seems the openSUSE build process can leave artifacts behind,
in the form of .~tmp~ files in the mirror. I assume these are
wrongfully present.

This is a problem, as those ~tmp~ files prevent syncing the
repositories.

While it's most likely that openSUSE files will be cleaned in the
source repos, should this problem arise in the future, it's also
more robust to skip the syncing of those files.

This has the extra benefit of temporarily unblock mirroring of
openSUSE Leap 15.1 in infra, as of today.

Change-Id: I0124b992483cfda9f97960b43bddf94efa008030
2019-05-28 15:19:22 +02:00
Zuul
459bc1ab4f Merge "Start mirroring openSUSE Leap 15.1" 2019-05-27 07:33:25 +00:00
James E. Blair
5faf89f566 Add haproxy-statsd to haproxy server
Build a container image with the haproxy-statsd script, and run that
along with the haproxy container.

Change-Id: I18be70d339df613bf9a72e115e80a6da876111e0
2019-05-24 15:40:28 -07:00
Monty Taylor
c4b0fa1ad3 Remove jenkins user from status.o.o
This is vestigal. Removing it to make reviewing xenialification
easier.

Change-Id: I9b57336d47ee4aa18fdc3888c2ac2c75a3b23c15
2019-05-24 16:14:27 -05:00
Monty Taylor
43fdea4ac4 Remove bugday from status.o.o
It doesn't seem like this is used anymore. Let's remove it before
we update the rest of this, so that we don't have to, you know,
update abandoned things.

Change-Id: I1c3708021046a428da82eaa843961091915ba4af
2019-05-24 14:56:50 -05:00
Dirk Mueller
48334c6a40 Start mirroring openSUSE Leap 15.1
openSUSE Leap 15.1 was released May 23rd, 2019 and we want to switch
the nodepool jobs against this asap in order to be able to remove
openSUSE Leap 42.3 (End of Life in June 2019) and eventually
openSUSE Leap 15.0 as well once all users have been converted over.

Change-Id: Ia2f8b9f4073a247875c97eafd80204e291affb8e
2019-05-24 14:59:45 +00:00
Zuul
5e908c739b Merge "Move openSUSE Tumbleweed into a caching mirror instead" 2019-05-24 08:01:38 +00:00
Dirk Mueller
b3ce1c52dc Move openSUSE Tumbleweed into a caching mirror instead
Tumbleweed is only rarely used in the openStack CI, so mirroring it
fully is not worth the time/space overhead. a caching proxy
should be good enough. Add it to the directories to clean up
and remove the older entries because they will no longer be
matching.

Change-Id: I987da098cf4a7330cdec8da9ae3cfbff2f330bf8
2019-05-24 16:19:40 +10:00
Clark Boylan
08152aa22f Remove groups configuration
This removes the groups servers from our inventory as well as our
manifests/modules. We don't run the groups service anymore as many
groups migrated to meetup.com independent of us and the others have
transitioned there.

Change-Id: I7cb76611e6d30e7189821923f36a38dec9ea7241
2019-05-23 12:20:04 -07:00
James E. Blair
03232d51ce Push all refs to gitea
The current version wil now skip performing expensive operations
on unknown refs, so it is safe to push refs/notes and refs/changes
to gitea.

Change-Id: I8f08f3341e0ff603f8579870bd862b5fd6c5a9c1
2019-05-23 07:09:49 -07:00
Zuul
5fca87512e Merge "Properly mirror the lxc container images as well" 2019-05-23 10:13:43 +00:00
Zuul
62c06cc3e9 Merge "Remove unused commit-filter script" 2019-05-23 07:55:31 +00:00
Ildiko Vancsa
25b8a8e4ef Adding new ML for the NBMP group
There is a new group forming around open source design and development
activities in the area of Network Based Media Processing (NBMP). This
patch creates a mailing list for the group to start openly collaborate.

https://wiki.openstack.org/wiki/NBMP_Working_Group

Change-Id: I8a55d6f1ddec5b7eeebf8e955582edcad8fa8470
2019-05-22 07:16:21 +00:00
Clark Boylan
2eefb60457 Add more /s to puppet:/// url for jetty shim deb
We only had two and need three.

Change-Id: If1d952867b7a662278e8a4c900322b9266f4e1c6
2019-05-21 15:03:06 -07:00
Ian Wienand
dabe6e2768 ask.o.o : fix jetty package install
I'm certain I copied this from somewhere out of date; it should be
"ensure" not "state" for puppet4

Change-Id: I18272db219a7d047bc58728b1d09355fd0100881
2019-05-22 06:45:37 +10:00
Zuul
e740439103 Merge "ask.o.o : workaround old puppet-solr package" 2019-05-21 08:39:30 +00:00
Ian Wienand
3fa721e541 ask.openstack.org: switch backup user to ask01-bup
The new server has new backups

Change-Id: I59ac068e8d049c1293de47979cdbe6f202fad3c6
2019-05-21 17:33:17 +10:00
Dirk Mueller
c43cb4a78f Properly mirror the lxc container images as well
There is convoluted code in openstack ansible CI to
fetch the file from the official mirror, which is frowned
upon for CI reliability purposes. so we have to mirror
it into AFS.

Change-Id: I84c43f8d4eb0d0ae5ca81c4f8620058a3ecc46fe
2019-05-20 15:44:10 +02:00
Ian Wienand
af553c45d7 ask.o.o : workaround old puppet-solr package
puppet-solr is dead upstream.  Even the un-merged pull request for
Xenial support isn't sufficient [1].

We can either get into the business of owning puppet-solr, or hack
around it.  It seems the major difference is that jetty package split
into separate jetty[8|9] packages, and puppet-solr just uses "jetty"
everywhere.

This deb, created by equivs does the following

 * pre-depends on jetty8
 * installs a symlink /etc/init.d/jetty -> jetty8
 * symlinks in the webserver directory to /usr/share/jetty

This appears to be enough to get things going.  By pre-installing it,
puppet-solr is happy enough to go on...

[1] https://github.com/vamsee/puppet-solr/pull/33

Change-Id: Ie86303caeb26634434dc4b2d0d3f1195749a277e
2019-05-20 17:25:20 +10:00
Zuul
8baf6cabd3 Merge "Rename review.openstack.org to review.opendev.org" 2019-05-12 11:46:29 +00:00
Monty Taylor
7f0baf439e Remove unused commit-filter script
This was for cgit servers and is no longer used.

Change-Id: Iea40e04632c61b3b103769645ce0350c35ef8602
2019-05-10 11:43:23 +00:00
Zuul
bdab965d9b Merge "Mirror fedora 30 for jobs" 2019-05-09 22:27:16 +00:00
Zuul
a233ed496f Merge "Add NO_TIMEOUT for mirror update scripts" 2019-05-09 22:18:55 +00:00
Monty Taylor
e69c7b7fb9 Rename review.openstack.org to review.opendev.org
There are many references to review.openstack.org, and while the
redirect should work, we can also go ahead and fix them.

Change-Id: I28f398796a6392a3dffea1d25cfe2ae3a36a3589
2019-05-09 14:38:51 +00:00
Zuul
67df630379 Merge "Remove graphite.openstack.org" 2019-05-08 00:14:25 +00:00
Zuul
e849675d84 Merge "Add mirroring for Stein packages" 2019-05-07 23:48:01 +00:00
Ian Wienand
2acfc176b0 Remove graphite.openstack.org
The server has been removed, remove it from inventory.

While we're here, s/graphite.openstack.org/graphite.opendev.org/'
... it's a CNAME redirect but we might as well clean up.

Change-Id: I36c951c85316cd65dde748b1e50ffa2e058c9a88
2019-05-08 05:55:33 +10:00
smarcet
df1fddf018 Fixed email configuration for openstackid
Change-Id: Id24d3c388cd52071b1f2699ffa7168e0122fb029
2019-05-06 19:03:59 -03:00
Dirk Mueller
36a3be1605 Add mirroring for Stein packages
These are available now, should be enabled by openstack helm

Change-Id: I3946b7077feba4facaff011e78131ffd4cc14dbc
2019-05-03 23:18:26 +02:00
Monty Taylor
b415375f8b Revert "Add cache-control headers for service-types.openstack.org"
This reverts commit fc98399aa4e3837e74b4587df051e9c538fa1462.

Change-Id: Ie9562c096f865195bc44e55ea6425ad207d44e50
2019-05-03 17:20:21 +00:00
Zuul
65e6f62090 Merge "Add cache-control headers for service-types.openstack.org" 2019-05-03 16:25:45 +00:00
Ian Wienand
c4b40028f6 Add NO_TIMEOUT for mirror update scripts
In I239bc1a0b5928673b42cc67291bb519d5f5d2471 we added NO_TIMEOUT as a
variable to reprepro for running when you know the timeout might get
hit (initial syncs, etc).

Add the same variable to the other mirror scripts for consistency.

Change-Id: Id34010058bd18107caee909f877fa817cf16428b
2019-05-03 12:20:06 +10:00
Paul Belanger
534b8d15a7 Mirror fedora 30 for jobs
Now that fedora-30 is released, prepare create images for nodepool by
first setting up mirrors.

Change-Id: I721b2532d41aed5e73e714a66fda1103facdb9f4
Signed-off-by: Paul Belanger <pabelanger@redhat.com>
2019-05-02 20:04:50 -04:00
Zuul
664286c966 Merge "Set logo height rather than width" 2019-05-02 22:25:11 +00:00
smarcet
fa0f5860d2 Update OpenstackId Prod Node Settings
moved from smtp email driver to sendgrid

Change-Id: I719a3fd7e730972b7a0784a9a4857a76672119d0
2019-04-30 14:24:42 -03:00
smarcet
728ed674da OpenStackID production deployment 2.0.1
* migrated from stmp to sendgrid api to send emails
* parametrized registration urls

Change-Id: I258ef22f2201b53e4e0ec872a873f07e0c921967
2019-04-30 09:29:49 -03:00
smarcet
66bf9c5cc4 OpenStackid parametrized urls
updated config to be able to setup registration/lost password
and resend verification link by config

Depends-On: https://review.opendev.org/#/c/656395/
Depends-On: https://review.opendev.org/#/c/656396/
Change-Id: I9df2afbc6a90652030fde5398f8ac28ca3c4c397
2019-04-29 18:41:54 -03:00