system-config/playbooks
Ian Wienand 4918594aa4 rsync-mirrors: drop rsync -t and make flags consistent
After investigating why every release seems to take hours, we noticed
that even in zero-delta updates where nothing has changed upstream,
we'd get a utimensat() call that updated the modified time nanoseconds
portion; e.g.

 lstat("Everything/x86_64/Packages/a/arch-install-scripts-23-1.fc31.noarch.rpm", {st_mode=S_IFREG|0644, st_size=28004, ...}) = 0
 utimensat(AT_FDCWD, "Everything/x86_64/Packages/a/arch-install-scripts-23-1.fc31.noarch.rpm",
  [UTIME_NOW, {tv_sec=1585676005, tv_nsec=6041000} /* 2020-03-31T17:33:25.006041000+0000 */], AT_SYMLINK_NOFOLLOW) = 0

This does not apply; in fact openafs uses the ns field as some sort of
generation counter [1].  This update is enough to convince openafs the
file has changed and it needs to be resynced, meaning that basically
every rsync run results in a full release.

This unnecessary update been fixed with [2] but is only in rsync
3.1.3+; our bionic host is currently 3.1.2.  Dropping "-t" from the
rsync commands avoids transferring modification times and should avoid
this problem.

While looking, "-D" turns on "--devices" and "--specials" to transfer
block devices and named sockets/fifos.  Turn this off.

Also remove "-p" if it was present.  We already did this for centos
with Ib5db052cdd23e39aecbeead15cf08d4bd7fcab38 and Fedora with
Id24196791f80cd99fe8a330fb2c7c6d893fc9995, where odd upstream
permissions such as setgid on directories can't be synced to afs.
Consistently remove it.

Also switch back the fedora updates to just "-v"; we had it at "-i"
for debugging.

[1] http://eavesdrop.openstack.org/irclogs/%23opendev/%23opendev.2020-06-15.log.html#t2020-06-15T02:58:08-2
[2] https://git.samba.org/?p=rsync.git;a=patch;h=0f8e9e2d8638e47d646a6baba694b303ac84e695

Change-Id: I78f3d4990b168c71185eb1c4900ceeaca4b6a16f
2020-06-16 11:50:48 +10:00
..
filter_plugins dns_[a|aaaa] filter; use host for lookup 2018-09-13 22:50:40 +10:00
group_vars Split inventory into multiple dirs and move hostvars 2020-06-04 07:44:36 -05:00
k8s Add resources for deploying rook and xtradb to kuberenets 2019-02-05 18:52:21 +00:00
module_utils/facts/system Ensure apt is used on ubuntu hosts with zypper 2018-08-20 20:45:13 +00:00
periodic Remove old 404 checker job 2020-03-11 15:15:00 -07:00
roles rsync-mirrors: drop rsync -t and make flags consistent 2020-06-16 11:50:48 +10:00
templates/clouds Remove linaro-london cloud 2020-05-16 10:14:09 +10:00
zuul Merge "Fake zuul_connections for gate" 2020-06-15 21:47:49 +00:00
apply-package-updates.yaml Apply package updates before we reboot in launch-node 2019-02-26 14:17:23 -08:00
base.yaml Run iptables in service playbooks instead of base 2020-06-04 07:44:22 -05:00
bootstrap-k8s-nodes.yaml Stop running k8s-on-openstack nested 2019-02-12 18:17:46 +00:00
gitea-rename-setup-org.yaml Restore setup-org.yaml 2019-09-18 12:40:19 -07:00
gitea-rename-tasks.yaml Restore setup-org.yaml 2019-09-18 12:40:19 -07:00
install-ansible.yaml Update to Ansible 2.9.8 2020-05-13 05:32:54 +10:00
install_puppet.yaml Handle moved puppet repos 2019-05-15 16:03:07 -07:00
letsencrypt.yaml Rename service-letsencrypt to just letsencrypt 2020-06-04 07:44:36 -05:00
manage-projects.yaml Use project-config from zuul instead of direct clones 2020-04-15 12:29:33 -05:00
nodepool_restart.yaml Add nodepool_restart playbook 2019-03-04 09:20:07 -08:00
remote_puppet_adhoc.yaml Clean up puppet variables and playbooks 2018-08-17 09:41:12 -05:00
remote_puppet_afs.yaml Use zuul checkouts of ansible roles from other repos 2020-04-30 12:39:12 -05:00
remote_puppet_else.yaml Use zuul checkouts of ansible roles from other repos 2020-04-30 12:39:12 -05:00
rename_repos.yaml Fix rename playbook after zuul user rename 2020-06-12 14:21:33 -07:00
run-accessbot.yaml Split eavesdrop into its own playbook 2020-04-23 14:34:28 -05:00
run_cloud_launcher.yaml Use zuul checkouts of ansible roles from other repos 2020-04-30 12:39:12 -05:00
service-backup.yaml Run iptables in service playbooks instead of base 2020-06-04 07:44:22 -05:00
service-bridge.yaml Add tool to export Rackspace DNS domains to bind format 2020-06-12 16:49:23 +10:00
service-codesearch.yaml Install pip3 on codesearch 2020-06-15 14:35:41 -05:00
service-eavesdrop.yaml Run iptables in service playbooks instead of base 2020-06-04 07:44:22 -05:00
service-etherpad.yaml Run iptables in service playbooks instead of base 2020-06-04 07:44:22 -05:00
service-gitea-lb.yaml Run iptables in service playbooks instead of base 2020-06-04 07:44:22 -05:00
service-gitea.yaml Run iptables in service playbooks instead of base 2020-06-04 07:44:22 -05:00
service-meetpad.yaml Run iptables in service playbooks instead of base 2020-06-04 07:44:22 -05:00
service-mirror-update.yaml Run iptables in service playbooks instead of base 2020-06-04 07:44:22 -05:00
service-mirror.yaml Run iptables in service playbooks instead of base 2020-06-04 07:44:22 -05:00
service-nameserver.yaml Run iptables in service playbooks instead of base 2020-06-04 07:44:22 -05:00
service-nodepool.yaml Run iptables in service playbooks instead of base 2020-06-04 07:44:22 -05:00
service-registry.yaml Run iptables in service playbooks instead of base 2020-06-04 07:44:22 -05:00
service-review-dev.yaml Run iptables in service playbooks instead of base 2020-06-04 07:44:22 -05:00
service-review.yaml Run iptables in service playbooks instead of base 2020-06-04 07:44:22 -05:00
service-static.yaml Run iptables in service playbooks instead of base 2020-06-04 07:44:22 -05:00
service-zookeeper.yaml Run iptables in service playbooks instead of base 2020-06-04 07:44:22 -05:00
service-zuul-preview.yaml Run iptables in service playbooks instead of base 2020-06-04 07:44:22 -05:00
service-zuul.yaml Run iptables in service playbooks instead of base 2020-06-04 07:44:22 -05:00
set-hostnames.yaml Split eavesdrop into its own playbook 2020-04-23 14:34:28 -05:00
start-mergers-executors.yaml Rework zuul start/stop/restart playbooks for docker 2020-04-27 09:34:50 -05:00
stop-mergers-executors.yaml Rework zuul start/stop/restart playbooks for docker 2020-04-27 09:34:50 -05:00
sync-gitea-projects.yaml Fix URLs after OpenDev rename 2020-03-18 18:23:17 +01:00
test-gitea.yaml Run actual full project creation in gitea test 2019-07-11 13:39:22 -07:00
unattended_upgrades.yml Rename attended_upgrades playbook to unattended_upgrades 2016-07-19 10:41:09 +02:00
update_puppet_version.yaml Fix URLs after OpenDev rename 2020-03-18 18:23:17 +01:00
zuul_reconfigure.yaml Stub out zuul_reconfigure playbook 2018-09-14 09:17:36 -06:00
zuul_restart.yaml Rework zuul start/stop/restart playbooks for docker 2020-04-27 09:34:50 -05:00
zuul_start.yaml Rework zuul start/stop/restart playbooks for docker 2020-04-27 09:34:50 -05:00
zuul_stop.yaml Rework zuul start/stop/restart playbooks for docker 2020-04-27 09:34:50 -05:00