4251-4300 of 10000 results (94ms)
2023-03-13 ยง
11:22 <jnuche@deploy2002> Installation of scap version "latest" completed for 553 hosts [production]
11:21 <jnuche@deploy2002> Installing scap version "latest" for 553 hosts [production]
11:11 <moritzm> imported php-msgpack 2.1.2+0.5.7-2+wmf1+buster1+icu67u1 T329491 [production]
10:55 <moritzm> imported php-imagick 3.4.4+php8.0+3.4.4-2+deb11u2+wmf1+buster1+icu67u1 T329491 [production]
10:43 <marostegui@cumin1001> dbctl commit (dc=all): 'Depooling db2159 (T329260)', diff saved to https://phabricator.wikimedia.org/P45757 and previous config saved to /var/cache/conftool/dbconfig/20230313-104322-marostegui.json [production]
10:43 <marostegui@cumin1001> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 1 day, 0:00:00 on db2187.codfw.wmnet with reason: Maintenance [production]
10:43 <marostegui@cumin1001> START - Cookbook sre.hosts.downtime for 1 day, 0:00:00 on db2187.codfw.wmnet with reason: Maintenance [production]
10:43 <marostegui@cumin1001> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 12:00:00 on db2159.codfw.wmnet with reason: Maintenance [production]
10:42 <marostegui@cumin1001> START - Cookbook sre.hosts.downtime for 12:00:00 on db2159.codfw.wmnet with reason: Maintenance [production]
10:42 <marostegui@cumin1001> dbctl commit (dc=all): 'Repooling after maintenance db2150 (T329260)', diff saved to https://phabricator.wikimedia.org/P45756 and previous config saved to /var/cache/conftool/dbconfig/20230313-104246-marostegui.json [production]
10:38 <moritzm> imported php-pcov 1.0.6-4+wmf1~buster1+icu67u1 T329491 [production]
10:32 <gmodena@deploy1002> helmfile [dse-k8s-eqiad] DONE helmfile.d/dse-k8s-services/mediawiki-page-content-change-enrichment: apply [production]
10:32 <gmodena@deploy1002> helmfile [dse-k8s-eqiad] START helmfile.d/dse-k8s-services/mediawiki-page-content-change-enrichment: apply [production]
10:30 <gmodena@deploy1002> helmfile [dse-k8s-eqiad] DONE helmfile.d/dse-k8s-services/mediawiki-page-content-change-enrichment: apply [production]
10:30 <gmodena@deploy1002> helmfile [dse-k8s-eqiad] START helmfile.d/dse-k8s-services/mediawiki-page-content-change-enrichment: apply [production]
10:27 <marostegui@cumin1001> dbctl commit (dc=all): 'Repooling after maintenance db2150', diff saved to https://phabricator.wikimedia.org/P45755 and previous config saved to /var/cache/conftool/dbconfig/20230313-102740-marostegui.json [production]
10:26 <moritzm> imported php-defaults 7.4+76+wmf1~buster2+icu67u1 T329491 [production]
10:12 <ayounsi@cumin1001> END (PASS) - Cookbook sre.network.peering (exit_code=0) with action 'email' for AS: 55701 [production]
10:12 <marostegui@cumin1001> dbctl commit (dc=all): 'Repooling after maintenance db2150', diff saved to https://phabricator.wikimedia.org/P45754 and previous config saved to /var/cache/conftool/dbconfig/20230313-101234-marostegui.json [production]
10:10 <ayounsi@cumin1001> START - Cookbook sre.network.peering with action 'email' for AS: 55701 [production]
10:10 <ayounsi@cumin1001> END (PASS) - Cookbook sre.network.peering (exit_code=0) with action 'email' for AS: 38193 [production]
10:10 <ayounsi@cumin1001> START - Cookbook sre.network.peering with action 'email' for AS: 38193 [production]
10:10 <ayounsi@cumin1001> END (PASS) - Cookbook sre.network.peering (exit_code=0) with action 'email' for AS: 46632 [production]
10:10 <ayounsi@cumin1001> START - Cookbook sre.network.peering with action 'email' for AS: 46632 [production]
10:10 <ayounsi@cumin1001> END (PASS) - Cookbook sre.network.peering (exit_code=0) with action 'email' for AS: 6663 [production]
10:09 <ayounsi@cumin1001> START - Cookbook sre.network.peering with action 'email' for AS: 6663 [production]
10:08 <ayounsi@cumin1001> END (PASS) - Cookbook sre.network.peering (exit_code=0) with action 'email' for AS: 45558 [production]
10:08 <ayounsi@cumin1001> START - Cookbook sre.network.peering with action 'email' for AS: 45558 [production]
10:08 <ayounsi@cumin1001> END (PASS) - Cookbook sre.network.peering (exit_code=0) with action 'email' for AS: 38082 [production]
10:07 <ayounsi@cumin1001> START - Cookbook sre.network.peering with action 'email' for AS: 38082 [production]
10:07 <ayounsi@cumin1001> END (PASS) - Cookbook sre.network.peering (exit_code=0) with action 'email' for AS: 668 [production]
10:06 <ayounsi@cumin1001> START - Cookbook sre.network.peering with action 'email' for AS: 668 [production]
10:05 <gmodena@deploy1002> helmfile [dse-k8s-eqiad] DONE helmfile.d/dse-k8s-services/mediawiki-page-content-change-enrichment: apply [production]
10:05 <gmodena@deploy1002> helmfile [dse-k8s-eqiad] START helmfile.d/dse-k8s-services/mediawiki-page-content-change-enrichment: apply [production]
10:02 <moritzm> imported dh-php 0.35+wmf1+buster1+icu67u1 T329491 [production]
09:57 <marostegui@cumin1001> dbctl commit (dc=all): 'Repooling after maintenance db2150 (T329260)', diff saved to https://phabricator.wikimedia.org/P45753 and previous config saved to /var/cache/conftool/dbconfig/20230313-095728-marostegui.json [production]
09:55 <vgutierrez> Enable haproxy hardening in cp hosts globally - T323944 [production]
09:52 <zabe@deploy2002> Finished scap: Backport for [[gerrit:896037|Drop loading of former extension Renameuser's i18n strings [Re-apply]]] (duration: 07m 40s) [production]
09:51 <marostegui@cumin1001> dbctl commit (dc=all): 'Depooling db2150 (T329260)', diff saved to https://phabricator.wikimedia.org/P45752 and previous config saved to /var/cache/conftool/dbconfig/20230313-095119-marostegui.json [production]
09:51 <marostegui@cumin1001> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 12:00:00 on db2150.codfw.wmnet with reason: Maintenance [production]
09:51 <marostegui@cumin1001> START - Cookbook sre.hosts.downtime for 12:00:00 on db2150.codfw.wmnet with reason: Maintenance [production]
09:50 <marostegui@cumin1001> dbctl commit (dc=all): 'Repooling after maintenance db2122 (T329260)', diff saved to https://phabricator.wikimedia.org/P45751 and previous config saved to /var/cache/conftool/dbconfig/20230313-095058-marostegui.json [production]
09:48 <jayme> pcc-worker1003:~# rm -r /srv/jenkins/puppet-compiler/40076 - / back to 70% [production]
09:46 <zabe@deploy2002> jforrester and zabe: Backport for [[gerrit:896037|Drop loading of former extension Renameuser's i18n strings [Re-apply]]] synced to the testservers: mwdebug1001.eqiad.wmnet, mwdebug1002.eqiad.wmnet, mwdebug2001.codfw.wmnet, mwdebug2002.codfw.wmnet [production]
09:45 <jayme> pcc-worker1002:~# rm -r /srv/jenkins/puppet-compiler/40078 - / back to 47% usage [production]
09:44 <zabe@deploy2002> Started scap: Backport for [[gerrit:896037|Drop loading of former extension Renameuser's i18n strings [Re-apply]]] [production]
09:44 <zabe@deploy2002> Finished scap: Backport for [[gerrit:897804|Revert "Revert "Unload RenameUser, now part of core: Part I of II"" (T331685)]] (duration: 07m 52s) [production]
09:40 <jayme> pcc-worker1001:~# rm -r /srv/jenkins/puppet-compiler/40079 /srv/jenkins/puppet-compiler/38943 - / back to 68% usage [production]
09:38 <zabe@deploy2002> zabe: Backport for [[gerrit:897804|Revert "Revert "Unload RenameUser, now part of core: Part I of II"" (T331685)]] synced to the testservers: mwdebug2001.codfw.wmnet, mwdebug1002.eqiad.wmnet, mwdebug1001.eqiad.wmnet, mwdebug2002.codfw.wmnet [production]
09:36 <zabe@deploy2002> Started scap: Backport for [[gerrit:897804|Revert "Revert "Unload RenameUser, now part of core: Part I of II"" (T331685)]] [production]