6201-6250 of 10000 results (97ms)
2023-03-20 ยง
14:29 <sukhe@cumin2002> START - Cookbook sre.hosts.downtime for 1:00:00 on lvs2008.codfw.wmnet with reason: T326564 [production]
14:17 <bking@deploy2002> helmfile [dse-k8s-eqiad] DONE helmfile.d/dse-k8s-services/mediawiki-page-content-change-enrichment: apply [production]
14:17 <bking@deploy2002> helmfile [dse-k8s-eqiad] START helmfile.d/dse-k8s-services/mediawiki-page-content-change-enrichment: apply [production]
14:17 <kharlan@deploy2002> helmfile [codfw] DONE helmfile.d/services/changeprop-jobqueue: apply [production]
14:11 <TheresNoTime> close UTC afternoon backport window [production]
14:10 <sukhe@cumin2002> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 0:30:00 on lvs1018.eqiad.wmnet with reason: rebooting for kernel updates [production]
14:10 <sukhe@cumin2002> START - Cookbook sre.hosts.downtime for 0:30:00 on lvs1018.eqiad.wmnet with reason: rebooting for kernel updates [production]
14:08 <TheresNoTime> `[samtar@mwmaint2002 ~]$ mwscript maintenance/migrateUserGroup.php --wiki ptwikisource 'autopatrol' 'autopatrolled'` T331762 [production]
14:06 <kharlan@deploy2002> helmfile [codfw] START helmfile.d/services/changeprop-jobqueue: apply [production]
14:05 <TheresNoTime> `[samtar@mwmaint2002 ~]$ mwscript maintenance/migrateUserGroup.php --wiki ptwikisource 'autoreview' 'autopatrol'` T331762 [production]
14:03 <TheresNoTime> `[samtar@mwmaint2002 ~]$ mwscript maintenance/namespaceDupes.php --wiki slwiki --fix` T332351 [production]
14:01 <TheresNoTime> `[samtar@mwmaint2002 ~]$ mwscript maintenance/migrateUserGroup.php --wiki ptwikisource 'reviewer' 'patrol'` T331762 [production]
14:01 <TheresNoTime> `[samtar@mwmaint2002 ~]$ mwscript maintenance/migrateUserGroup.php --wiki ptwikisource 'autoreviewer' 'autopatrol'` ("nothing to do") T331762 [production]
14:00 <TheresNoTime> `[samtar@mwmaint2002 ~]$ mwscript maintenance/emptyUserGroup.php --wiki ptwikisource editor` T331762 [production]
13:58 <samtar@deploy2002> Finished scap: Backport for [[gerrit:776200|Remove meaningless restriction level "none"]], [[gerrit:900696|Remove FlaggedRevs from ptwikisource (T331762)]] (duration: 09m 44s) [production]
13:50 <samtar@deploy2002> thiemowmde and samtar and zoranzoki21: Backport for [[gerrit:776200|Remove meaningless restriction level "none"]], [[gerrit:900696|Remove FlaggedRevs from ptwikisource (T331762)]] synced to the testservers: mwdebug2002.codfw.wmnet, mwdebug1001.eqiad.wmnet, mwdebug2001.codfw.wmnet, mwdebug1002.eqiad.wmnet [production]
13:49 <samtar@deploy2002> Started scap: Backport for [[gerrit:776200|Remove meaningless restriction level "none"]], [[gerrit:900696|Remove FlaggedRevs from ptwikisource (T331762)]] [production]
13:47 <samtar@deploy2002> Finished scap: Backport for [[gerrit:900675|SITENAME change of Serbo-Croatian Wikipedia (T332468)]] (duration: 09m 26s) [production]
13:41 <jmm@cumin2002> END (PASS) - Cookbook sre.ganeti.reimage (exit_code=0) for host cuminunpriv1001.eqiad.wmnet with OS bullseye [production]
13:39 <samtar@deploy2002> aleksandar and samtar: Backport for [[gerrit:900675|SITENAME change of Serbo-Croatian Wikipedia (T332468)]] synced to the testservers: mwdebug1001.eqiad.wmnet, mwdebug2002.codfw.wmnet, mwdebug1002.eqiad.wmnet, mwdebug2001.codfw.wmnet [production]
13:38 <samtar@deploy2002> Started scap: Backport for [[gerrit:900675|SITENAME change of Serbo-Croatian Wikipedia (T332468)]] [production]
13:37 <samtar@deploy2002> Finished scap: Backport for [[gerrit:900689|kuwiktionary: Add wordmark (T326067)]], [[gerrit:900742|trwikivoyage: Update wordmark (T332439)]] (duration: 08m 46s) [production]
13:35 <sukhe@cumin2002> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 0:30:00 on lvs2008.codfw.wmnet with reason: rebooting for kernel updates [production]
13:35 <sukhe@cumin2002> START - Cookbook sre.hosts.downtime for 0:30:00 on lvs2008.codfw.wmnet with reason: rebooting for kernel updates [production]
13:34 <sukhe@cumin2002> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 0:30:00 on lvs3005.esams.wmnet with reason: rebooting for kernel updates [production]
13:34 <sukhe@cumin2002> START - Cookbook sre.hosts.downtime for 0:30:00 on lvs3005.esams.wmnet with reason: rebooting for kernel updates [production]
13:30 <awight@deploy2002> Finished deploy [kartotherian/deploy@906be32] (eqiad): Update kartotherian to a6e9843 (duration: 01m 30s) [production]
13:29 <samtar@deploy2002> stang and samtar: Backport for [[gerrit:900689|kuwiktionary: Add wordmark (T326067)]], [[gerrit:900742|trwikivoyage: Update wordmark (T332439)]] synced to the testservers: mwdebug2001.codfw.wmnet, mwdebug1002.eqiad.wmnet, mwdebug2002.codfw.wmnet, mwdebug1001.eqiad.wmnet [production]
13:29 <jmm@cumin2002> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 2:00:00 on cuminunpriv1001.eqiad.wmnet with reason: host reimage [production]
13:29 <awight@deploy2002> Started deploy [kartotherian/deploy@906be32] (eqiad): Update kartotherian to a6e9843 [production]
13:28 <samtar@deploy2002> Started scap: Backport for [[gerrit:900689|kuwiktionary: Add wordmark (T326067)]], [[gerrit:900742|trwikivoyage: Update wordmark (T332439)]] [production]
13:28 <kharlan@deploy2002> helmfile [codfw] DONE helmfile.d/services/changeprop-jobqueue: apply [production]
13:26 <awight@deploy2002> Finished deploy [kartotherian/deploy@906be32] (codfw): Update kartotherian to a6e9843 (duration: 01m 39s) [production]
13:26 <jmm@cumin2002> START - Cookbook sre.hosts.downtime for 2:00:00 on cuminunpriv1001.eqiad.wmnet with reason: host reimage [production]
13:24 <awight@deploy2002> Started deploy [kartotherian/deploy@906be32] (codfw): Update kartotherian to a6e9843 [production]
13:18 <samtar@deploy2002> Finished scap: Backport for [[gerrit:900537|bewiki: Remove group "autoeditor", "reviewer" (T326012)]], [[gerrit:900690|slwiki: Create Draft namespace (T332351)]] (duration: 11m 36s) [production]
13:18 <jmm@cumin2002> START - Cookbook sre.ganeti.reimage for host cuminunpriv1001.eqiad.wmnet with OS bullseye [production]
13:17 <kharlan@deploy2002> helmfile [codfw] START helmfile.d/services/changeprop-jobqueue: apply [production]
13:17 <kharlan@deploy2002> helmfile [eqiad] DONE helmfile.d/services/changeprop-jobqueue: apply [production]
13:15 <kharlan@deploy2002> helmfile [eqiad] START helmfile.d/services/changeprop-jobqueue: apply [production]
13:14 <kharlan@deploy2002> helmfile [staging] DONE helmfile.d/services/changeprop-jobqueue: apply [production]
13:14 <kharlan@deploy2002> helmfile [staging] START helmfile.d/services/changeprop-jobqueue: apply [production]
13:08 <samtar@deploy2002> stang and samtar: Backport for [[gerrit:900537|bewiki: Remove group "autoeditor", "reviewer" (T326012)]], [[gerrit:900690|slwiki: Create Draft namespace (T332351)]] synced to the testservers: mwdebug1001.eqiad.wmnet, mwdebug1002.eqiad.wmnet, mwdebug2002.codfw.wmnet, mwdebug2001.codfw.wmnet [production]
13:06 <samtar@deploy2002> Started scap: Backport for [[gerrit:900537|bewiki: Remove group "autoeditor", "reviewer" (T326012)]], [[gerrit:900690|slwiki: Create Draft namespace (T332351)]] [production]
11:35 <krinkle@deploy2002> Synchronized php-1.40.0-wmf.27/includes/libs/rdbms/: (no justification provided) (duration: 15m 28s) [production]
09:57 <ayounsi@cumin1001> END (PASS) - Cookbook sre.network.peering (exit_code=0) with action 'email' for AS: 36692 [production]
09:56 <ayounsi@cumin1001> START - Cookbook sre.network.peering with action 'email' for AS: 36692 [production]
09:56 <ayounsi@cumin1001> END (PASS) - Cookbook sre.network.peering (exit_code=0) with action 'email' for AS: 12956 [production]
09:56 <ayounsi@cumin1001> START - Cookbook sre.network.peering with action 'email' for AS: 12956 [production]
09:55 <ayounsi@cumin1001> END (PASS) - Cookbook sre.network.peering (exit_code=0) with action 'email' for AS: 141082 [production]