1001-1050 of 10000 results (52ms)
2022-04-28 ยง
14:42 <kormat@cumin1001> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 1:30:00 on db2146.codfw.wmnet with reason: Rebooting for T303171 [production]
14:42 <kormat@cumin1001> START - Cookbook sre.hosts.downtime for 1:30:00 on db2146.codfw.wmnet with reason: Rebooting for T303171 [production]
14:41 <kormat@cumin1001> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 1:30:00 on db2145.codfw.wmnet with reason: Rebooting for T303171 [production]
14:41 <kormat@cumin1001> START - Cookbook sre.hosts.downtime for 1:30:00 on db2145.codfw.wmnet with reason: Rebooting for T303171 [production]
14:40 <kormat@cumin1001> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 1:30:00 on db2116.codfw.wmnet with reason: Rebooting for T303171 [production]
14:40 <kormat@cumin1001> START - Cookbook sre.hosts.downtime for 1:30:00 on db2116.codfw.wmnet with reason: Rebooting for T303171 [production]
14:40 <kormat@cumin1001> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 1:30:00 on db2130.codfw.wmnet with reason: Rebooting for T303171 [production]
14:40 <kormat@cumin1001> START - Cookbook sre.hosts.downtime for 1:30:00 on db2130.codfw.wmnet with reason: Rebooting for T303171 [production]
14:40 <kormat@cumin1001> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 1:30:00 on db2112.codfw.wmnet with reason: Rebooting for T303171 [production]
14:40 <kormat@cumin1001> START - Cookbook sre.hosts.downtime for 1:30:00 on db2112.codfw.wmnet with reason: Rebooting for T303171 [production]
14:39 <jmm@cumin2002> START - Cookbook sre.hosts.reboot-single for host restbase2025.codfw.wmnet [production]
14:38 <kormat@cumin1001> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 1:30:00 on db2092.codfw.wmnet with reason: Rebooting for T303171 [production]
14:38 <kormat@cumin1001> START - Cookbook sre.hosts.downtime for 1:30:00 on db2092.codfw.wmnet with reason: Rebooting for T303171 [production]
14:36 <kormat@cumin1001> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 2:00:00 on db2071.codfw.wmnet with reason: host reimage [production]
14:33 <jmm@cumin2002> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 2:00:00 on ganeti-test2002.codfw.wmnet with reason: host reimage [production]
14:32 <kormat@cumin1001> START - Cookbook sre.hosts.downtime for 2:00:00 on db2071.codfw.wmnet with reason: host reimage [production]
14:29 <jmm@cumin2002> START - Cookbook sre.hosts.downtime for 2:00:00 on ganeti-test2002.codfw.wmnet with reason: host reimage [production]
14:25 <jmm@cumin2002> END (PASS) - Cookbook sre.hosts.reboot-single (exit_code=0) for host restbase2024.codfw.wmnet [production]
14:18 <jmm@cumin2002> START - Cookbook sre.hosts.reboot-single for host restbase2024.codfw.wmnet [production]
14:18 <mwdebug-deploy@deploy1002> helmfile [codfw] DONE helmfile.d/services/mwdebug: apply [production]
14:17 <mwdebug-deploy@deploy1002> helmfile [codfw] START helmfile.d/services/mwdebug: apply [production]
14:17 <mwdebug-deploy@deploy1002> helmfile [eqiad] DONE helmfile.d/services/mwdebug: apply [production]
14:17 <jelto@cumin1001> END (PASS) - Cookbook sre.hosts.reboot-cluster (exit_code=0) [production]
14:16 <mwdebug-deploy@deploy1002> helmfile [eqiad] START helmfile.d/services/mwdebug: apply [production]
14:15 <jmm@cumin2002> START - Cookbook sre.hosts.reimage for host ganeti-test2002.codfw.wmnet with OS bullseye [production]
14:14 <kormat@cumin1001> START - Cookbook sre.hosts.reimage for host db2071.codfw.wmnet with OS bullseye [production]
14:11 <mwdebug-deploy@deploy1002> helmfile [codfw] DONE helmfile.d/services/mwdebug: apply [production]
14:10 <mwdebug-deploy@deploy1002> helmfile [codfw] START helmfile.d/services/mwdebug: apply [production]
14:10 <mwdebug-deploy@deploy1002> helmfile [eqiad] DONE helmfile.d/services/mwdebug: apply [production]
14:09 <mwdebug-deploy@deploy1002> helmfile [eqiad] START helmfile.d/services/mwdebug: apply [production]
14:09 <kormat> reimaging s1 to bullseye on s2@codfw dbmaint (T303171) [production]
14:08 <kormat@deploy1002> Synchronized wmf-config/ProductionServices.php: Set pc1013 as pc3 primary T307101 (duration: 00m 54s) [production]
14:08 <jmm@cumin2002> END (PASS) - Cookbook sre.hosts.reboot-single (exit_code=0) for host restbase2023.codfw.wmnet [production]
14:07 <dcaro@cumin1001> END (PASS) - Cookbook sre.hosts.reboot-single (exit_code=0) for host cloudbackup1004.eqiad.wmnet [production]
14:06 <jgiannelos@deploy1002> helmfile [eqiad] DONE helmfile.d/services/tegola-vector-tiles: sync [production]
14:06 <Lucas_WMDE> UTC afternoon backport window done [production]
14:06 <jgiannelos@deploy1002> helmfile [eqiad] START helmfile.d/services/tegola-vector-tiles: sync [production]
14:05 <lucaswerkmeister-wmde@deploy1002> Synchronized wmf-config/InitialiseSettings.php: Config: [[gerrit:787111|itwiki: assign 'setmentor' to 'bot' usergroup (T307005)]] (duration: 00m 55s) [production]
14:05 <jgiannelos@deploy1002> helmfile [eqiad] DONE helmfile.d/services/tegola-vector-tiles: apply [production]
14:05 <jgiannelos@deploy1002> helmfile [eqiad] START helmfile.d/services/tegola-vector-tiles: apply [production]
14:05 <jgiannelos@deploy1002> helmfile [eqiad] DONE helmfile.d/services/tegola-vector-tiles: apply [production]
14:05 <jgiannelos@deploy1002> helmfile [eqiad] START helmfile.d/services/tegola-vector-tiles: apply [production]
14:04 <mwdebug-deploy@deploy1002> helmfile [codfw] DONE helmfile.d/services/mwdebug: apply [production]
14:02 <kormat@cumin1001> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 1:30:00 on db2071.codfw.wmnet with reason: Rebooting for T303171 [production]
14:02 <hnowlan@puppetmaster1001> conftool action : set/pooled=false; selector: dnsdisc=kartotherian,name=codfw [production]
14:02 <kormat@cumin1001> START - Cookbook sre.hosts.downtime for 1:30:00 on db2071.codfw.wmnet with reason: Rebooting for T303171 [production]
14:01 <lucaswerkmeister-wmde@deploy1002> Synchronized wmf-config/abusefilter.php: Config: [[gerrit:787115|zhwikiversity: Enable blocking feature of AbuseFilter (T307007)]] (duration: 00m 51s) [production]
14:00 <mwdebug-deploy@deploy1002> helmfile [codfw] START helmfile.d/services/mwdebug: apply [production]
14:00 <mwdebug-deploy@deploy1002> helmfile [eqiad] DONE helmfile.d/services/mwdebug: apply [production]
14:00 <dcaro@cumin1001> START - Cookbook sre.hosts.reboot-single for host cloudbackup1004.eqiad.wmnet [production]