4051-4100 of 10000 results (62ms)
2022-05-10 ยง
08:57 <mvernon@cumin1001> START - Cookbook sre.hosts.reimage for host ms-be2053.codfw.wmnet with OS bullseye [production]
08:53 <klausman@cumin2002> START - Cookbook sre.hosts.reimage for host ores2003.codfw.wmnet with OS buster [production]
08:51 <mvernon@cumin1001> END (PASS) - Cookbook sre.hosts.reboot-single (exit_code=0) for host ms-be1040.eqiad.wmnet [production]
08:48 <marostegui> Rename revision_actor_temp on db2092 T307906 [production]
08:48 <marostegui> dbmaint s1@codfw T307906 [production]
08:48 <jmm@cumin2002> END (PASS) - Cookbook sre.hosts.reboot-single (exit_code=0) for host ganeti6004.drmrs.wmnet [production]
08:46 <mvernon@cumin1001> START - Cookbook sre.hosts.reboot-single for host ms-be1040.eqiad.wmnet [production]
08:43 <jmm@cumin2002> START - Cookbook sre.hosts.reboot-single for host ganeti6004.drmrs.wmnet [production]
08:38 <mvernon@cumin1001> END (PASS) - Cookbook sre.hosts.reboot-single (exit_code=0) for host ms-be2042.codfw.wmnet [production]
08:33 <moritzm> failover ganeti master for drmrs/B13 to ganeti6002 [production]
08:33 <mvernon@cumin1001> START - Cookbook sre.hosts.reboot-single for host ms-be2042.codfw.wmnet [production]
08:31 <jmm@cumin2002> END (PASS) - Cookbook sre.hosts.reboot-single (exit_code=0) for host ganeti6002.drmrs.wmnet [production]
08:26 <jmm@cumin2002> START - Cookbook sre.hosts.reboot-single for host ganeti6002.drmrs.wmnet [production]
08:20 <jmm@cumin2002> END (FAIL) - Cookbook sre.hosts.reboot-single (exit_code=1) for host ganeti6003.drmrs.wmnet [production]
08:19 <mwdebug-deploy@deploy1002> helmfile [codfw] DONE helmfile.d/services/mwdebug: apply [production]
08:18 <mvernon@cumin1001> END (PASS) - Cookbook sre.hosts.reboot-single (exit_code=0) for host ms-be2041.codfw.wmnet [production]
08:18 <mwdebug-deploy@deploy1002> helmfile [codfw] START helmfile.d/services/mwdebug: apply [production]
08:18 <mwdebug-deploy@deploy1002> helmfile [eqiad] DONE helmfile.d/services/mwdebug: apply [production]
08:17 <mwdebug-deploy@deploy1002> helmfile [eqiad] START helmfile.d/services/mwdebug: apply [production]
08:12 <mwdebug-deploy@deploy1002> helmfile [codfw] DONE helmfile.d/services/mwdebug: apply [production]
08:12 <mvernon@cumin1001> START - Cookbook sre.hosts.reboot-single for host ms-be2041.codfw.wmnet [production]
08:11 <mwdebug-deploy@deploy1002> helmfile [codfw] START helmfile.d/services/mwdebug: apply [production]
08:11 <mwdebug-deploy@deploy1002> helmfile [eqiad] DONE helmfile.d/services/mwdebug: apply [production]
08:10 <jmm@cumin2002> START - Cookbook sre.hosts.reboot-single for host ganeti6003.drmrs.wmnet [production]
08:10 <mwdebug-deploy@deploy1002> helmfile [eqiad] START helmfile.d/services/mwdebug: apply [production]
08:10 <ladsgroup@deploy1002> Synchronized wmf-config/InitialiseSettings.php: Config: [[gerrit:790430|Revert "Revert "Set arwiki to read new in templatelinks migration""]] (duration: 00m 48s) [production]
08:06 <ladsgroup@deploy1002> Synchronized wmf-config: Config: [[gerrit:787698|Clean up unnecessary two-level setting]] (duration: 00m 48s) [production]
08:05 <mwdebug-deploy@deploy1002> helmfile [codfw] DONE helmfile.d/services/mwdebug: apply [production]
08:05 <ladsgroup@deploy1002> Synchronized wmf-config/InitialiseSettings.php: Config: [[gerrit:790618|Stop writing to revision_actor_temp table everywhere (T275246)]] (duration: 00m 48s) [production]
08:04 <mwdebug-deploy@deploy1002> helmfile [codfw] START helmfile.d/services/mwdebug: apply [production]
08:04 <mwdebug-deploy@deploy1002> helmfile [eqiad] DONE helmfile.d/services/mwdebug: apply [production]
08:03 <mwdebug-deploy@deploy1002> helmfile [eqiad] START helmfile.d/services/mwdebug: apply [production]
08:00 <ladsgroup@deploy1002> Synchronized php-1.39.0-wmf.10/includes/api/ApiQueryLinks.php: Backport: [[gerrit:790427|api: Add support for linksmigration in ApiQueryLinks (T304780)]] (duration: 00m 49s) [production]
07:58 <mwdebug-deploy@deploy1002> helmfile [codfw] DONE helmfile.d/services/mwdebug: apply [production]
07:58 <moritzm> installing qemu security updates [production]
07:57 <mwdebug-deploy@deploy1002> helmfile [codfw] START helmfile.d/services/mwdebug: apply [production]
07:57 <mwdebug-deploy@deploy1002> helmfile [eqiad] DONE helmfile.d/services/mwdebug: apply [production]
07:56 <mwdebug-deploy@deploy1002> helmfile [eqiad] START helmfile.d/services/mwdebug: apply [production]
07:55 <moritzm> failover ganeti master for drmrs/B12 to ganeti6001 [production]
07:55 <awight@deploy1002> Synchronized wmf-config: Config: [[gerrit:787698|Clean up unnecessary two-level setting]] (duration: 00m 49s) [production]
07:52 <jmm@cumin2002> END (PASS) - Cookbook sre.hosts.reboot-single (exit_code=0) for host ganeti6001.drmrs.wmnet [production]
07:51 <mwdebug-deploy@deploy1002> helmfile [codfw] DONE helmfile.d/services/mwdebug: apply [production]
07:50 <mwdebug-deploy@deploy1002> helmfile [codfw] START helmfile.d/services/mwdebug: apply [production]
07:50 <mwdebug-deploy@deploy1002> helmfile [eqiad] DONE helmfile.d/services/mwdebug: apply [production]
07:49 <mwdebug-deploy@deploy1002> helmfile [eqiad] START helmfile.d/services/mwdebug: apply [production]
07:48 <awight@deploy1002> Synchronized wmf-config: Config: [[gerrit:786289|Watch for mapdata cache misses in production (T304813 T300712)]] (duration: 00m 50s) [production]
07:46 <jmm@cumin2002> START - Cookbook sre.hosts.reboot-single for host ganeti6001.drmrs.wmnet [production]
07:39 <mvernon@cumin1001> END (PASS) - Cookbook sre.hosts.reboot-single (exit_code=0) for host ms-be2040.codfw.wmnet [production]
07:23 <mvernon@cumin1001> START - Cookbook sre.hosts.reboot-single for host ms-be2040.codfw.wmnet [production]
07:17 <jmm@cumin2002> END (PASS) - Cookbook sre.idm.logout (exit_code=0) Logging Naray-ctr out of all services on: 1223 hosts [production]