5301-5350 of 10000 results (97ms)
2023-12-20 ยง
18:05 <cmooney@cumin1001> END (PASS) - Cookbook sre.network.configure-switch-interfaces (exit_code=0) for host sretest2003 [production]
18:05 <cmooney@cumin1001> START - Cookbook sre.network.configure-switch-interfaces for host sretest2003 [production]
18:05 <cmooney@cumin1002> END (FAIL) - Cookbook sre.network.configure-switch-interfaces (exit_code=99) for host sretest2003 [production]
18:05 <cmooney@cumin1002> START - Cookbook sre.network.configure-switch-interfaces for host sretest2003 [production]
17:26 <bking@cumin2002> START - Cookbook sre.hosts.reboot-single for host wdqs1022.eqiad.wmnet [production]
17:25 <bking@cumin2002> END (PASS) - Cookbook sre.hardware.upgrade-firmware (exit_code=0) upgrade firmware for hosts wdqs1022.eqiad.wmnet [production]
17:25 <bking@cumin2002> START - Cookbook sre.hardware.upgrade-firmware upgrade firmware for hosts wdqs1022.eqiad.wmnet [production]
17:05 <elukey@deploy2002> helmfile [ml-staging-codfw] Ran 'sync' command on namespace 'revertrisk' for release 'main' . [production]
16:03 <elukey@deploy2002> helmfile [ml-staging-codfw] DONE helmfile.d/admin 'sync'. [production]
16:03 <elukey@deploy2002> helmfile [ml-staging-codfw] START helmfile.d/admin 'sync'. [production]
16:03 <jclark@cumin1001> START - Cookbook sre.hosts.reimage for host ms-be2080.codfw.wmnet with OS bullseye [production]
15:22 <jhancock@cumin2002> END (FAIL) - Cookbook sre.hosts.reimage (exit_code=99) for host ms-be2074.codfw.wmnet with OS bullseye [production]
15:18 <Lucas_WMDE> UTC afternoon backport+config window done [production]
15:16 <lucaswerkmeister-wmde@deploy2002> Finished scap: Backport for [[gerrit:984601|Replace $wgCommandLineMode checks with MW_ENTRY_POINT (T353751)]] (duration: 08m 22s) [production]
15:14 <bking@cumin2002> END (FAIL) - Cookbook sre.hardware.upgrade-firmware (exit_code=99) upgrade firmware for hosts wdqs1022.eqiad.wmnet [production]
15:11 <lucaswerkmeister-wmde@deploy2002> lucaswerkmeister-wmde and matmarex: Continuing with sync [production]
15:10 <lucaswerkmeister-wmde@deploy2002> lucaswerkmeister-wmde and matmarex: Backport for [[gerrit:984601|Replace $wgCommandLineMode checks with MW_ENTRY_POINT (T353751)]] synced to the testservers (https://wikitech.wikimedia.org/wiki/Mwdebug) [production]
15:09 <bking@cumin2002> END (FAIL) - Cookbook sre.hardware.upgrade-firmware (exit_code=1) upgrade firmware for hosts wdqs1024.eqiad.wmnet [production]
15:09 <bking@cumin2002> END (PASS) - Cookbook sre.hosts.reboot-single (exit_code=0) for host wdqs1024.eqiad.wmnet [production]
15:08 <lucaswerkmeister-wmde@deploy2002> Started scap: Backport for [[gerrit:984601|Replace $wgCommandLineMode checks with MW_ENTRY_POINT (T353751)]] [production]
15:06 <bking@cumin2002> START - Cookbook sre.hardware.upgrade-firmware upgrade firmware for hosts wdqs1022.eqiad.wmnet [production]
15:05 <bking@cumin2002> END (FAIL) - Cookbook sre.hardware.upgrade-firmware (exit_code=99) upgrade firmware for hosts wdqs1022.eqiad.wmnet [production]
15:05 <bking@cumin2002> START - Cookbook sre.hardware.upgrade-firmware upgrade firmware for hosts wdqs1022.eqiad.wmnet [production]
15:05 <bking@cumin2002> END (PASS) - Cookbook sre.hardware.upgrade-firmware (exit_code=0) upgrade firmware for hosts wdqs1023.eqiad.wmnet [production]
15:05 <bking@cumin2002> START - Cookbook sre.hardware.upgrade-firmware upgrade firmware for hosts wdqs1023.eqiad.wmnet [production]
15:05 <dani@deploy2002> helmfile [staging] DONE helmfile.d/services/miscweb: apply [production]
15:04 <dani@deploy2002> helmfile [staging] START helmfile.d/services/miscweb: apply [production]
15:02 <bking@cumin2002> START - Cookbook sre.hosts.reboot-single for host wdqs1024.eqiad.wmnet [production]
15:02 <bking@cumin2002> START - Cookbook sre.hardware.upgrade-firmware upgrade firmware for hosts wdqs1024.eqiad.wmnet [production]
15:01 <bking@cumin2002> END (PASS) - Cookbook sre.hardware.upgrade-firmware (exit_code=0) upgrade firmware for hosts wdqs1024.eqiad.wmnet [production]
15:01 <bking@cumin2002> START - Cookbook sre.hardware.upgrade-firmware upgrade firmware for hosts wdqs1024.eqiad.wmnet [production]
14:58 <inflatador> bking@cumin2002 disable/mask wmf_auto_restart_prometheus-blazegraph-exporter-wdqs-categories on wdqs102[24] T352878 [production]
14:57 <lucaswerkmeister-wmde@deploy2002> Finished scap: Backport for [[gerrit:982416|RunSingleJob.php: Fix use of MWExceptionHandler before it's defined (T352265)]] (duration: 10m 30s) [production]
14:51 <lucaswerkmeister-wmde@deploy2002> lucaswerkmeister-wmde and matmarex: Continuing with sync [production]
14:48 <lucaswerkmeister-wmde@deploy2002> lucaswerkmeister-wmde and matmarex: Backport for [[gerrit:982416|RunSingleJob.php: Fix use of MWExceptionHandler before it's defined (T352265)]] synced to the testservers (https://wikitech.wikimedia.org/wiki/Mwdebug) [production]
14:46 <lucaswerkmeister-wmde@deploy2002> Started scap: Backport for [[gerrit:982416|RunSingleJob.php: Fix use of MWExceptionHandler before it's defined (T352265)]] [production]
14:43 <lucaswerkmeister-wmde@deploy2002> Finished scap: Backport for [[gerrit:976650|Remove BetaFeature code related to ReferencePreviews (T351708)]], [[gerrit:978035|Remove wgPopupsReferencePreviews now that it defaults to true (T351708)]] (duration: 10m 16s) [production]
14:37 <lucaswerkmeister-wmde@deploy2002> lucaswerkmeister-wmde and awight and wmde-fisch: Continuing with sync [production]
14:35 <lucaswerkmeister-wmde@deploy2002> lucaswerkmeister-wmde and awight and wmde-fisch: Backport for [[gerrit:976650|Remove BetaFeature code related to ReferencePreviews (T351708)]], [[gerrit:978035|Remove wgPopupsReferencePreviews now that it defaults to true (T351708)]] synced to the testservers (https://wikitech.wikimedia.org/wiki/Mwdebug) [production]
14:33 <lucaswerkmeister-wmde@deploy2002> Started scap: Backport for [[gerrit:976650|Remove BetaFeature code related to ReferencePreviews (T351708)]], [[gerrit:978035|Remove wgPopupsReferencePreviews now that it defaults to true (T351708)]] [production]
14:30 <lucaswerkmeister-wmde@deploy2002> Finished scap: Backport for [[gerrit:984324|Check for false from ThumbnailImage::getStoragePath (T353758)]] (duration: 09m 38s) [production]
14:26 <lucaswerkmeister-wmde@deploy2002> kharlan and lucaswerkmeister-wmde: Continuing with sync [production]
14:22 <lucaswerkmeister-wmde@deploy2002> kharlan and lucaswerkmeister-wmde: Backport for [[gerrit:984324|Check for false from ThumbnailImage::getStoragePath (T353758)]] synced to the testservers (https://wikitech.wikimedia.org/wiki/Mwdebug) [production]
14:21 <lucaswerkmeister-wmde@deploy2002> Started scap: Backport for [[gerrit:984324|Check for false from ThumbnailImage::getStoragePath (T353758)]] [production]
14:19 <lucaswerkmeister-wmde@deploy2002> Finished scap: Backport for [[gerrit:981636|Make wiktionary and mw.org provide og:site_name (T348203)]] (duration: 15m 54s) [production]
14:16 <moritzm> installing distro-info-data updates from Bookworm point release [production]
14:14 <lucaswerkmeister-wmde@deploy2002> pols12 and lucaswerkmeister-wmde: Continuing with sync [production]
14:12 <moritzm> installing debootstrap bugfix updates from Bookworm point release [production]
14:06 <lucaswerkmeister-wmde@deploy2002> pols12 and lucaswerkmeister-wmde: Backport for [[gerrit:981636|Make wiktionary and mw.org provide og:site_name (T348203)]] synced to the testservers (https://wikitech.wikimedia.org/wiki/Mwdebug) [production]
14:04 <moritzm> installing cups updates from bookworm point release [production]