1401-1450 of 10000 results (134ms)
2026-03-18 §
08:58 <jmm@cumin2002> END (PASS) - Cookbook sre.ganeti.drain-node (exit_code=0) for draining ganeti node ganeti1023.eqiad.wmnet [production]
08:58 <jmm@cumin2002> END (PASS) - Cookbook sre.hosts.reboot-single (exit_code=0) for host ganeti1023.eqiad.wmnet [production]
08:57 <jmm@cumin2002> START - Cookbook sre.hosts.reboot-single for host ping1004.eqiad.wmnet [production]
08:56 <mvernon@cumin1003> START - Cookbook sre.hosts.reboot-single for host ms-be1072.eqiad.wmnet [production]
08:56 <mvernon@cumin1003> END (PASS) - Cookbook sre.hosts.reboot-single (exit_code=0) for host ms-be1071.eqiad.wmnet [production]
08:55 <mvernon@cumin2002> START - Cookbook sre.hosts.reboot-single for host ms-be2071.codfw.wmnet [production]
08:55 <mvernon@cumin2002> END (PASS) - Cookbook sre.hosts.reboot-single (exit_code=0) for host ms-be2070.codfw.wmnet [production]
08:52 <jmm@cumin2002> START - Cookbook sre.hosts.reboot-single for host ganeti1023.eqiad.wmnet [production]
08:50 <jmm@cumin2002> START - Cookbook sre.ganeti.drain-node for draining ganeti node ganeti1023.eqiad.wmnet [production]
08:48 <mvernon@cumin1003> START - Cookbook sre.hosts.reboot-single for host ms-be1071.eqiad.wmnet [production]
08:47 <mvernon@cumin2002> START - Cookbook sre.hosts.reboot-single for host ms-be2070.codfw.wmnet [production]
08:46 <klausman@cumin1003> START - Cookbook sre.cassandra.roll-reboot rolling reboot on A:ml-cache-eqiad [production]
08:29 <hashar> Restarting CI Jenkins for plugin upgrade # T420347 [production]
08:22 <aklapper@deploy2002> rebuilt and synchronized wikiversions files: group1 to 1.46.0-wmf.20 refs T413811 [production]
07:45 <ayounsi@cumin1003> END (PASS) - Cookbook sre.network.peering (exit_code=0) with action 'configure' for AS: 32934 [production]
07:42 <btullis@cumin1003> END (PASS) - Cookbook sre.hadoop.reboot-workers (exit_code=0) for Hadoop analytics cluster [production]
07:35 <ayounsi@cumin1003> START - Cookbook sre.network.peering with action 'configure' for AS: 32934 [production]
07:22 <kartik@deploy2002> helmfile [codfw] DONE helmfile.d/services/machinetranslation: apply [production]
07:16 <kartik@deploy2002> helmfile [codfw] START helmfile.d/services/machinetranslation: apply [production]
06:54 <kartik@deploy2002> helmfile [codfw] DONE helmfile.d/services/machinetranslation: apply [production]
06:38 <kartik@deploy2002> helmfile [codfw] START helmfile.d/services/machinetranslation: apply [production]
03:22 <musikanimal@deploy2002> Finished scap sync-world: Backport for [[gerrit:1254468|CM5: add more aggressive warnings about CM5 deprecation (T373720)]] (duration: 12m 22s) [production]
03:18 <musikanimal@deploy2002> musikanimal: Continuing with sync [production]
03:11 <musikanimal@deploy2002> musikanimal: Backport for [[gerrit:1254468|CM5: add more aggressive warnings about CM5 deprecation (T373720)]] synced to the testservers (see https://wikitech.wikimedia.org/wiki/Mwdebug). Changes can now be verified there. [production]
03:09 <musikanimal@deploy2002> Started scap sync-world: Backport for [[gerrit:1254468|CM5: add more aggressive warnings about CM5 deprecation (T373720)]] [production]
02:08 <mwpresync@deploy2002> Finished scap build-images: Publishing wmf/next image (duration: 07m 47s) [production]
02:07 <dani@deploy1003> helmfile [codfw] DONE helmfile.d/services/miscweb: apply [production]
02:07 <dani@deploy1003> helmfile [codfw] START helmfile.d/services/miscweb: apply [production]
02:07 <dani@deploy1003> helmfile [eqiad] DONE helmfile.d/services/miscweb: apply [production]
02:07 <dani@deploy1003> helmfile [eqiad] START helmfile.d/services/miscweb: apply [production]
02:07 <dani@deploy1003> helmfile [staging] DONE helmfile.d/services/miscweb: apply [production]
02:07 <dani@deploy1003> helmfile [staging] START helmfile.d/services/miscweb: apply [production]
02:06 <dani@deploy1003> helmfile [codfw] DONE helmfile.d/services/miscweb: apply [production]
02:05 <dani@deploy1003> helmfile [codfw] START helmfile.d/services/miscweb: apply [production]
02:05 <dani@deploy1003> helmfile [eqiad] DONE helmfile.d/services/miscweb: apply [production]
02:05 <dani@deploy1003> helmfile [eqiad] START helmfile.d/services/miscweb: apply [production]
02:05 <dani@deploy1003> helmfile [staging] DONE helmfile.d/services/miscweb: apply [production]
02:04 <dani@deploy1003> helmfile [staging] START helmfile.d/services/miscweb: apply [production]
02:00 <mwpresync@deploy2002> Started scap build-images: Publishing wmf/next image [production]
01:38 <denisse@deploy2002> Finished deploy [librenms/librenms@9bdfb73]: Upgrade LibreNMS to 26.3.1 (duration: 00m 19s) [production]
01:38 <denisse@deploy2002> Started deploy [librenms/librenms@9bdfb73]: Upgrade LibreNMS to 26.3.1 [production]
01:10 <denisse@deploy2002> Finished deploy [librenms/librenms@d152b36]: Upgrade LibreNMS to 25.11.0 (duration: 00m 08s) [production]
01:10 <denisse@deploy2002> Started deploy [librenms/librenms@d152b36]: Upgrade LibreNMS to 25.11.0 [production]
2026-03-17 §
23:44 <btullis@cumin1003> START - Cookbook sre.hadoop.reboot-workers for Hadoop analytics cluster [production]
23:38 <btullis@cumin1003> END (FAIL) - Cookbook sre.hadoop.reboot-workers (exit_code=99) for Hadoop analytics cluster [production]
22:55 <brett@puppetserver1001> conftool action : set/pooled=yes; selector: name=cp3081.* [production]
22:20 <cdobbins@cumin2002> conftool action : set/pooled=yes; selector: name=cp3073.esams.wmnet [reason: trixie reimaging] [production]
22:15 <cdobbins@cumin2002> END (PASS) - Cookbook sre.hosts.reimage (exit_code=0) for host cp3073.esams.wmnet with OS trixie [production]
22:11 <cdobbins@cumin2002> conftool action : set/pooled=yes; selector: name=cp3072.esams.wmnet [reason: trixie reimaging] [production]
22:10 <cdobbins@cumin2002> END (PASS) - Cookbook sre.hosts.reimage (exit_code=0) for host cp3072.esams.wmnet with OS trixie [production]