251-300 of 10000 results (12ms)
2025-07-03 §
07:16 <ladsgroup@deploy1003> musikanimal, ladsgroup: Backport for [[gerrit:1166067|codeFolding: fix folding <ref> (T398430)]] synced to the testservers (see https://wikitech.wikimedia.org/wiki/Mwdebug). Changes can now be verified there. [production]
07:14 <ladsgroup@deploy1003> Started scap sync-world: Backport for [[gerrit:1166067|codeFolding: fix folding <ref> (T398430)]] [production]
07:03 <jmm@cumin2002> START - Cookbook sre.ganeti.changedisk for changing disk type of prometheus6002.drmrs.wmnet to drbd [production]
07:02 <jmm@cumin2002> DONE (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 1:00:00 on prometheus6002.drmrs.wmnet with reason: switch disk type back to DRBD [production]
07:01 <jmm@cumin2002> END (PASS) - Cookbook sre.ganeti.changedisk (exit_code=0) for changing disk type of doh6002.wikimedia.org to drbd [production]
06:50 <jmm@cumin2002> END (PASS) - Cookbook sre.ganeti.drain-node (exit_code=0) for draining ganeti node ganeti6003.drmrs.wmnet [production]
06:49 <jmm@cumin2002> START - Cookbook sre.ganeti.drain-node for draining ganeti node ganeti6003.drmrs.wmnet [production]
06:47 <jmm@cumin2002> START - Cookbook sre.ganeti.changedisk for changing disk type of doh6002.wikimedia.org to drbd [production]
06:45 <jmm@cumin2002> END (PASS) - Cookbook sre.ganeti.changedisk (exit_code=0) for changing disk type of durum6002.drmrs.wmnet to drbd [production]
06:34 <jmm@cumin2002> START - Cookbook sre.ganeti.changedisk for changing disk type of durum6002.drmrs.wmnet to drbd [production]
03:38 <jhathaway@cumin2002> END (PASS) - Cookbook sre.hosts.reimage (exit_code=0) for host sretest2001.codfw.wmnet with OS bookworm [production]
03:22 <jhathaway@cumin2002> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 2:00:00 on sretest2001.codfw.wmnet with reason: host reimage [production]
03:18 <jhathaway@cumin2002> START - Cookbook sre.hosts.downtime for 2:00:00 on sretest2001.codfw.wmnet with reason: host reimage [production]
03:06 <jhathaway@cumin2002> START - Cookbook sre.hosts.reimage for host sretest2001.codfw.wmnet with OS bookworm [production]
01:56 <dani@deploy1003> helmfile [codfw] DONE helmfile.d/services/miscweb: apply [production]
01:56 <dani@deploy1003> helmfile [codfw] START helmfile.d/services/miscweb: apply [production]
01:56 <dani@deploy1003> helmfile [eqiad] DONE helmfile.d/services/miscweb: apply [production]
01:56 <dani@deploy1003> helmfile [eqiad] START helmfile.d/services/miscweb: apply [production]
01:56 <dani@deploy1003> helmfile [staging] DONE helmfile.d/services/miscweb: apply [production]
01:56 <dani@deploy1003> helmfile [staging] START helmfile.d/services/miscweb: apply [production]
01:56 <dani@deploy1003> helmfile [codfw] DONE helmfile.d/services/miscweb: apply [production]
01:55 <dani@deploy1003> helmfile [codfw] START helmfile.d/services/miscweb: apply [production]
01:55 <dani@deploy1003> helmfile [eqiad] DONE helmfile.d/services/miscweb: apply [production]
01:55 <dani@deploy1003> helmfile [eqiad] START helmfile.d/services/miscweb: apply [production]
01:55 <dani@deploy1003> helmfile [staging] DONE helmfile.d/services/miscweb: apply [production]
01:55 <dani@deploy1003> helmfile [staging] START helmfile.d/services/miscweb: apply [production]
01:54 <dani@deploy1003> helmfile [codfw] DONE helmfile.d/services/miscweb: apply [production]
01:54 <dani@deploy1003> helmfile [codfw] START helmfile.d/services/miscweb: apply [production]
01:54 <dani@deploy1003> helmfile [eqiad] DONE helmfile.d/services/miscweb: apply [production]
01:54 <dani@deploy1003> helmfile [eqiad] START helmfile.d/services/miscweb: apply [production]
01:54 <dani@deploy1003> helmfile [staging] DONE helmfile.d/services/miscweb: apply [production]
01:54 <dani@deploy1003> helmfile [staging] START helmfile.d/services/miscweb: apply [production]
01:54 <dani@deploy1003> helmfile [codfw] DONE helmfile.d/services/miscweb: apply [production]
01:54 <dani@deploy1003> helmfile [codfw] START helmfile.d/services/miscweb: apply [production]
01:54 <dani@deploy1003> helmfile [eqiad] DONE helmfile.d/services/miscweb: apply [production]
01:53 <dani@deploy1003> helmfile [eqiad] START helmfile.d/services/miscweb: apply [production]
01:53 <dani@deploy1003> helmfile [staging] DONE helmfile.d/services/miscweb: apply [production]
01:53 <dani@deploy1003> helmfile [staging] START helmfile.d/services/miscweb: apply [production]
00:09 <swfrench-wmf> reprepro include php-msgpack_3.0.0-1+wmf11u1 in component/php83 - T398245 [production]
00:08 <swfrench-wmf> reprepro include php-igbinary_3.2.16-4+wmf11u1 in component/php83 - T398245 [production]
00:03 <swfrench-wmf> reprepro include php-apcu_5.1.24-1+wmf11u1 in component/php83 - T398245 [production]
2025-07-02 §
23:40 <vriley@cumin1002> END (FAIL) - Cookbook sre.hosts.reimage (exit_code=99) for host ganeti1053.eqiad.wmnet with OS bookworm [production]
23:38 <tzatziki> removing 15 files for legal compliance [production]
23:25 <jhathaway@cumin2002> END (FAIL) - Cookbook sre.hosts.reimage (exit_code=99) for host sretest2001.codfw.wmnet with OS bookworm [production]
23:08 <jhathaway@cumin2002> START - Cookbook sre.hosts.reimage for host sretest2001.codfw.wmnet with OS bookworm [production]
23:07 <jhathaway@cumin2002> END (ERROR) - Cookbook sre.hosts.reimage (exit_code=97) for host sretest2001.codfw.wmnet with OS bookworm [production]
23:05 <jhathaway@cumin2002> START - Cookbook sre.hosts.reimage for host sretest2001.codfw.wmnet with OS bookworm [production]
23:05 <jhathaway@cumin2002> END (ERROR) - Cookbook sre.hosts.reimage (exit_code=97) for host sretest2001.codfw.wmnet with OS bookworm [production]
23:02 <ryankemper> [WDQS] `ryankemper@wdqs2009:~$ sudo systemctl restart prometheus-blazegraph-exporter-wdqs-blazegraph.service` [production]
22:51 <jhathaway@cumin2002> START - Cookbook sre.hosts.reimage for host sretest2001.codfw.wmnet with OS bookworm [production]