2351-2400 of 10000 results (112ms)
2025-09-24 §
08:24 <jmm@cumin2002> START - Cookbook sre.ganeti.drain-node for draining ganeti node ganeti3008.esams.wmnet [production]
08:21 <jmm@cumin2002> END (PASS) - Cookbook sre.ganeti.drain-node (exit_code=0) for draining ganeti node ganeti3007.esams.wmnet [production]
08:21 <jmm@cumin2002> END (PASS) - Cookbook sre.hosts.reboot-single (exit_code=0) for host ganeti3007.esams.wmnet [production]
08:14 <mvernon@cumin2002> DONE (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 1:00:00 on ms-be1066.eqiad.wmnet with reason: vacuum [production]
08:13 <jmm@cumin2002> START - Cookbook sre.hosts.reboot-single for host ganeti3007.esams.wmnet [production]
08:13 <Emperor> VACUUM large container dbs on ms-be1066 T377827 [production]
08:09 <jmm@cumin2002> START - Cookbook sre.ganeti.drain-node for draining ganeti node ganeti3007.esams.wmnet [production]
07:58 <fceratto@cumin1002> START - Cookbook sre.mysql.sanitize-wiki Checking sanitization for wikis tokwiki in section s5 [production]
07:49 <jmm@cumin2002> END (PASS) - Cookbook sre.ganeti.drain-node (exit_code=0) for draining ganeti node ganeti3005.esams.wmnet [production]
07:49 <jmm@cumin2002> END (PASS) - Cookbook sre.hosts.reboot-single (exit_code=0) for host ganeti3005.esams.wmnet [production]
07:41 <jmm@cumin2002> START - Cookbook sre.hosts.reboot-single for host ganeti3005.esams.wmnet [production]
07:33 <jmm@cumin2002> START - Cookbook sre.ganeti.drain-node for draining ganeti node ganeti3005.esams.wmnet [production]
07:31 <mlitn@deploy1003> Finished scap sync-world: Backport for [[gerrit:1190684|Add MediaSearch custommatch:linked_from keyword (T403613)]] (duration: 13m 04s) [production]
07:26 <mlitn@deploy1003> mlitn: Continuing with sync [production]
07:25 <mlitn@deploy1003> mlitn: Backport for [[gerrit:1190684|Add MediaSearch custommatch:linked_from keyword (T403613)]] synced to the testservers (see https://wikitech.wikimedia.org/wiki/Mwdebug). Changes can now be verified there. [production]
07:18 <mlitn@deploy1003> Started scap sync-world: Backport for [[gerrit:1190684|Add MediaSearch custommatch:linked_from keyword (T403613)]] [production]
07:11 <kharlan@deploy1003> Finished scap sync-world: Backport for [[gerrit:1190184|hCaptcha: Enable account creation trial on phase 2 wikis (T402366)]] (duration: 19m 26s) [production]
07:06 <kharlan@deploy1003> kharlan: Continuing with sync [production]
07:02 <jmm@cumin2002> END (PASS) - Cookbook sre.ganeti.drain-node (exit_code=0) for draining ganeti node ganeti7002.magru.wmnet [production]
07:01 <jmm@cumin2002> END (PASS) - Cookbook sre.hosts.reboot-single (exit_code=0) for host ganeti7002.magru.wmnet [production]
06:58 <kharlan@deploy1003> kharlan: Backport for [[gerrit:1190184|hCaptcha: Enable account creation trial on phase 2 wikis (T402366)]] synced to the testservers (see https://wikitech.wikimedia.org/wiki/Mwdebug). Changes can now be verified there. [production]
06:52 <kharlan@deploy1003> Started scap sync-world: Backport for [[gerrit:1190184|hCaptcha: Enable account creation trial on phase 2 wikis (T402366)]] [production]
06:51 <jmm@cumin2002> START - Cookbook sre.hosts.reboot-single for host ganeti7002.magru.wmnet [production]
06:49 <jmm@cumin2002> START - Cookbook sre.ganeti.drain-node for draining ganeti node ganeti7002.magru.wmnet [production]
05:35 <eileen> * civicrm upgraded from 8cdce9e0 to 1c973d84 [production]
01:57 <andrew@cumin2002> END (PASS) - Cookbook sre.hosts.reimage (exit_code=0) for host cloudcephosd1049.eqiad.wmnet with OS bookworm [production]
01:40 <andrew@cumin2002> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 2:00:00 on cloudcephosd1049.eqiad.wmnet with reason: host reimage [production]
01:36 <andrew@cumin2002> START - Cookbook sre.hosts.downtime for 2:00:00 on cloudcephosd1049.eqiad.wmnet with reason: host reimage [production]
01:17 <andrew@cumin2002> START - Cookbook sre.hosts.reimage for host cloudcephosd1049.eqiad.wmnet with OS bookworm [production]
01:12 <mwpresync@deploy1003> Finished scap build-images: Publishing wmf/next image (duration: 11m 58s) [production]
01:00 <mwpresync@deploy1003> Started scap build-images: Publishing wmf/next image [production]
00:58 <andrew@cumin2002> END (PASS) - Cookbook sre.hosts.reimage (exit_code=0) for host cloudcephosd1048.eqiad.wmnet with OS bookworm [production]
00:44 <andrew@cumin2002> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 2:00:00 on cloudcephosd1048.eqiad.wmnet with reason: host reimage [production]
00:40 <andrew@cumin2002> START - Cookbook sre.hosts.downtime for 2:00:00 on cloudcephosd1048.eqiad.wmnet with reason: host reimage [production]
2025-09-23 §
23:55 <krinkle@deploy1003> Finished scap sync-world: Backport for [[gerrit:1190761|Disable wmgUseMdotRouting on Wikibooks and Wikiquote (group1) (T403510)]] (duration: 16m 39s) [production]
23:49 <krinkle@deploy1003> krinkle: Continuing with sync [production]
23:47 <andrew@cumin2002> START - Cookbook sre.hosts.reimage for host cloudcephosd1048.eqiad.wmnet with OS bookworm [production]
23:47 <krinkle@deploy1003> krinkle: Backport for [[gerrit:1190761|Disable wmgUseMdotRouting on Wikibooks and Wikiquote (group1) (T403510)]] synced to the testservers (see https://wikitech.wikimedia.org/wiki/Mwdebug). Changes can now be verified there. [production]
23:45 <andrew@cumin2002> END (PASS) - Cookbook sre.hosts.reimage (exit_code=0) for host cloudcephosd1047.eqiad.wmnet with OS bookworm [production]
23:39 <krinkle@deploy1003> Started scap sync-world: Backport for [[gerrit:1190761|Disable wmgUseMdotRouting on Wikibooks and Wikiquote (group1) (T403510)]] [production]
23:27 <andrew@cumin2002> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 2:00:00 on cloudcephosd1047.eqiad.wmnet with reason: host reimage [production]
23:24 <andrew@cumin2002> START - Cookbook sre.hosts.downtime for 2:00:00 on cloudcephosd1047.eqiad.wmnet with reason: host reimage [production]
23:04 <andrew@cumin2002> START - Cookbook sre.hosts.reimage for host cloudcephosd1047.eqiad.wmnet with OS bookworm [production]
22:03 <andrew@cumin2002> END (PASS) - Cookbook sre.hosts.reimage (exit_code=0) for host cloudcephosd1046.eqiad.wmnet with OS bookworm [production]
22:00 <jgleeson> civicrm upgraded from 4304c138 to 8cdce9e0 [production]
21:44 <andrew@cumin2002> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 2:00:00 on cloudcephosd1046.eqiad.wmnet with reason: host reimage [production]
21:38 <andrew@cumin2002> START - Cookbook sre.hosts.downtime for 2:00:00 on cloudcephosd1046.eqiad.wmnet with reason: host reimage [production]
21:18 <andrew@cumin2002> START - Cookbook sre.hosts.reimage for host cloudcephosd1046.eqiad.wmnet with OS bookworm [production]
21:17 <andrew@cumin2002> END (PASS) - Cookbook sre.hosts.reimage (exit_code=0) for host cloudcephosd1045.eqiad.wmnet with OS bookworm [production]
21:11 <tgr_> UTC late deploys done [production]