1-50 of 10000 results (89ms)
2025-09-23 ยง
23:55 <krinkle@deploy1003> Finished scap sync-world: Backport for [[gerrit:1190761|Disable wmgUseMdotRouting on Wikibooks and Wikiquote (group1) (T403510)]] (duration: 16m 39s) [production]
23:49 <krinkle@deploy1003> krinkle: Continuing with sync [production]
23:47 <andrew@cumin2002> START - Cookbook sre.hosts.reimage for host cloudcephosd1048.eqiad.wmnet with OS bookworm [production]
23:47 <krinkle@deploy1003> krinkle: Backport for [[gerrit:1190761|Disable wmgUseMdotRouting on Wikibooks and Wikiquote (group1) (T403510)]] synced to the testservers (see https://wikitech.wikimedia.org/wiki/Mwdebug). Changes can now be verified there. [production]
23:45 <andrew@cumin2002> END (PASS) - Cookbook sre.hosts.reimage (exit_code=0) for host cloudcephosd1047.eqiad.wmnet with OS bookworm [production]
23:39 <krinkle@deploy1003> Started scap sync-world: Backport for [[gerrit:1190761|Disable wmgUseMdotRouting on Wikibooks and Wikiquote (group1) (T403510)]] [production]
23:27 <andrew@cumin2002> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 2:00:00 on cloudcephosd1047.eqiad.wmnet with reason: host reimage [production]
23:24 <andrew@cumin2002> START - Cookbook sre.hosts.downtime for 2:00:00 on cloudcephosd1047.eqiad.wmnet with reason: host reimage [production]
23:04 <andrew@cumin2002> START - Cookbook sre.hosts.reimage for host cloudcephosd1047.eqiad.wmnet with OS bookworm [production]
22:03 <andrew@cumin2002> END (PASS) - Cookbook sre.hosts.reimage (exit_code=0) for host cloudcephosd1046.eqiad.wmnet with OS bookworm [production]
22:00 <jgleeson> civicrm upgraded from 4304c138 to 8cdce9e0 [production]
21:44 <andrew@cumin2002> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 2:00:00 on cloudcephosd1046.eqiad.wmnet with reason: host reimage [production]
21:38 <andrew@cumin2002> START - Cookbook sre.hosts.downtime for 2:00:00 on cloudcephosd1046.eqiad.wmnet with reason: host reimage [production]
21:18 <andrew@cumin2002> START - Cookbook sre.hosts.reimage for host cloudcephosd1046.eqiad.wmnet with OS bookworm [production]
21:17 <andrew@cumin2002> END (PASS) - Cookbook sre.hosts.reimage (exit_code=0) for host cloudcephosd1045.eqiad.wmnet with OS bookworm [production]
21:11 <tgr_> UTC late deploys done [production]
21:10 <tgr@deploy1003> Finished scap sync-world: Backport for [[gerrit:1190712|session: Fix date handling for JWT cookies (T399243 T399200)]], [[gerrit:1190713|session: Fix date handling for JWT cookies (T399243 T399200)]] (duration: 41m 51s) [production]
20:59 <andrew@cumin2002> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 2:00:00 on cloudcephosd1045.eqiad.wmnet with reason: host reimage [production]
20:57 <tgr@deploy1003> tgr: Continuing with sync [production]
20:55 <andrew@cumin2002> START - Cookbook sre.hosts.downtime for 2:00:00 on cloudcephosd1045.eqiad.wmnet with reason: host reimage [production]
20:55 <tgr@deploy1003> tgr: Backport for [[gerrit:1190712|session: Fix date handling for JWT cookies (T399243 T399200)]], [[gerrit:1190713|session: Fix date handling for JWT cookies (T399243 T399200)]] synced to the testservers (see https://wikitech.wikimedia.org/wiki/Mwdebug). Changes can now be verified there. [production]
20:35 <andrew@cumin2002> START - Cookbook sre.hosts.reimage for host cloudcephosd1045.eqiad.wmnet with OS bookworm [production]
20:29 <andrew@cumin2002> END (PASS) - Cookbook sre.hosts.reimage (exit_code=0) for host cloudcephosd1040.eqiad.wmnet with OS bookworm [production]
20:28 <tgr@deploy1003> Started scap sync-world: Backport for [[gerrit:1190712|session: Fix date handling for JWT cookies (T399243 T399200)]], [[gerrit:1190713|session: Fix date handling for JWT cookies (T399243 T399200)]] [production]
20:09 <andrew@cumin2002> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 2:00:00 on cloudcephosd1040.eqiad.wmnet with reason: host reimage [production]
20:06 <andrew@cumin2002> START - Cookbook sre.hosts.downtime for 2:00:00 on cloudcephosd1040.eqiad.wmnet with reason: host reimage [production]
19:50 <brennen@deploy1003> rebuilt and synchronized wikiversions files: group0 to 1.45.0-wmf.20 refs T396381 [production]
19:44 <andrew@cumin2002> START - Cookbook sre.hosts.reimage for host cloudcephosd1040.eqiad.wmnet with OS bookworm [production]
19:42 <andrew@cumin2002> END (PASS) - Cookbook sre.hosts.reimage (exit_code=0) for host cloudcephosd1039.eqiad.wmnet with OS bookworm [production]
19:35 <logmsgbot> brennen Deployed security patch for T405112 [production]
19:24 <andrew@cumin2002> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 2:00:00 on cloudcephosd1039.eqiad.wmnet with reason: host reimage [production]
19:19 <andrew@cumin2002> START - Cookbook sre.hosts.downtime for 2:00:00 on cloudcephosd1039.eqiad.wmnet with reason: host reimage [production]
19:19 <jgleeson> payments-wiki upgraded from 3e13fadf to bf2864e9 [production]
19:18 <logmsgbot> brennen Deployed security patch for T405112 [production]
19:07 <brennen@deploy1003> Finished scap sync-world: Backport for [[gerrit:1190738|Revert "User: Reduce locking severity of ::getInstanceForUpdate()"]] (duration: 11m 36s) [production]
19:02 <brennen@deploy1003> brennen, tgr: Continuing with sync [production]
19:01 <brennen@deploy1003> brennen, tgr: Backport for [[gerrit:1190738|Revert "User: Reduce locking severity of ::getInstanceForUpdate()"]] synced to the testservers (see https://wikitech.wikimedia.org/wiki/Mwdebug). Changes can now be verified there. [production]
18:57 <andrew@cumin2002> START - Cookbook sre.hosts.reimage for host cloudcephosd1039.eqiad.wmnet with OS bookworm [production]
18:55 <brennen@deploy1003> Started scap sync-world: Backport for [[gerrit:1190738|Revert "User: Reduce locking severity of ::getInstanceForUpdate()"]] [production]
18:53 <andrew@cumin2002> END (PASS) - Cookbook sre.hosts.reimage (exit_code=0) for host cloudcephosd1038.eqiad.wmnet with OS bookworm [production]
18:38 <ebernhardson@deploy1003> Finished scap sync-world: Backport for [[gerrit:1190737|cirrus: Send more_like traffic to eqiad (T405394)]] (duration: 10m 34s) [production]
18:34 <fceratto@deploy1003> helmfile [aux-k8s-eqiad] 'sync' command on namespace 'zarcillo' for release 'main' . [production]
18:33 <ebernhardson@deploy1003> ebernhardson: Continuing with sync [production]
18:32 <andrew@cumin2002> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 2:00:00 on cloudcephosd1038.eqiad.wmnet with reason: host reimage [production]
18:32 <ebernhardson@deploy1003> ebernhardson: Backport for [[gerrit:1190737|cirrus: Send more_like traffic to eqiad (T405394)]] synced to the testservers (see https://wikitech.wikimedia.org/wiki/Mwdebug). Changes can now be verified there. [production]
18:28 <jgleeson> SmashPig upgraded from f805ba74 to 96afe81c [production]
18:28 <ebernhardson@deploy1003> Started scap sync-world: Backport for [[gerrit:1190737|cirrus: Send more_like traffic to eqiad (T405394)]] [production]
18:27 <andrew@cumin2002> START - Cookbook sre.hosts.downtime for 2:00:00 on cloudcephosd1038.eqiad.wmnet with reason: host reimage [production]
18:10 <fceratto@deploy1003> helmfile [aux-k8s-eqiad] 'sync' command on namespace 'zarcillo' for release 'main' . [production]
18:08 <bking@cumin1002> END (PASS) - Cookbook sre.elasticsearch.ban (exit_code=0) Unbanning all hosts in search_codfw [production]