1-50 of 10000 results (100ms)
2026-05-27 ยง
22:58 <catrope@deploy1003> Finished scap sync-world: Backport for [[gerrit:1294435|passwordlessLogin: Limit conditional mediation to the main login form (T427419)]] (duration: 07m 49s) [production]
22:55 <ladsgroup@cumin1003> END (PASS) - Cookbook sre.mysql.sanitarium_restart (exit_code=0) [production]
22:54 <catrope@deploy1003> catrope: Continuing with deployment [production]
22:52 <catrope@deploy1003> catrope: Backport for [[gerrit:1294435|passwordlessLogin: Limit conditional mediation to the main login form (T427419)]] synced to the testservers (see https://wikitech.wikimedia.org/wiki/Mwdebug). Changes can now be verified there. [production]
22:50 <catrope@deploy1003> Started scap sync-world: Backport for [[gerrit:1294435|passwordlessLogin: Limit conditional mediation to the main login form (T427419)]] [production]
22:46 <jdlrobson@deploy1003> Finished scap sync-world: Backport for [[gerrit:1294360|Thumbnails are not being optimized in large mode (T427237)]], [[gerrit:1294322|Thumbnails are not being optimized in large mode (T427237)]] (duration: 06m 54s) [production]
22:42 <jdlrobson@deploy1003> jdlrobson: Continuing with deployment [production]
22:41 <jdlrobson@deploy1003> jdlrobson: Backport for [[gerrit:1294360|Thumbnails are not being optimized in large mode (T427237)]], [[gerrit:1294322|Thumbnails are not being optimized in large mode (T427237)]] synced to the testservers (see https://wikitech.wikimedia.org/wiki/Mwdebug). Changes can now be verified there. [production]
22:40 <ladsgroup@cumin1003> START - Cookbook sre.mysql.sanitarium_restart [production]
22:40 <ladsgroup@cumin1003> END (FAIL) - Cookbook sre.mysql.sanitarium_restart (exit_code=99) [production]
22:40 <ladsgroup@cumin1003> START - Cookbook sre.mysql.sanitarium_restart [production]
22:39 <jdlrobson@deploy1003> Started scap sync-world: Backport for [[gerrit:1294360|Thumbnails are not being optimized in large mode (T427237)]], [[gerrit:1294322|Thumbnails are not being optimized in large mode (T427237)]] [production]
22:39 <ladsgroup@deploy1003> Finished scap sync-world: Add conduct.wikimedia.org (T426984) (duration: 07m 16s) [production]
22:35 <ladsgroup@deploy1003> ladsgroup: Continuing with deployment [production]
22:34 <ladsgroup@deploy1003> ladsgroup: Add conduct.wikimedia.org (T426984) synced to the testservers (see https://wikitech.wikimedia.org/wiki/Mwdebug). Changes can now be verified there. [production]
22:33 <ladsgroup@deploy1003> Started scap sync-world: Add conduct.wikimedia.org (T426984) [production]
22:13 <egardner@deploy1003> Finished scap sync-world: Backport for [[gerrit:1294370|Carousel only on articles (T427336)]] (duration: 10m 00s) [production]
22:09 <egardner@deploy1003> egardner: Continuing with deployment [production]
22:05 <egardner@deploy1003> egardner: Backport for [[gerrit:1294370|Carousel only on articles (T427336)]] synced to the testservers (see https://wikitech.wikimedia.org/wiki/Mwdebug). Changes can now be verified there. [production]
22:03 <egardner@deploy1003> Started scap sync-world: Backport for [[gerrit:1294370|Carousel only on articles (T427336)]] [production]
21:37 <bking@cumin2002> DONE (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 15 days, 0:00:00 on relforge[1008-1010].eqiad.wmnet with reason: non-production environment [production]
21:20 <arlolra@deploy1003> helmfile [codfw] DONE helmfile.d/services/mw-parsoid: apply [production]
21:20 <arlolra@deploy1003> helmfile [codfw] START helmfile.d/services/mw-parsoid: apply [production]
21:20 <arlolra@deploy1003> helmfile [eqiad] DONE helmfile.d/services/mw-parsoid: apply [production]
21:19 <arlolra@deploy1003> helmfile [eqiad] START helmfile.d/services/mw-parsoid: apply [production]
21:04 <ebernhardson@deploy1003> Finished scap sync-world: Backport for [[gerrit:1288370|Allow Vector 2022 font size changes in namespace 100 for enwiktionary (T423766)]], [[gerrit:1293819|Fix case of 'commonsfinder' in $wgUrlProtocols (T426614)]] (duration: 07m 38s) [production]
20:59 <ebernhardson@deploy1003> matmarex, ebernhardson, pppery: Continuing with deployment [production]
20:58 <ebernhardson@deploy1003> matmarex, ebernhardson, pppery: Backport for [[gerrit:1288370|Allow Vector 2022 font size changes in namespace 100 for enwiktionary (T423766)]], [[gerrit:1293819|Fix case of 'commonsfinder' in $wgUrlProtocols (T426614)]] synced to the testservers (see https://wikitech.wikimedia.org/wiki/Mwdebug). Changes can now be verified there. [production]
20:56 <ebernhardson@deploy1003> Started scap sync-world: Backport for [[gerrit:1288370|Allow Vector 2022 font size changes in namespace 100 for enwiktionary (T423766)]], [[gerrit:1293819|Fix case of 'commonsfinder' in $wgUrlProtocols (T426614)]] [production]
20:51 <ebernhardson@deploy1003> Finished scap sync-world: Backport for [[gerrit:1294373|identity: Prune private ips from x-forwarded-for (T407432)]], [[gerrit:1294374|Revert^2 "cirrus: AB test query suggester variants" (T407432)]] (duration: 07m 30s) [production]
20:47 <ebernhardson@deploy1003> ebernhardson: Continuing with deployment [production]
20:46 <ebernhardson@deploy1003> ebernhardson: Backport for [[gerrit:1294373|identity: Prune private ips from x-forwarded-for (T407432)]], [[gerrit:1294374|Revert^2 "cirrus: AB test query suggester variants" (T407432)]] synced to the testservers (see https://wikitech.wikimedia.org/wiki/Mwdebug). Changes can now be verified there. [production]
20:44 <ebernhardson@deploy1003> Started scap sync-world: Backport for [[gerrit:1294373|identity: Prune private ips from x-forwarded-for (T407432)]], [[gerrit:1294374|Revert^2 "cirrus: AB test query suggester variants" (T407432)]] [production]
20:43 <swfrench-wmf> reprepro include dh-php_5.5+wmf12u1 into component/php83 for bookworm-wikimedia - T427312 [production]
20:39 <brett@cumin2002> END (FAIL) - Cookbook sre.hosts.decommission (exit_code=1) for hosts lvs1016.eqiad.wmnet [production]
20:39 <brett@cumin2002> END (PASS) - Cookbook sre.dns.netbox (exit_code=0) [production]
20:39 <brett@cumin2002> END (PASS) - Cookbook sre.puppet.sync-netbox-hiera (exit_code=0) generate netbox hiera data: "Triggered by cookbooks.sre.dns.netbox: lvs1016.eqiad.wmnet decommissioned, removing all IPs except the asset tag one - brett@cumin2002" [production]
20:38 <swfrench-wmf> reprepro include php-defaults_94+wmf12u1 into component/php83 for bookworm-wikimedia - T427312 [production]
20:37 <brett@cumin2002> START - Cookbook sre.puppet.sync-netbox-hiera generate netbox hiera data: "Triggered by cookbooks.sre.dns.netbox: lvs1016.eqiad.wmnet decommissioned, removing all IPs except the asset tag one - brett@cumin2002" [production]
20:31 <brett@cumin2002> START - Cookbook sre.dns.netbox [production]
20:27 <swfrench-wmf> reprepro include php8.3_8.3.31-1+wmf12u2 into component/php83 for bookworm-wikimedia - T427312 [production]
20:25 <brett@cumin2002> START - Cookbook sre.hosts.decommission for hosts lvs1016.eqiad.wmnet [production]
20:25 <sbisson@deploy1003> Finished scap sync-world: Backport for [[gerrit:1294342|Allow disabling experiment for experienced editors (>=100 edits) (T426871)]], [[gerrit:1294343|Allow disabling experiment for experienced editors (>=100 edits) (T426871)]], [[gerrit:1294344|frwiki: restrict Article Guidance experiment to junior editors (T426871)]] (duration: 08m 11s) [production]
20:21 <brett@cumin2002> END (ERROR) - Cookbook sre.hosts.reimage (exit_code=97) for host lvs1016.eqiad.wmnet with OS bullseye [production]
20:21 <sbisson@deploy1003> sbisson: Continuing with deployment [production]
20:20 <brett@cumin2002> END (PASS) - Cookbook sre.hosts.reboot-single (exit_code=0) for host lvs1020.eqiad.wmnet [production]
20:19 <sbisson@deploy1003> sbisson: Backport for [[gerrit:1294342|Allow disabling experiment for experienced editors (>=100 edits) (T426871)]], [[gerrit:1294343|Allow disabling experiment for experienced editors (>=100 edits) (T426871)]], [[gerrit:1294344|frwiki: restrict Article Guidance experiment to junior editors (T426871)]] synced to the testservers (see https://wikitech.wikimedia.org/wiki/Mwdebug). Changes can now be v [production]
20:17 <sbisson@deploy1003> Started scap sync-world: Backport for [[gerrit:1294342|Allow disabling experiment for experienced editors (>=100 edits) (T426871)]], [[gerrit:1294343|Allow disabling experiment for experienced editors (>=100 edits) (T426871)]], [[gerrit:1294344|frwiki: restrict Article Guidance experiment to junior editors (T426871)]] [production]
20:14 <brett@cumin2002> START - Cookbook sre.hosts.reboot-single for host lvs1020.eqiad.wmnet [production]
20:05 <cmooney@cumin1003> END (PASS) - Cookbook sre.network.peering (exit_code=0) with action 'configure' for AS: 12355 [production]