1-50 of 10000 results (24ms)
2026-05-27 ยง
21:20 <arlolra@deploy1003> helmfile [codfw] DONE helmfile.d/services/mw-parsoid: apply [production]
21:20 <arlolra@deploy1003> helmfile [codfw] START helmfile.d/services/mw-parsoid: apply [production]
21:20 <arlolra@deploy1003> helmfile [eqiad] DONE helmfile.d/services/mw-parsoid: apply [production]
21:19 <arlolra@deploy1003> helmfile [eqiad] START helmfile.d/services/mw-parsoid: apply [production]
21:07 <Reedy> Reloading Zuul to deploy https://gerrit.wikimedia.org/r/1294425 [releng]
21:04 <ebernhardson@deploy1003> Finished scap sync-world: Backport for [[gerrit:1288370|Allow Vector 2022 font size changes in namespace 100 for enwiktionary (T423766)]], [[gerrit:1293819|Fix case of 'commonsfinder' in $wgUrlProtocols (T426614)]] (duration: 07m 38s) [production]
20:59 <ebernhardson@deploy1003> matmarex, ebernhardson, pppery: Continuing with deployment [production]
20:58 <ebernhardson@deploy1003> matmarex, ebernhardson, pppery: Backport for [[gerrit:1288370|Allow Vector 2022 font size changes in namespace 100 for enwiktionary (T423766)]], [[gerrit:1293819|Fix case of 'commonsfinder' in $wgUrlProtocols (T426614)]] synced to the testservers (see https://wikitech.wikimedia.org/wiki/Mwdebug). Changes can now be verified there. [production]
20:56 <ebernhardson@deploy1003> Started scap sync-world: Backport for [[gerrit:1288370|Allow Vector 2022 font size changes in namespace 100 for enwiktionary (T423766)]], [[gerrit:1293819|Fix case of 'commonsfinder' in $wgUrlProtocols (T426614)]] [production]
20:51 <ebernhardson@deploy1003> Finished scap sync-world: Backport for [[gerrit:1294373|identity: Prune private ips from x-forwarded-for (T407432)]], [[gerrit:1294374|Revert^2 "cirrus: AB test query suggester variants" (T407432)]] (duration: 07m 30s) [production]
20:47 <ebernhardson@deploy1003> ebernhardson: Continuing with deployment [production]
20:46 <ebernhardson@deploy1003> ebernhardson: Backport for [[gerrit:1294373|identity: Prune private ips from x-forwarded-for (T407432)]], [[gerrit:1294374|Revert^2 "cirrus: AB test query suggester variants" (T407432)]] synced to the testservers (see https://wikitech.wikimedia.org/wiki/Mwdebug). Changes can now be verified there. [production]
20:44 <ebernhardson@deploy1003> Started scap sync-world: Backport for [[gerrit:1294373|identity: Prune private ips from x-forwarded-for (T407432)]], [[gerrit:1294374|Revert^2 "cirrus: AB test query suggester variants" (T407432)]] [production]
20:43 <swfrench-wmf> reprepro include dh-php_5.5+wmf12u1 into component/php83 for bookworm-wikimedia - T427312 [production]
20:39 <brett@cumin2002> END (FAIL) - Cookbook sre.hosts.decommission (exit_code=1) for hosts lvs1016.eqiad.wmnet [production]
20:39 <brett@cumin2002> END (PASS) - Cookbook sre.dns.netbox (exit_code=0) [production]
20:39 <brett@cumin2002> END (PASS) - Cookbook sre.puppet.sync-netbox-hiera (exit_code=0) generate netbox hiera data: "Triggered by cookbooks.sre.dns.netbox: lvs1016.eqiad.wmnet decommissioned, removing all IPs except the asset tag one - brett@cumin2002" [production]
20:38 <swfrench-wmf> reprepro include php-defaults_94+wmf12u1 into component/php83 for bookworm-wikimedia - T427312 [production]
20:37 <brett@cumin2002> START - Cookbook sre.puppet.sync-netbox-hiera generate netbox hiera data: "Triggered by cookbooks.sre.dns.netbox: lvs1016.eqiad.wmnet decommissioned, removing all IPs except the asset tag one - brett@cumin2002" [production]
20:33 <andrewbogott> rebuilt pywikibot for v11.3.0 T426547 [tools]
20:31 <brett@cumin2002> START - Cookbook sre.dns.netbox [production]
20:27 <swfrench-wmf> reprepro include php8.3_8.3.31-1+wmf12u2 into component/php83 for bookworm-wikimedia - T427312 [production]
20:25 <brett@cumin2002> START - Cookbook sre.hosts.decommission for hosts lvs1016.eqiad.wmnet [production]
20:25 <sbisson@deploy1003> Finished scap sync-world: Backport for [[gerrit:1294342|Allow disabling experiment for experienced editors (>=100 edits) (T426871)]], [[gerrit:1294343|Allow disabling experiment for experienced editors (>=100 edits) (T426871)]], [[gerrit:1294344|frwiki: restrict Article Guidance experiment to junior editors (T426871)]] (duration: 08m 11s) [production]
20:21 <brett@cumin2002> END (ERROR) - Cookbook sre.hosts.reimage (exit_code=97) for host lvs1016.eqiad.wmnet with OS bullseye [production]
20:21 <sbisson@deploy1003> sbisson: Continuing with deployment [production]
20:20 <brett@cumin2002> END (PASS) - Cookbook sre.hosts.reboot-single (exit_code=0) for host lvs1020.eqiad.wmnet [production]
20:19 <sbisson@deploy1003> sbisson: Backport for [[gerrit:1294342|Allow disabling experiment for experienced editors (>=100 edits) (T426871)]], [[gerrit:1294343|Allow disabling experiment for experienced editors (>=100 edits) (T426871)]], [[gerrit:1294344|frwiki: restrict Article Guidance experiment to junior editors (T426871)]] synced to the testservers (see https://wikitech.wikimedia.org/wiki/Mwdebug). Changes can now be v [production]
20:17 <sbisson@deploy1003> Started scap sync-world: Backport for [[gerrit:1294342|Allow disabling experiment for experienced editors (>=100 edits) (T426871)]], [[gerrit:1294343|Allow disabling experiment for experienced editors (>=100 edits) (T426871)]], [[gerrit:1294344|frwiki: restrict Article Guidance experiment to junior editors (T426871)]] [production]
20:14 <brett@cumin2002> START - Cookbook sre.hosts.reboot-single for host lvs1020.eqiad.wmnet [production]
20:05 <cmooney@cumin1003> END (PASS) - Cookbook sre.network.peering (exit_code=0) with action 'configure' for AS: 12355 [production]
20:04 <cmooney@cumin1003> START - Cookbook sre.network.peering with action 'configure' for AS: 12355 [production]
19:51 <brett@cumin2002> START - Cookbook sre.hosts.reimage for host lvs1016.eqiad.wmnet with OS bullseye [production]
19:48 <dani@deploy1003> helmfile [codfw] DONE helmfile.d/services/miscweb: apply [production]
19:48 <dani@deploy1003> helmfile [codfw] START helmfile.d/services/miscweb: apply [production]
19:48 <dani@deploy1003> helmfile [eqiad] DONE helmfile.d/services/miscweb: apply [production]
19:48 <dani@deploy1003> helmfile [eqiad] START helmfile.d/services/miscweb: apply [production]
19:48 <dani@deploy1003> helmfile [staging] DONE helmfile.d/services/miscweb: apply [production]
19:48 <dani@deploy1003> helmfile [staging] START helmfile.d/services/miscweb: apply [production]
19:46 <dani@deploy1003> helmfile [codfw] DONE helmfile.d/services/miscweb: apply [production]
19:46 <dani@deploy1003> helmfile [codfw] START helmfile.d/services/miscweb: apply [production]
19:46 <dani@deploy1003> helmfile [eqiad] DONE helmfile.d/services/miscweb: apply [production]
19:46 <dani@deploy1003> helmfile [eqiad] START helmfile.d/services/miscweb: apply [production]
19:45 <dani@deploy1003> helmfile [staging] DONE helmfile.d/services/miscweb: apply [production]
19:45 <dani@deploy1003> helmfile [staging] START helmfile.d/services/miscweb: apply [production]
19:32 <brett@cumin2002> END (PASS) - Cookbook sre.cdn.roll-reboot (exit_code=0) rolling reboot on P{cp6016.drmrs.wmnet,cp[1112,1114].eqiad.wmnet,cp[5024,5031-5032].eqsin.wmnet} and A:cp [production]
19:32 <brett@cumin2002> cookbooks.sre.cdn.roll-reboot finished rebooting cp5032.eqsin.wmnet [production]
19:20 <eevans@deploy1003> helmfile [staging] DONE helmfile.d/services/linked-artifacts: apply [production]
19:20 <eevans@deploy1003> helmfile [staging] START helmfile.d/services/linked-artifacts: apply [production]
19:01 <joal@deploy1003> Finished deploy [analytics/refinery@96cf761] (thin): Regular analytics weekly train THIN [analytics/refinery@96cf761f] (duration: 02m 08s) [production]