151-200 of 10000 results (24ms)
2025-12-11 ยง
21:35 <urbanecm@deploy2002> Finished scap sync-world: Backport for [[gerrit:1217580|Revert^3 "Confirmation email: further styling adjustments" (T411526)]], [[gerrit:1217581|Revert^3 "i18n: replace <> to avoid false positive export errors" (T411526)]] (duration: 46m 04s) [production]
21:22 <urbanecm@deploy2002> urbanecm: Continuing with sync [production]
21:22 <urbanecm@deploy2002> urbanecm: Backport for [[gerrit:1217580|Revert^3 "Confirmation email: further styling adjustments" (T411526)]], [[gerrit:1217581|Revert^3 "i18n: replace <> to avoid false positive export errors" (T411526)]] synced to the testservers (see https://wikitech.wikimedia.org/wiki/Mwdebug). Changes can now be verified there. [production]
21:17 <xcollazo@deploy2002> helmfile [dse-k8s-eqiad] DONE helmfile.d/dse-k8s-services/mw-content-history-reconcile-enrich: apply [production]
21:17 <xcollazo@deploy2002> helmfile [dse-k8s-eqiad] START helmfile.d/dse-k8s-services/mw-content-history-reconcile-enrich: apply [production]
21:15 <wmbot~lucaswerkmeister@tools-bastion-15> deployed 5c7dd452be (l10n updates: mk) [tools.lexeme-forms]
21:14 <jclark@cumin1003> END (FAIL) - Cookbook sre.hosts.reimage (exit_code=99) for host ganeti-jumbo1002.eqiad.wmnet with OS trixie [production]
21:10 <xcollazo@deploy2002> helmfile [dse-k8s-eqiad] DONE helmfile.d/dse-k8s-services/mw-content-history-reconcile-enrich: apply [production]
21:09 <xcollazo@deploy2002> helmfile [dse-k8s-eqiad] START helmfile.d/dse-k8s-services/mw-content-history-reconcile-enrich: apply [production]
20:57 <jclark@cumin1003> END (PASS) - Cookbook sre.hosts.provision (exit_code=0) for host ganeti-jumbo1002.mgmt.eqiad.wmnet with chassis set policy FORCE_RESTART [production]
20:56 <jclark@cumin1003> START - Cookbook sre.hosts.provision for host ganeti-jumbo1002.mgmt.eqiad.wmnet with chassis set policy FORCE_RESTART [production]
20:50 <jclark@cumin1003> END (PASS) - Cookbook sre.hosts.reimage (exit_code=0) for host ganeti-jumbo1001.eqiad.wmnet with OS trixie [production]
20:50 <jclark@cumin1003> END (PASS) - Cookbook sre.puppet.sync-netbox-hiera (exit_code=0) generate netbox hiera data: "Triggered by cookbooks.sre.hosts.reimage: Host reimage - jclark@cumin1003" [production]
20:49 <urbanecm@deploy2002> Started scap sync-world: Backport for [[gerrit:1217580|Revert^3 "Confirmation email: further styling adjustments" (T411526)]], [[gerrit:1217581|Revert^3 "i18n: replace <> to avoid false positive export errors" (T411526)]] [production]
20:40 <urbanecm@deploy2002> sync-world failed: <CalledProcessError> Command 'sudo -u mwbuilder /srv/mwbuilder/release/make-container-image/build-images.py --http-proxy http://webproxy:8080 --https-proxy http://webproxy:8080 /srv/mediawiki-staging/scap/image-build --staging-dir /srv/mediawiki-staging --mediawiki-versions 1.46.0-wmf.4,1.46.0-wmf.5,next --multiversion-image-basename docker-registry.discovery.wmnet/restricted/me [production]
20:38 <brett@dns1006> END - running authdns-update [production]
20:37 <brett@dns1006> START - running authdns-update [production]
20:34 <gehel@cumin1003> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 2:00:00 on wdqs1031.eqiad.wmnet with reason: host reimage [production]
20:28 <gehel@cumin1003> START - Cookbook sre.hosts.downtime for 2:00:00 on wdqs1031.eqiad.wmnet with reason: host reimage [production]
20:25 <jclark@cumin1003> START - Cookbook sre.puppet.sync-netbox-hiera generate netbox hiera data: "Triggered by cookbooks.sre.hosts.reimage: Host reimage - jclark@cumin1003" [production]
20:10 <gehel@cumin1003> START - Cookbook sre.hosts.reimage for host wdqs1031.eqiad.wmnet with OS trixie [production]
20:09 <jclark@cumin1003> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 2:00:00 on ganeti-jumbo1001.eqiad.wmnet with reason: host reimage [production]
20:02 <jclark@cumin1003> START - Cookbook sre.hosts.downtime for 2:00:00 on ganeti-jumbo1001.eqiad.wmnet with reason: host reimage [production]
19:54 <jclark@cumin1003> START - Cookbook sre.hosts.reimage for host ganeti-jumbo1002.eqiad.wmnet with OS trixie [production]
19:51 <jclark@cumin1003> START - Cookbook sre.hosts.reimage for host ganeti-jumbo1001.eqiad.wmnet with OS trixie [production]
19:49 <jclark@cumin1003> END (FAIL) - Cookbook sre.hosts.provision (exit_code=99) for host ganeti-jumbo1003.mgmt.eqiad.wmnet with chassis set policy FORCE_RESTART [production]
19:48 <jclark@cumin1003> START - Cookbook sre.hosts.provision for host ganeti-jumbo1003.mgmt.eqiad.wmnet with chassis set policy FORCE_RESTART [production]
19:47 <urbanecm@deploy2002> Started scap sync-world: Backport for [[gerrit:1217573|Revert^2 "Confirmation email: further styling adjustments" (T411526)]], [[gerrit:1217574|Revert^2 "i18n: replace <> to avoid false positive export errors" (T411526)]] [production]
19:46 <urbanecm@deploy2002> Finished scap sync-world: Backport for [[gerrit:1217575|[Growth] Enable Add Link backend on a handful of wikis (T410469)]] (duration: 08m 55s) [production]
19:42 <urbanecm@deploy2002> urbanecm: Continuing with sync [production]
19:41 <jhancock@cumin1003> END (PASS) - Cookbook sre.hosts.provision (exit_code=0) for host dse-k8s-worker2005.mgmt.codfw.wmnet with chassis set policy FORCE_RESTART [production]
19:40 <jhancock@cumin1003> END (PASS) - Cookbook sre.hosts.provision (exit_code=0) for host dse-k8s-worker2004.mgmt.codfw.wmnet with chassis set policy FORCE_RESTART [production]
19:40 <urbanecm@deploy2002> urbanecm: Backport for [[gerrit:1217575|[Growth] Enable Add Link backend on a handful of wikis (T410469)]] synced to the testservers (see https://wikitech.wikimedia.org/wiki/Mwdebug). Changes can now be verified there. [production]
19:37 <urbanecm@deploy2002> Started scap sync-world: Backport for [[gerrit:1217575|[Growth] Enable Add Link backend on a handful of wikis (T410469)]] [production]
19:29 <jhancock@cumin1003> START - Cookbook sre.hosts.provision for host dse-k8s-worker2005.mgmt.codfw.wmnet with chassis set policy FORCE_RESTART [production]
19:28 <jhancock@cumin1003> START - Cookbook sre.hosts.provision for host dse-k8s-worker2004.mgmt.codfw.wmnet with chassis set policy FORCE_RESTART [production]
19:27 <jhancock@cumin1003> END (PASS) - Cookbook sre.network.configure-switch-interfaces (exit_code=0) for host dse-k8s-worker2005 [production]
19:27 <jhancock@cumin1003> END (PASS) - Cookbook sre.network.configure-switch-interfaces (exit_code=0) for host dse-k8s-worker2004 [production]
19:27 <jhancock@cumin1003> START - Cookbook sre.network.configure-switch-interfaces for host dse-k8s-worker2005 [production]
19:27 <jhancock@cumin1003> START - Cookbook sre.network.configure-switch-interfaces for host dse-k8s-worker2004 [production]
19:27 <jhancock@cumin1003> END (PASS) - Cookbook sre.dns.netbox (exit_code=0) [production]
19:27 <jhancock@cumin1003> END (PASS) - Cookbook sre.puppet.sync-netbox-hiera (exit_code=0) generate netbox hiera data: "Triggered by cookbooks.sre.dns.netbox: adding dse-k8s-worker2004-5 to codfw - jhancock@cumin1003" [production]
19:26 <jhancock@cumin1003> START - Cookbook sre.puppet.sync-netbox-hiera generate netbox hiera data: "Triggered by cookbooks.sre.dns.netbox: adding dse-k8s-worker2004-5 to codfw - jhancock@cumin1003" [production]
19:23 <jhancock@cumin1003> START - Cookbook sre.dns.netbox [production]
19:22 <wmftkbot> Test Kitchen edge-unique experiments (poll 8600) - adds: none; removes: sticky-headers; fields: none - xLab/MPIC/TK tips at https://w.wiki/FwuD [analytics]
19:15 <Krinkle> krinkle@deploy1002 sql --write wikifunctionswiki `UPDATE page SET page_touched='20251211191600' WHERE page_id=66102 LIMIT 1;` [production]
18:51 <rzl@deploy2002> Finished scap sync-world: https://gerrit.wikimedia.org/r/1217347 T410975 (duration: 04m 54s) [production]
18:50 <rzl@deploy2002> rzl: Continuing with sync [production]
18:48 <rzl@deploy2002> rzl: https://gerrit.wikimedia.org/r/1217347 T410975 synced to the testservers (see https://wikitech.wikimedia.org/wiki/Mwdebug). Changes can now be verified there. [production]
18:47 <rzl@deploy2002> Started scap sync-world: https://gerrit.wikimedia.org/r/1217347 T410975 [production]