51-100 of 10000 results (21ms)
2025-12-11 ยง
19:46 <urbanecm@deploy2002> Finished scap sync-world: Backport for [[gerrit:1217575|[Growth] Enable Add Link backend on a handful of wikis (T410469)]] (duration: 08m 55s) [production]
19:42 <urbanecm@deploy2002> urbanecm: Continuing with sync [production]
19:41 <jhancock@cumin1003> END (PASS) - Cookbook sre.hosts.provision (exit_code=0) for host dse-k8s-worker2005.mgmt.codfw.wmnet with chassis set policy FORCE_RESTART [production]
19:40 <jhancock@cumin1003> END (PASS) - Cookbook sre.hosts.provision (exit_code=0) for host dse-k8s-worker2004.mgmt.codfw.wmnet with chassis set policy FORCE_RESTART [production]
19:40 <urbanecm@deploy2002> urbanecm: Backport for [[gerrit:1217575|[Growth] Enable Add Link backend on a handful of wikis (T410469)]] synced to the testservers (see https://wikitech.wikimedia.org/wiki/Mwdebug). Changes can now be verified there. [production]
19:37 <urbanecm@deploy2002> Started scap sync-world: Backport for [[gerrit:1217575|[Growth] Enable Add Link backend on a handful of wikis (T410469)]] [production]
19:29 <jhancock@cumin1003> START - Cookbook sre.hosts.provision for host dse-k8s-worker2005.mgmt.codfw.wmnet with chassis set policy FORCE_RESTART [production]
19:28 <jhancock@cumin1003> START - Cookbook sre.hosts.provision for host dse-k8s-worker2004.mgmt.codfw.wmnet with chassis set policy FORCE_RESTART [production]
19:27 <jhancock@cumin1003> END (PASS) - Cookbook sre.network.configure-switch-interfaces (exit_code=0) for host dse-k8s-worker2005 [production]
19:27 <jhancock@cumin1003> END (PASS) - Cookbook sre.network.configure-switch-interfaces (exit_code=0) for host dse-k8s-worker2004 [production]
19:27 <jhancock@cumin1003> START - Cookbook sre.network.configure-switch-interfaces for host dse-k8s-worker2005 [production]
19:27 <jhancock@cumin1003> START - Cookbook sre.network.configure-switch-interfaces for host dse-k8s-worker2004 [production]
19:27 <jhancock@cumin1003> END (PASS) - Cookbook sre.dns.netbox (exit_code=0) [production]
19:27 <jhancock@cumin1003> END (PASS) - Cookbook sre.puppet.sync-netbox-hiera (exit_code=0) generate netbox hiera data: "Triggered by cookbooks.sre.dns.netbox: adding dse-k8s-worker2004-5 to codfw - jhancock@cumin1003" [production]
19:26 <jhancock@cumin1003> START - Cookbook sre.puppet.sync-netbox-hiera generate netbox hiera data: "Triggered by cookbooks.sre.dns.netbox: adding dse-k8s-worker2004-5 to codfw - jhancock@cumin1003" [production]
19:23 <jhancock@cumin1003> START - Cookbook sre.dns.netbox [production]
19:22 <wmftkbot> Test Kitchen edge-unique experiments (poll 8600) - adds: none; removes: sticky-headers; fields: none - xLab/MPIC/TK tips at https://w.wiki/FwuD [analytics]
19:15 <Krinkle> krinkle@deploy1002 sql --write wikifunctionswiki `UPDATE page SET page_touched='20251211191600' WHERE page_id=66102 LIMIT 1;` [production]
18:51 <rzl@deploy2002> Finished scap sync-world: https://gerrit.wikimedia.org/r/1217347 T410975 (duration: 04m 54s) [production]
18:50 <rzl@deploy2002> rzl: Continuing with sync [production]
18:48 <rzl@deploy2002> rzl: https://gerrit.wikimedia.org/r/1217347 T410975 synced to the testservers (see https://wikitech.wikimedia.org/wiki/Mwdebug). Changes can now be verified there. [production]
18:47 <rzl@deploy2002> Started scap sync-world: https://gerrit.wikimedia.org/r/1217347 T410975 [production]
17:46 <wmbot~jjmc89@tools-bastion-14> redact credentials from fezcollector.sh fezcollector_ae.sh fezcollector_interactive.sh fezcollector_spi.sh fezcollector_test.sh T412411 [tools.fezcollector]
17:37 <btullis@deploy2002> helmfile [dse-k8s-eqiad] DONE helmfile.d/dse-k8s-services/analytics-test: apply [production]
17:37 <btullis@deploy2002> helmfile [dse-k8s-eqiad] START helmfile.d/dse-k8s-services/analytics-test: apply [production]
17:20 <gehel@cumin1003> END (FAIL) - Cookbook sre.hosts.reimage (exit_code=99) for host wdqs1030.eqiad.wmnet with OS trixie [production]
17:17 <gehel@cumin1003> END (FAIL) - Cookbook sre.hosts.reimage (exit_code=99) for host wdqs1029.eqiad.wmnet with OS trixie [production]
17:13 <taavi> add toolforge-standards-committee as a member T412411 [tools.fezcollector]
16:23 <jhathaway> upload new package of corto via reprepro [production]
16:18 <taavi@cloudcumin1001> END (PASS) - Cookbook wmcs.toolforge.component.deploy (exit_code=0) for component jobs-api [tools]
16:06 <taavi@cloudcumin1001> START - Cookbook wmcs.toolforge.component.deploy for component jobs-api [tools]
16:06 <taavi@cloudcumin1001> END (PASS) - Cookbook wmcs.toolforge.component.deploy (exit_code=0) for component jobs-api [toolsbeta]
15:53 <taavi@cloudcumin1001> START - Cookbook wmcs.toolforge.component.deploy for component jobs-api [toolsbeta]
15:47 <gehel@cumin1003> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 2:00:00 on wdqs1030.eqiad.wmnet with reason: host reimage [production]
15:43 <gehel@cumin1003> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 2:00:00 on wdqs1029.eqiad.wmnet with reason: host reimage [production]
15:43 <btullis@deploy2002> helmfile [dse-k8s-eqiad] DONE helmfile.d/dse-k8s-services/analytics-test: apply [production]
15:43 <btullis@deploy2002> helmfile [dse-k8s-eqiad] START helmfile.d/dse-k8s-services/analytics-test: apply [production]
15:41 <gehel@cumin1003> START - Cookbook sre.hosts.downtime for 2:00:00 on wdqs1030.eqiad.wmnet with reason: host reimage [production]
15:39 <gehel@cumin1003> START - Cookbook sre.hosts.downtime for 2:00:00 on wdqs1029.eqiad.wmnet with reason: host reimage [production]
15:24 <gehel@cumin1003> START - Cookbook sre.hosts.reimage for host wdqs1030.eqiad.wmnet with OS trixie [production]
15:21 <gehel@cumin1003> START - Cookbook sre.hosts.reimage for host wdqs1029.eqiad.wmnet with OS trixie [production]
15:13 <gehel@cumin1003> END (PASS) - Cookbook sre.hosts.reimage (exit_code=0) for host wdqs1028.eqiad.wmnet with OS trixie [production]
15:02 <jclark@cumin1003> END (PASS) - Cookbook sre.hosts.provision (exit_code=0) for host ganeti-jumbo1002.mgmt.eqiad.wmnet with chassis set policy FORCE_RESTART [production]
15:01 <jclark@cumin1003> END (PASS) - Cookbook sre.hosts.provision (exit_code=0) for host ganeti-jumbo1001.mgmt.eqiad.wmnet with chassis set policy FORCE_RESTART [production]
14:54 <gehel@cumin1003> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 2:00:00 on wdqs1028.eqiad.wmnet with reason: host reimage [production]
14:50 <gehel@cumin1003> START - Cookbook sre.hosts.downtime for 2:00:00 on wdqs1028.eqiad.wmnet with reason: host reimage [production]
14:48 <jclark@cumin1003> START - Cookbook sre.hosts.provision for host ganeti-jumbo1003.mgmt.eqiad.wmnet with chassis set policy FORCE_RESTART [production]
14:48 <jclark@cumin1003> START - Cookbook sre.hosts.provision for host ganeti-jumbo1002.mgmt.eqiad.wmnet with chassis set policy FORCE_RESTART [production]
14:48 <jclark@cumin1003> START - Cookbook sre.hosts.provision for host ganeti-jumbo1001.mgmt.eqiad.wmnet with chassis set policy FORCE_RESTART [production]
14:43 <jclark@cumin1003> START - Cookbook sre.dns.netbox [production]