451-500 of 10000 results (22ms)
2026-04-09 ยง
19:30 <vriley@cumin1003> END (FAIL) - Cookbook sre.hosts.provision (exit_code=99) for host ganeti1055.mgmt.eqiad.wmnet with chassis set policy FORCE_RESTART and with Dell SCP reboot policy FORCED [production]
19:29 <vriley@cumin1003> START - Cookbook sre.hosts.provision for host ganeti1055.mgmt.eqiad.wmnet with chassis set policy FORCE_RESTART and with Dell SCP reboot policy FORCED [production]
19:24 <vriley@cumin1003> END (FAIL) - Cookbook sre.hosts.provision (exit_code=99) for host ganeti1055.mgmt.eqiad.wmnet with chassis set policy FORCE_RESTART and with Dell SCP reboot policy FORCED [production]
19:20 <vriley@cumin1003> START - Cookbook sre.hosts.provision for host ganeti1055.mgmt.eqiad.wmnet with chassis set policy FORCE_RESTART and with Dell SCP reboot policy FORCED [production]
19:18 <vriley@cumin1003> END (FAIL) - Cookbook sre.hosts.provision (exit_code=99) for host ganeti1055.mgmt.eqiad.wmnet with chassis set policy FORCE_RESTART and with Dell SCP reboot policy FORCED [production]
19:16 <inflatador> bking@apt1002 sudo -E reprepro -C thirdparty/opensearch2 copy trixie-wikimedia bookworm-wikimedia opensearch T422860 [production]
19:16 <vriley@cumin1003> START - Cookbook sre.hosts.provision for host ganeti1055.mgmt.eqiad.wmnet with chassis set policy FORCE_RESTART and with Dell SCP reboot policy FORCED [production]
19:15 <vriley@cumin1003> END (FAIL) - Cookbook sre.hosts.provision (exit_code=99) for host ganeti1055.mgmt.eqiad.wmnet with chassis set policy FORCE_RESTART and with Dell SCP reboot policy FORCED [production]
19:13 <wm-bot2> Deployment completed: https://github.com/cluebotng/component-configs/actions/runs/24208407251 (https://github.com/cluebotng/component-configs/commits/6cd680dd209bf7fbb01cf24cb6cca82f0fab716d) [tools.cluebotng-review]
19:11 <vriley@cumin1003> START - Cookbook sre.hosts.provision for host ganeti1055.mgmt.eqiad.wmnet with chassis set policy FORCE_RESTART and with Dell SCP reboot policy FORCED [production]
19:10 <vriley@cumin1003> END (PASS) - Cookbook sre.network.configure-switch-interfaces (exit_code=0) for host ganeti1055 [production]
19:09 <vriley@cumin1003> START - Cookbook sre.network.configure-switch-interfaces for host ganeti1055 [production]
19:09 <vriley@cumin1003> END (PASS) - Cookbook sre.dns.netbox (exit_code=0) [production]
19:06 <vriley@cumin1003> START - Cookbook sre.dns.netbox [production]
19:04 <inflatador> bking@apt1002 delete old haproxy pkgs P90343 [production]
19:02 <otto@deploy1003> helmfile [dse-k8s-eqiad] DONE helmfile.d/dse-k8s-services/mw-page-html-content-change-enrich-next: apply [production]
19:02 <otto@deploy1003> helmfile [dse-k8s-eqiad] START helmfile.d/dse-k8s-services/mw-page-html-content-change-enrich-next: apply [production]
19:00 <larssandergreen> tools upgraded from 986f7f83 to 9bff5f07 [fundraising]
18:58 <otto@deploy1003> helmfile [dse-k8s-eqiad] DONE helmfile.d/dse-k8s-services/mw-page-html-content-change-enrich-next: apply [production]
18:58 <otto@deploy1003> helmfile [dse-k8s-eqiad] START helmfile.d/dse-k8s-services/mw-page-html-content-change-enrich-next: apply [production]
18:56 <ladsgroup@deploy1003> Finished scap sync-world: Backport for [[gerrit:1269572|Revert^5 "Use envoy for swift inside mediawiki"]] (duration: 05m 53s) [production]
18:52 <ladsgroup@deploy1003> ladsgroup: Continuing with sync [production]
18:52 <ladsgroup@deploy1003> ladsgroup: Backport for [[gerrit:1269572|Revert^5 "Use envoy for swift inside mediawiki"]] synced to the testservers (see https://wikitech.wikimedia.org/wiki/Mwdebug). Changes can now be verified there. [production]
18:50 <ladsgroup@deploy1003> Started scap sync-world: Backport for [[gerrit:1269572|Revert^5 "Use envoy for swift inside mediawiki"]] [production]
18:49 <dancy@deploy1003> Installation of scap version "4.247.0" completed for 2 hosts [production]
18:49 <otto@deploy1003> helmfile [dse-k8s-eqiad] DONE helmfile.d/dse-k8s-services/mw-page-html-content-change-enrich-next: apply [production]
18:49 <otto@deploy1003> helmfile [dse-k8s-eqiad] START helmfile.d/dse-k8s-services/mw-page-html-content-change-enrich-next: apply [production]
18:47 <dancy@deploy1003> Installing scap version "4.247.0" for 2 host(s) [production]
18:46 <otto@deploy1003> helmfile [dse-k8s-eqiad] DONE helmfile.d/dse-k8s-services/mw-page-html-content-change-enrich-next: apply [production]
18:46 <otto@deploy1003> helmfile [dse-k8s-eqiad] START helmfile.d/dse-k8s-services/mw-page-html-content-change-enrich-next: apply [production]
18:40 <otto@deploy1003> helmfile [dse-k8s-eqiad] DONE helmfile.d/dse-k8s-services/mw-page-html-content-change-enrich-next: apply [production]
18:40 <otto@deploy1003> helmfile [dse-k8s-eqiad] START helmfile.d/dse-k8s-services/mw-page-html-content-change-enrich-next: apply [production]
18:37 <otto@deploy1003> helmfile [dse-k8s-eqiad] DONE helmfile.d/dse-k8s-services/mw-page-html-content-change-enrich-next: apply [production]
18:37 <otto@deploy1003> helmfile [dse-k8s-eqiad] START helmfile.d/dse-k8s-services/mw-page-html-content-change-enrich-next: apply [production]
18:36 <wm-bot2> Deployment completed: https://github.com/cluebotng/component-configs/actions/runs/24206712245 (https://github.com/cluebotng/component-configs/commits/e7d5ec988541b9d441a5c565f624b7e88e11204f) [tools.cluebotng-monitoring]
18:32 <wm-bot2> Deployment completed: https://github.com/cluebotng/component-configs/actions/runs/24206712296 (https://github.com/cluebotng/component-configs/commits/e7d5ec988541b9d441a5c565f624b7e88e11204f) [tools.cluebotng-review]
18:29 <otto@deploy1003> helmfile [dse-k8s-eqiad] DONE helmfile.d/dse-k8s-services/mw-page-html-content-change-enrich-next: apply [production]
18:29 <otto@deploy1003> helmfile [dse-k8s-eqiad] START helmfile.d/dse-k8s-services/mw-page-html-content-change-enrich-next: apply [production]
18:23 <andrew@cumin2002> END (PASS) - Cookbook sre.hosts.reboot-single (exit_code=0) for host cloudcephmon2005-dev.codfw.wmnet [production]
18:19 <wm-bot2> Deployment completed: https://github.com/cluebotng/component-configs/actions/runs/24206093220 (https://github.com/cluebotng/component-configs/commits/a97bfe791582e24f1c696f1bd89b965ea233c253) [tools.cluebotng-review]
18:18 <wm-bot2> Deployment completed: https://github.com/cluebotng/component-configs/actions/runs/24206093210 (https://github.com/cluebotng/component-configs/commits/a97bfe791582e24f1c696f1bd89b965ea233c253) [tools.toolforge-functional-runner]
18:18 <wm-bot2> Deployment completed: https://github.com/cluebotng/component-configs/actions/runs/24206093239 (https://github.com/cluebotng/component-configs/commits/a97bfe791582e24f1c696f1bd89b965ea233c253) [tools.cluebotng-editsets]
18:17 <wm-bot2> Deployment failed: https://github.com/cluebotng/component-configs/actions/runs/24206093215 (https://github.com/cluebotng/component-configs/commits/a97bfe791582e24f1c696f1bd89b965ea233c253) [tools.cluebotng-monitoring]
18:17 <wm-bot2> Deployment completed: https://github.com/cluebotng/component-configs/actions/runs/24206093268 (https://github.com/cluebotng/component-configs/commits/a97bfe791582e24f1c696f1bd89b965ea233c253) [tools.cluebotng-trainer]
18:17 <andrew@cumin2002> START - Cookbook sre.hosts.reboot-single for host cloudcephmon2005-dev.codfw.wmnet [production]
18:17 <wm-bot2> Deployment failed: https://github.com/cluebotng/component-configs/actions/runs/24206093216 (https://github.com/cluebotng/component-configs/commits/a97bfe791582e24f1c696f1bd89b965ea233c253) [tools.cluebotng]
18:16 <wm-bot2> Deployment failed: https://github.com/cluebotng/component-configs/actions/runs/24206093212 (https://github.com/cluebotng/component-configs/commits/a97bfe791582e24f1c696f1bd89b965ea233c253) [tools.cluebotng-staging]
18:13 <dancy@deploy1003> rebuilt and synchronized wikiversions files: group2 to 1.46.0-wmf.23 refs T420481 [production]
18:04 <otto@deploy1003> helmfile [dse-k8s-eqiad] DONE helmfile.d/dse-k8s-services/mw-page-html-content-change-enrich-next: apply [production]
18:04 <otto@deploy1003> helmfile [dse-k8s-eqiad] START helmfile.d/dse-k8s-services/mw-page-html-content-change-enrich-next: apply [production]