601-650 of 10000 results (12ms)
2025-09-29 §
07:25 <jmm@cumin2002> END (PASS) - Cookbook sre.hosts.reboot-single (exit_code=0) for host ganeti1049.eqiad.wmnet [production]
07:20 <jmm@cumin2002> START - Cookbook sre.hosts.reboot-single for host ganeti1049.eqiad.wmnet [production]
07:17 <jmm@cumin2002> START - Cookbook sre.ganeti.drain-node for draining ganeti node ganeti1049.eqiad.wmnet [production]
07:00 <godog> kick stuck nfs workers from clouddumps1001 [tools]
06:46 <jmm@cumin2002> END (PASS) - Cookbook sre.ganeti.drain-node (exit_code=0) for draining ganeti node ganeti1048.eqiad.wmnet [production]
06:46 <jmm@cumin2002> END (PASS) - Cookbook sre.hosts.reboot-single (exit_code=0) for host ganeti1048.eqiad.wmnet [production]
06:41 <jmm@cumin2002> START - Cookbook sre.hosts.reboot-single for host ganeti1048.eqiad.wmnet [production]
06:38 <jmm@cumin2002> START - Cookbook sre.ganeti.drain-node for draining ganeti node ganeti1048.eqiad.wmnet [production]
06:38 <jmm@cumin2002> END (PASS) - Cookbook sre.ganeti.drain-node (exit_code=0) for draining ganeti node ganeti1047.eqiad.wmnet [production]
06:38 <jmm@cumin2002> END (PASS) - Cookbook sre.hosts.reboot-single (exit_code=0) for host ganeti1047.eqiad.wmnet [production]
06:37 <moritzm> upgrade Envoy on chartmuseum hosts T403663 [production]
06:33 <jmm@cumin2002> START - Cookbook sre.hosts.reboot-single for host ganeti1047.eqiad.wmnet [production]
06:28 <jmm@cumin2002> START - Cookbook sre.ganeti.drain-node for draining ganeti node ganeti1047.eqiad.wmnet [production]
01:14 <mwpresync@deploy2002> Finished scap build-images: Publishing wmf/next image (duration: 13m 50s) [production]
01:00 <mwpresync@deploy2002> Started scap build-images: Publishing wmf/next image [production]
2025-09-28 §
18:22 <moritzm> restart Tomcat on idp1004 [production]
18:12 <jmm@dns1004> END - running authdns-update [production]
18:11 <jmm@dns1004> START - running authdns-update [production]
16:38 <dani@deploy1003> helmfile [codfw] DONE helmfile.d/services/miscweb: apply [production]
16:38 <dani@deploy1003> helmfile [codfw] START helmfile.d/services/miscweb: apply [production]
16:38 <dani@deploy1003> helmfile [eqiad] DONE helmfile.d/services/miscweb: apply [production]
16:37 <dani@deploy1003> helmfile [eqiad] START helmfile.d/services/miscweb: apply [production]
16:37 <dani@deploy1003> helmfile [staging] DONE helmfile.d/services/miscweb: apply [production]
16:37 <dani@deploy1003> helmfile [staging] START helmfile.d/services/miscweb: apply [production]
08:54 <wmbot~dcaro@acme> END (PASS) - Cookbook wmcs.toolforge.k8s.reboot_stuck_workers (exit_code=0) for tools-k8s-worker-nfs-1, tools-k8s-worker-nfs-19, tools-k8s-worker-nfs-23, tools-k8s-worker-nfs-67, tools-k8s-worker-nfs-7, tools-k8s-worker-nfs-9 (T405850) [tools]
08:35 <wmbot~dcaro@acme> START - Cookbook wmcs.toolforge.k8s.reboot_stuck_workers for tools-k8s-worker-nfs-1, tools-k8s-worker-nfs-19, tools-k8s-worker-nfs-23, tools-k8s-worker-nfs-67, tools-k8s-worker-nfs-7, tools-k8s-worker-nfs-9 (T405850) [tools]
08:15 <wmbot~dcaro@acme> END (PASS) - Cookbook wmcs.toolforge.k8s.reboot (exit_code=0) for tools-k8s-worker-nfs-9 (T405850) [tools]
08:13 <wmbot~dcaro@acme> START - Cookbook wmcs.toolforge.k8s.reboot for tools-k8s-worker-nfs-9 (T405850) [tools]
08:12 <wmbot~dcaro@acme> END (PASS) - Cookbook wmcs.toolforge.k8s.reboot_stuck_workers (exit_code=0) for tools-k8s-worker-nfs-1 (T405850) [tools]
08:10 <wmbot~dcaro@acme> START - Cookbook wmcs.toolforge.k8s.reboot_stuck_workers for tools-k8s-worker-nfs-1 (T405850) [tools]
08:10 <wmbot~dcaro@acme> END (PASS) - Cookbook wmcs.openstack.cloudvirt.vm_console (exit_code=0) [tools]
08:08 <wmbot~dcaro@acme> START - Cookbook wmcs.openstack.cloudvirt.vm_console [tools]
08:08 <wmbot~dcaro@acme> END (ERROR) - Cookbook wmcs.openstack.cloudvirt.vm_console (exit_code=255) [tools]
08:08 <wmbot~dcaro@acme> START - Cookbook wmcs.openstack.cloudvirt.vm_console [tools]
08:08 <wmbot~dcaro@acme> END (ERROR) - Cookbook wmcs.openstack.cloudvirt.vm_console (exit_code=255) [tools]
08:08 <wmbot~dcaro@acme> START - Cookbook wmcs.openstack.cloudvirt.vm_console [tools]
08:07 <wmbot~dcaro@acme> END (ERROR) - Cookbook wmcs.openstack.cloudvirt.vm_console (exit_code=255) [tools]
08:07 <wmbot~dcaro@acme> START - Cookbook wmcs.openstack.cloudvirt.vm_console [tools]
08:01 <wmbot~bsadowski1@tools-bastion-15> Restarted StewardBot due to a connection loss [tools.stewardbots]
01:02 <mwpresync@deploy2002> Finished scap build-images: Publishing wmf/next image (duration: 01m 23s) [production]
01:00 <mwpresync@deploy2002> Started scap build-images: Publishing wmf/next image [production]
2025-09-27 §
13:10 <wm-bot2> Deployment completed: https://github.com/cluebotng/component-configs/actions/runs/18060217564 (https://github.com/cluebotng/component-configs/commits/049d68d8af679276a08e05d41c90210efa03240b) [tools.cluebotng-trainer]
13:10 <wm-bot2> Deployment completed: https://github.com/cluebotng/component-configs/actions/runs/18060217573 (https://github.com/cluebotng/component-configs/commits/049d68d8af679276a08e05d41c90210efa03240b) [tools.cluebot-syncer]
13:08 <wm-bot2> Deployment completed: https://github.com/cluebotng/component-configs/actions/runs/18060157048 (https://github.com/cluebotng/component-configs/commits/3aa079ed0cb7aa29f9ece46a47ad96203e53f242) [tools.cluebotng-review]
13:07 <wmbot~damian-scripts@tools-bastion-15> bot deployed @ refs/tags/v1.3.0 [tools.cluebotng]
01:14 <mwpresync@deploy2002> Finished scap build-images: Publishing wmf/next image (duration: 13m 31s) [production]
01:00 <mwpresync@deploy2002> Started scap build-images: Publishing wmf/next image [production]
2025-09-26 §
22:41 <rzl> rzl@apt1002:~$ sudo -i reprepro -C component/envoy-future include bullseye-wikimedia /home/rzl/envoyproxy/envoyproxy_1.32.12-1_amd64.changes # T405808 [production]
22:18 <wm-bot2> Deployment completed: https://github.com/cluebotng/component-configs/actions/runs/18050560602 (https://github.com/cluebotng/component-configs/commits/886ded0824a9ce7b27c852949f3530bda15bef14) [tools.cluebotng-review]
21:56 <jclark@cumin1002> END (PASS) - Cookbook sre.hosts.reimage (exit_code=0) for host an-worker1214.eqiad.wmnet with OS bullseye [production]