1-50 of 10000 results (36ms)
2026-03-30 §
14:38 <taavi@cloudcumin1001> END (PASS) - Cookbook wmcs.toolforge.component.deploy (exit_code=0) for component maintain-kubeusers [tools]
14:38 <taavi@cloudcumin1001> START - Cookbook wmcs.toolforge.component.deploy for component maintain-kubeusers [tools]
12:05 <dcaro> removing wal from prometheus nodes to restart them [tools]
2026-03-26 §
17:30 <taavi@cloudcumin1001> END (FAIL) - Cookbook wmcs.toolforge.component.deploy (exit_code=99) for component wmcs-k8s-metrics [tools]
17:25 <taavi@cloudcumin1001> START - Cookbook wmcs.toolforge.component.deploy for component wmcs-k8s-metrics [tools]
14:21 <taavi@cloudcumin1001> END (PASS) - Cookbook wmcs.toolforge.k8s.image.copy_to_registry (exit_code=0) for image docker-registry.svc.toolforge.org/cadvisor:0.56.2 [tools]
14:20 <taavi@cloudcumin1001> START - Cookbook wmcs.toolforge.k8s.image.copy_to_registry for image docker-registry.svc.toolforge.org/cadvisor:0.56.2 [tools]
14:20 <taavi@cloudcumin1001> END (FAIL) - Cookbook wmcs.toolforge.k8s.image.copy_to_registry (exit_code=99) for image docker-registry.svc.toolforge.org/cadvisor:0.56.2 [tools]
14:20 <taavi@cloudcumin1001> START - Cookbook wmcs.toolforge.k8s.image.copy_to_registry for image docker-registry.svc.toolforge.org/cadvisor:0.56.2 [tools]
10:22 <dcaro@cloudcumin1001> END (PASS) - Cookbook wmcs.toolforge.component.deploy (exit_code=0) for component builds-api [tools]
10:16 <dcaro@cloudcumin1001> START - Cookbook wmcs.toolforge.component.deploy for component builds-api [tools]
2026-03-25 §
13:43 <taavi@cloudcumin1001> END (PASS) - Cookbook wmcs.vps.remove_instance (exit_code=0) for instance tools-package-builder-04 [tools]
13:43 <taavi@cloudcumin1001> START - Cookbook wmcs.vps.remove_instance for instance tools-package-builder-04 [tools]
2026-03-24 §
17:49 <dcaro@cloudcumin1001> END (PASS) - Cookbook wmcs.toolforge.component.deploy (exit_code=0) for component builds-builder [tools]
17:44 <dcaro@cloudcumin1001> START - Cookbook wmcs.toolforge.component.deploy for component builds-builder [tools]
13:04 <dcaro@cloudcumin1001> END (PASS) - Cookbook wmcs.toolforge.component.deploy (exit_code=0) for component jobs-api [tools]
12:51 <dcaro@cloudcumin1001> START - Cookbook wmcs.toolforge.component.deploy for component jobs-api [tools]
2026-03-23 §
11:16 <taavi> send 10% of traffic to istio T392356 [tools]
10:53 <taavi> send 5% of traffic to istio T392356 [tools]
10:45 <taavi@cloudcumin1001> END (PASS) - Cookbook wmcs.toolforge.component.deploy (exit_code=0) for component istio-gateway [tools]
10:45 <taavi@cloudcumin1001> START - Cookbook wmcs.toolforge.component.deploy for component istio-gateway [tools]
2026-03-19 §
20:58 <taavi@cloudcumin1001> END (PASS) - Cookbook wmcs.toolforge.k8s.reboot (exit_code=0) for all nodes [tools]
17:00 <dcaro@cloudcumin1001> END (PASS) - Cookbook wmcs.toolforge.component.deploy (exit_code=0) for component builds-api [tools]
16:53 <dcaro@cloudcumin1001> START - Cookbook wmcs.toolforge.component.deploy for component builds-api [tools]
16:24 <dcaro@cloudcumin1001> END (PASS) - Cookbook wmcs.toolforge.component.deploy (exit_code=0) for component jobs-api [tools]
16:08 <dcaro@cloudcumin1001> START - Cookbook wmcs.toolforge.component.deploy for component jobs-api [tools]
15:29 <taavi@cloudcumin1001> START - Cookbook wmcs.toolforge.k8s.reboot for all nodes [tools]
14:56 <dcaro@cloudcumin1001> END (PASS) - Cookbook wmcs.toolforge.component.deploy (exit_code=0) for component jobs-api [tools]
14:43 <dcaro@cloudcumin1001> START - Cookbook wmcs.toolforge.component.deploy for component jobs-api [tools]
11:38 <taavi@cloudcumin1001> END (PASS) - Cookbook wmcs.toolforge.component.deploy (exit_code=0) for component infra-tracing [tools]
11:19 <taavi@cloudcumin1001> START - Cookbook wmcs.toolforge.component.deploy for component infra-tracing [tools]
09:07 <taavi> fixing 2 tools still running ruby2.1 image to use that instead of 'ruby2' in service.manifest [tools]
08:52 <taavi> fixing 2 tools still running ruby2.5 image to use that instead of 'ruby25' in service.manifest [tools]
08:49 <taavi> fixing 12 tools still running node6 image to use that instead of 'nodejs' in service.manifest [tools]
08:38 <taavi> fixing 12 tools still running golang1.11 image to use that instead of 'golang111' in service.manifest [tools]
08:36 <taavi> fixing 60 tools still running python3.4 image to use 'python3.4' instead of 'python' in service.manifest [tools]
2026-03-18 §
12:00 <taavi> restarting existing web services to backfill HTTPRoute resources T392356 [tools]
07:37 <filippo@cloudcumin1001> END (PASS) - Cookbook wmcs.toolforge.add_k8s_node (exit_code=0) for a worker-nfs role in the tools cluster [tools]
07:37 <filippo@cloudcumin1001> Added a new k8s worker-nfs tools-k8s-worker-nfs-83.tools.eqiad1.wikimedia.cloud to the cluster [tools]
07:23 <filippo@cloudcumin1001> START - Cookbook wmcs.toolforge.add_k8s_node for a worker-nfs role in the tools cluster (T419824) [tools]
2026-03-17 §
12:43 <taavi> shutdown tools-package-builder-04 T401819 [tools]
2026-03-15 §
03:10 <andrewbogott> rebooting tools-redis-6, VM is in state ERROR [tools]
2026-03-13 §
22:04 <taavi> reboot tools-bastion-15 T420044 [tools]
19:06 <taavi> reboot tools-bastion-14 T420044 [tools]
2026-03-12 §
13:55 <filippo@cloudcumin1001> END (PASS) - Cookbook wmcs.toolforge.k8s.reboot (exit_code=0) for tools-k8s-worker-nfs-76 [tools]
13:50 <filippo@cloudcumin1001> START - Cookbook wmcs.toolforge.k8s.reboot for tools-k8s-worker-nfs-76 [tools]
2026-03-10 §
11:44 <dcaro@cloudcumin1001> END (PASS) - Cookbook wmcs.toolforge.component.deploy (exit_code=0) for component misctools-cli [tools]
11:28 <dcaro@cloudcumin1001> START - Cookbook wmcs.toolforge.component.deploy for component misctools-cli [tools]
09:47 <raymond-ndibe@cloudcumin1001> END (PASS) - Cookbook wmcs.toolforge.component.deploy (exit_code=0) for component jobs-api [tools]
09:31 <raymond-ndibe@cloudcumin1001> START - Cookbook wmcs.toolforge.component.deploy for component jobs-api [tools]