3101-3150 of 7208 results (37ms)
2023-09-13 §
12:41 <wm-bot2> dcaro@urcuchillay END (FAIL) - Cookbook wmcs.toolforge.k8s.component.deploy (exit_code=99) for component maintain-kubeusersNone (T341084) [tools]
12:41 <wm-bot2> dcaro@urcuchillay START - Cookbook wmcs.toolforge.k8s.component.deploy for component maintain-kubeusersNone (T341084) [tools]
12:40 <wm-bot2> dcaro@urcuchillay END (FAIL) - Cookbook wmcs.toolforge.k8s.component.deploy (exit_code=99) for component maintain-kubeusersNone (T341084) [tools]
12:40 <wm-bot2> dcaro@urcuchillay START - Cookbook wmcs.toolforge.k8s.component.deploy for component maintain-kubeusersNone (T341084) [tools]
10:41 <wm-bot2> dcaro@urcuchillay END (ERROR) - Cookbook wmcs.toolforge.k8s.component.deploy (exit_code=97) for component maintain-kubeusersNone (T341084) [tools]
10:41 <wm-bot2> dcaro@urcuchillay START - Cookbook wmcs.toolforge.k8s.component.deploy for component maintain-kubeusersNone (T341084) [tools]
10:38 <wm-bot2> dcaro@urcuchillay END (PASS) - Cookbook wmcs.toolforge.k8s.component.deploy (exit_code=0) for component maintain-kubeusersNone (T341084) [tools]
10:38 <wm-bot2> dcaro@urcuchillay START - Cookbook wmcs.toolforge.k8s.component.deploy for component maintain-kubeusersNone (T341084) [tools]
10:35 <wm-bot2> dcaro@urcuchillay END (PASS) - Cookbook wmcs.toolforge.k8s.component.deploy (exit_code=0) for component maintain-kubeusersNone (T341084) [tools]
10:34 <wm-bot2> dcaro@urcuchillay START - Cookbook wmcs.toolforge.k8s.component.deploy for component maintain-kubeusersNone (T341084) [tools]
2023-09-12 §
15:25 <andrewbogott> rebooting tools-sgeweblight-10-26.tools.eqiad1.wikimedia.cloud, oom [tools]
09:02 <taavi> restart a bunch of sge nodes due to NFS lockups [tools]
08:43 <taavi> reboot tools-sgebastion-10 due to stuck NFS mounts [tools]
2023-09-11 §
12:34 <dcaro> deploy kubernetes-metrics (T341084) [tools]
2023-09-05 §
13:31 <wm-bot2> dcaro@urcuchillay END (PASS) - Cookbook wmcs.toolforge.k8s.component.deploy (exit_code=0) for component registry-admissionNone (T341462) [tools]
13:31 <wm-bot2> dcaro@urcuchillay START - Cookbook wmcs.toolforge.k8s.component.deploy for component registry-admissionNone (T341462) [tools]
11:00 <dhinus> restarting mariadb on toolsdb-2 (replica) to test slave_parallel_threads (T345450) [tools]
2023-09-01 §
12:12 <wm-bot2> dcaro@urcuchillay END (FAIL) - Cookbook wmcs.openstack.cloudvirt.vm_console (exit_code=99) [tools]
12:12 <wm-bot2> dcaro@urcuchillay START - Cookbook wmcs.openstack.cloudvirt.vm_console [tools]
12:12 <wm-bot2> dcaro@urcuchillay END (FAIL) - Cookbook wmcs.openstack.cloudvirt.vm_console (exit_code=99) [tools]
12:12 <wm-bot2> dcaro@urcuchillay START - Cookbook wmcs.openstack.cloudvirt.vm_console [tools]
11:54 <taavi> reboot unresponsible tools-sgeweblight-10-21 [tools]
09:03 <wm-bot2> dcaro@urcuchillay END (FAIL) - Cookbook wmcs.openstack.cloudvirt.vm_console (exit_code=99) [tools]
09:03 <wm-bot2> dcaro@urcuchillay START - Cookbook wmcs.openstack.cloudvirt.vm_console [tools]
2023-08-31 §
13:06 <wm-bot2> dcaro@urcuchillay END (PASS) - Cookbook wmcs.toolforge.grid.cleanup_queue_errors (exit_code=0) [tools]
13:05 <wm-bot2> dcaro@urcuchillay START - Cookbook wmcs.toolforge.grid.cleanup_queue_errors [tools]
12:52 <wm-bot2> dcaro@urcuchillay END (PASS) - Cookbook wmcs.toolforge.grid.get_cluster_status (exit_code=0) [tools]
12:51 <wm-bot2> dcaro@urcuchillay START - Cookbook wmcs.toolforge.grid.get_cluster_status [tools]
09:50 <wm-bot2> deployed kubernetes component api-gateway (c0faf0f) (T341462) - cookbook ran by dcaro@urcuchillay [tools]
09:49 <wm-bot2> deployed kubernetes component jobs-api (9c9bee0) (T341462) - cookbook ran by dcaro@urcuchillay [tools]
09:48 <wm-bot2> deployed kubernetes component api-gateway (9c9bee0) (T341462) - cookbook ran by dcaro@urcuchillay [tools]
09:43 <wm-bot2> deployed kubernetes component api-gateway (485046b) (T341462) - cookbook ran by dcaro@urcuchillay [tools]
09:41 <wm-bot2> deployed kubernetes component api-gateway (c0faf0f) (T341462) - cookbook ran by dcaro@urcuchillay [tools]
2023-08-30 §
10:06 <dcaro> upgrade toolforge-weld to 1.2.1 (T344155) [tools]
08:59 <dcaro> restarting harbor to flush caches (T344435) [tools]
08:43 <dcaro> cleaning up empty harbor projects (T344435) [tools]
2023-08-29 §
14:17 <wm-bot2> deployed kubernetes component jobs-api (485046b) (T341462) - cookbook ran by dcaro@urcuchillay [tools]
13:06 <wm-bot2> deployed kubernetes component jobs-emailer (6f9c8cf) - cookbook ran by taavi@runko [tools]
2023-08-28 §
14:58 <wm-bot2> deployed kubernetes component envvars-api (90055b5) (T344502) - cookbook ran by dcaro@urcuchillay [tools]
2023-08-25 §
02:00 <bd808> Reboot of login.toolforge.org hung until a hard reboot was triggered via horizon [tools]
01:51 <bd808> Scheduled reboot of login.toolforge.org for 2023-08-25 01:56:08 UTC [tools]
2023-08-22 §
15:27 <taavi> fix broken k8s config files T344289#9110359 [tools]
14:31 <wm-bot2> deployed kubernetes component https://gerrit.wikimedia.org/r/labs/tools/maintain-kubeusers (27328a4) (T344668) - cookbook ran by taavi@runko [tools]
14:17 <wm-bot2> build & push docker image docker-registry.tools.wmflabs.org/maintain-kubeusers:eaeb46b from https://gerrit.wikimedia.org/r/labs/tools/maintain-kubeusers (eaeb46b) (T344668) - cookbook ran by taavi@runko [tools]
2023-08-18 §
13:46 <wm-bot2> deployed kubernetes component envvars-api (06c26be) (T341462) - cookbook ran by dcaro@urcuchillay [tools]
12:55 <taavi> reboot frozen tools-sgebastion-10 [tools]
12:48 <wm-bot2> deployed kubernetes component builds-api (727e6a7) (T341462) - cookbook ran by dcaro@urcuchillay [tools]
2023-08-17 §
12:19 <dcaro> deploy builds-api builds-api-0.0.85-20230817105952-25c2b55f [tools]
2023-08-15 §
23:29 <bd808> Rebooted tools-db-1.tools.eqiad1.wikimedia.cloud for T344298 [tools]
2023-07-26 §
09:30 <wm-bot2> deployed kubernetes component image-config (06066ba) - cookbook ran by taavi@runko [tools]