101-150 of 4198 results (30ms)
2023-09-12 §
15:25 <andrewbogott> rebooting tools-sgeweblight-10-26.tools.eqiad1.wikimedia.cloud, oom [tools]
09:02 <taavi> restart a bunch of sge nodes due to NFS lockups [tools]
08:43 <taavi> reboot tools-sgebastion-10 due to stuck NFS mounts [tools]
2023-09-11 §
12:34 <dcaro> deploy kubernetes-metrics (T341084) [tools]
2023-09-05 §
13:31 <wm-bot2> dcaro@urcuchillay END (PASS) - Cookbook wmcs.toolforge.k8s.component.deploy (exit_code=0) for component registry-admissionNone (T341462) [tools]
13:31 <wm-bot2> dcaro@urcuchillay START - Cookbook wmcs.toolforge.k8s.component.deploy for component registry-admissionNone (T341462) [tools]
11:00 <dhinus> restarting mariadb on toolsdb-2 (replica) to test slave_parallel_threads (T345450) [tools]
2023-09-01 §
12:12 <wm-bot2> dcaro@urcuchillay END (FAIL) - Cookbook wmcs.openstack.cloudvirt.vm_console (exit_code=99) [tools]
12:12 <wm-bot2> dcaro@urcuchillay START - Cookbook wmcs.openstack.cloudvirt.vm_console [tools]
12:12 <wm-bot2> dcaro@urcuchillay END (FAIL) - Cookbook wmcs.openstack.cloudvirt.vm_console (exit_code=99) [tools]
12:12 <wm-bot2> dcaro@urcuchillay START - Cookbook wmcs.openstack.cloudvirt.vm_console [tools]
11:54 <taavi> reboot unresponsible tools-sgeweblight-10-21 [tools]
09:03 <wm-bot2> dcaro@urcuchillay END (FAIL) - Cookbook wmcs.openstack.cloudvirt.vm_console (exit_code=99) [tools]
09:03 <wm-bot2> dcaro@urcuchillay START - Cookbook wmcs.openstack.cloudvirt.vm_console [tools]
2023-08-31 §
13:06 <wm-bot2> dcaro@urcuchillay END (PASS) - Cookbook wmcs.toolforge.grid.cleanup_queue_errors (exit_code=0) [tools]
13:05 <wm-bot2> dcaro@urcuchillay START - Cookbook wmcs.toolforge.grid.cleanup_queue_errors [tools]
12:52 <wm-bot2> dcaro@urcuchillay END (PASS) - Cookbook wmcs.toolforge.grid.get_cluster_status (exit_code=0) [tools]
12:51 <wm-bot2> dcaro@urcuchillay START - Cookbook wmcs.toolforge.grid.get_cluster_status [tools]
09:50 <wm-bot2> deployed kubernetes component api-gateway (c0faf0f) (T341462) - cookbook ran by dcaro@urcuchillay [tools]
09:49 <wm-bot2> deployed kubernetes component jobs-api (9c9bee0) (T341462) - cookbook ran by dcaro@urcuchillay [tools]
09:48 <wm-bot2> deployed kubernetes component api-gateway (9c9bee0) (T341462) - cookbook ran by dcaro@urcuchillay [tools]
09:43 <wm-bot2> deployed kubernetes component api-gateway (485046b) (T341462) - cookbook ran by dcaro@urcuchillay [tools]
09:41 <wm-bot2> deployed kubernetes component api-gateway (c0faf0f) (T341462) - cookbook ran by dcaro@urcuchillay [tools]
2023-08-30 §
10:06 <dcaro> upgrade toolforge-weld to 1.2.1 (T344155) [tools]
08:59 <dcaro> restarting harbor to flush caches (T344435) [tools]
08:43 <dcaro> cleaning up empty harbor projects (T344435) [tools]
2023-08-29 §
14:17 <wm-bot2> deployed kubernetes component jobs-api (485046b) (T341462) - cookbook ran by dcaro@urcuchillay [tools]
13:06 <wm-bot2> deployed kubernetes component jobs-emailer (6f9c8cf) - cookbook ran by taavi@runko [tools]
2023-08-28 §
14:58 <wm-bot2> deployed kubernetes component envvars-api (90055b5) (T344502) - cookbook ran by dcaro@urcuchillay [tools]
2023-08-25 §
02:00 <bd808> Reboot of login.toolforge.org hung until a hard reboot was triggered via horizon [tools]
01:51 <bd808> Scheduled reboot of login.toolforge.org for 2023-08-25 01:56:08 UTC [tools]
2023-08-22 §
15:27 <taavi> fix broken k8s config files T344289#9110359 [tools]
14:31 <wm-bot2> deployed kubernetes component https://gerrit.wikimedia.org/r/labs/tools/maintain-kubeusers (27328a4) (T344668) - cookbook ran by taavi@runko [tools]
14:17 <wm-bot2> build & push docker image docker-registry.tools.wmflabs.org/maintain-kubeusers:eaeb46b from https://gerrit.wikimedia.org/r/labs/tools/maintain-kubeusers (eaeb46b) (T344668) - cookbook ran by taavi@runko [tools]
2023-08-18 §
13:46 <wm-bot2> deployed kubernetes component envvars-api (06c26be) (T341462) - cookbook ran by dcaro@urcuchillay [tools]
12:55 <taavi> reboot frozen tools-sgebastion-10 [tools]
12:48 <wm-bot2> deployed kubernetes component builds-api (727e6a7) (T341462) - cookbook ran by dcaro@urcuchillay [tools]
2023-08-17 §
12:19 <dcaro> deploy builds-api builds-api-0.0.85-20230817105952-25c2b55f [tools]
2023-08-15 §
23:29 <bd808> Rebooted tools-db-1.tools.eqiad1.wikimedia.cloud for T344298 [tools]
2023-07-26 §
09:30 <wm-bot2> deployed kubernetes component image-config (06066ba) - cookbook ran by taavi@runko [tools]
2023-07-25 §
13:03 <wm-bot2> deployed kubernetes component image-config (0eb287a) - cookbook ran by taavi@runko [tools]
13:02 <taavi> add php8.2 image T335352 T335507 [tools]
2023-07-24 §
21:45 <bd808> Rebuilding container images for refactored config and new PHP 8.2 image (T335352) [tools]
17:31 <taavi> hard reboot tools-harbor-1, unresponsible [tools]
2023-07-23 §
14:17 <taavi> hard reboot tools-sgeexec-10-15 [tools]
2023-07-20 §
15:19 <arturo> deploying https://gitlab.wikimedia.org/repos/cloud/toolforge/buildservice/-/merge_requests/6 again with newer image (T342338, T321188) [tools]
13:09 <wm-bot2> updating docker-registry.tools.wmflabs.org/toolforge-distroless-base-debug:latest (T321188) - cookbook ran by arturo@nostromo [tools]
11:27 <wm-bot2> updating docker-registry.tools.wmflabs.org/toolforge-distroless-base:debug (T321188) - cookbook ran by arturo@endurance [tools]
11:25 <wm-bot2> updating docker-registry.tools.wmflabs.org/toolforge-distroless-base:latest (T321188) - cookbook ran by arturo@endurance [tools]
2023-07-19 §
16:34 <wm-bot2> updating docker-registry.tools.wmflabs.org/toolforge-distroless-base@sha256:77051c1e40d180d0695b5a9ba7a15161ecac7220ea8c1ed6721bd1c8329b1b2f (T321188) - cookbook ran by arturo@nostromo [tools]