|
2025-09-25
§
|
| 16:07 |
<dcaro@cloudcumin1001> |
END (PASS) - Cookbook wmcs.toolforge.component.deploy (exit_code=0) for component jobs-cli |
[tools] |
| 15:58 |
<dcaro@cloudcumin1001> |
START - Cookbook wmcs.toolforge.component.deploy for component jobs-cli |
[tools] |
| 13:28 |
<dcaro@cloudcumin1001> |
END (PASS) - Cookbook wmcs.toolforge.component.deploy (exit_code=0) for component jobs-api |
[tools] |
| 13:15 |
<dcaro@cloudcumin1001> |
START - Cookbook wmcs.toolforge.component.deploy for component jobs-api |
[tools] |
| 12:22 |
<dcaro@cloudcumin1001> |
END (PASS) - Cookbook wmcs.toolforge.component.deploy (exit_code=0) for component jobs-api |
[tools] |
| 12:10 |
<dcaro@cloudcumin1001> |
START - Cookbook wmcs.toolforge.component.deploy for component jobs-api |
[tools] |
| 12:04 |
<dcaro@cloudcumin1001> |
END (ERROR) - Cookbook wmcs.toolforge.component.deploy (exit_code=97) for component jobs-api |
[tools] |
| 11:54 |
<dcaro@cloudcumin1001> |
START - Cookbook wmcs.toolforge.component.deploy for component jobs-api |
[tools] |
| 09:29 |
<dcaro@cloudcumin1001> |
END (PASS) - Cookbook wmcs.toolforge.component.deploy (exit_code=0) for component jobs-api |
[tools] |
| 09:14 |
<dcaro@cloudcumin1001> |
START - Cookbook wmcs.toolforge.component.deploy for component jobs-api |
[tools] |
|
2025-09-24
§
|
| 20:25 |
<andrew@cloudcumin1001> |
END (PASS) - Cookbook wmcs.toolforge.k8s.reboot (exit_code=0) for tools-k8s-worker-nfs-14 |
[tools] |
| 20:19 |
<andrew@cloudcumin1001> |
START - Cookbook wmcs.toolforge.k8s.reboot for tools-k8s-worker-nfs-14 |
[tools] |
| 17:41 |
<dcaro@cloudcumin1001> |
END (PASS) - Cookbook wmcs.toolforge.component.deploy (exit_code=0) for component jobs-cli |
[tools] |
| 17:32 |
<dcaro@cloudcumin1001> |
START - Cookbook wmcs.toolforge.component.deploy for component jobs-cli |
[tools] |
| 17:32 |
<dcaro@cloudcumin1001> |
END (FAIL) - Cookbook wmcs.toolforge.component.deploy (exit_code=99) for component jobs-cli |
[tools] |
| 17:30 |
<wmbot~dcaro@acme> |
END (PASS) - Cookbook wmcs.toolforge.k8s.reboot_stuck_workers (exit_code=0) for tools-k8s-worker-nfs-43 |
[tools] |
| 17:28 |
<wmbot~dcaro@acme> |
START - Cookbook wmcs.toolforge.k8s.reboot_stuck_workers for tools-k8s-worker-nfs-43 |
[tools] |
| 17:23 |
<dcaro@cloudcumin1001> |
START - Cookbook wmcs.toolforge.component.deploy for component jobs-cli |
[tools] |
| 17:10 |
<wmbot~dcaro@acme> |
END (PASS) - Cookbook wmcs.toolforge.k8s.reboot_stuck_workers (exit_code=0) for tools-k8s-worker-nfs-43 |
[tools] |
| 17:07 |
<wmbot~dcaro@acme> |
START - Cookbook wmcs.toolforge.k8s.reboot_stuck_workers for tools-k8s-worker-nfs-43 |
[tools] |
| 16:57 |
<wmbot~dcaro@acme> |
END (PASS) - Cookbook wmcs.toolforge.k8s.reboot (exit_code=0) for tools-k8s-worker-nfs-73 (T400957) |
[tools] |
| 16:50 |
<wmbot~dcaro@acme> |
START - Cookbook wmcs.toolforge.k8s.reboot for tools-k8s-worker-nfs-73 (T400957) |
[tools] |
| 13:49 |
<dcaro> |
patched all tools with new resource defaults, everything looks good |
[tools] |
| 13:34 |
<dcaro@cloudcumin1001> |
END (PASS) - Cookbook wmcs.toolforge.component.deploy (exit_code=0) for component jobs-api |
[tools] |
| 13:21 |
<dcaro@cloudcumin1001> |
START - Cookbook wmcs.toolforge.component.deploy for component jobs-api |
[tools] |
| 13:09 |
<dcaro> |
depolyed jobs-api change to default resources, patching existing jobs |
[tools] |
| 13:08 |
<dcaro@cloudcumin1001> |
END (ERROR) - Cookbook wmcs.toolforge.component.deploy (exit_code=97) for component jobs-cli |
[tools] |
| 13:07 |
<dcaro@cloudcumin1001> |
START - Cookbook wmcs.toolforge.component.deploy for component jobs-cli |
[tools] |
| 12:36 |
<dcaro@cloudcumin1001> |
END (FAIL) - Cookbook wmcs.toolforge.component.deploy (exit_code=99) for component maintain-kubeusers |
[tools] |
| 12:29 |
<dcaro@cloudcumin1001> |
START - Cookbook wmcs.toolforge.component.deploy for component maintain-kubeusers |
[tools] |
| 12:28 |
<dcaro@cloudcumin1001> |
END (FAIL) - Cookbook wmcs.toolforge.component.deploy (exit_code=99) for component maintain-kubeusers |
[tools] |
| 12:14 |
<dcaro@cloudcumin1001> |
START - Cookbook wmcs.toolforge.component.deploy for component maintain-kubeusers |
[tools] |
| 12:11 |
<dcaro@cloudcumin1001> |
END (FAIL) - Cookbook wmcs.toolforge.component.deploy (exit_code=99) for component maintain-kubeusers |
[tools] |
| 12:03 |
<dcaro@cloudcumin1001> |
START - Cookbook wmcs.toolforge.component.deploy for component maintain-kubeusers |
[tools] |
| 03:54 |
<andrew@cloudcumin1001> |
END (PASS) - Cookbook wmcs.toolforge.k8s.reboot (exit_code=0) for tools-k8s-worker-nfs-12 |
[tools] |
| 03:52 |
<andrew@cloudcumin1001> |
START - Cookbook wmcs.toolforge.k8s.reboot for tools-k8s-worker-nfs-12 |
[tools] |
|
2025-09-21
§
|
| 09:17 |
<wmbot~dcaro@acme> |
END (PASS) - Cookbook wmcs.toolforge.k8s.reboot (exit_code=0) for tools-k8s-worker-nfs-21, tools-k8s-worker-nfs-37, tools-k8s-worker-nfs-2 |
[tools] |
| 09:02 |
<wmbot~dcaro@acme> |
START - Cookbook wmcs.toolforge.k8s.reboot for tools-k8s-worker-nfs-21, tools-k8s-worker-nfs-37, tools-k8s-worker-nfs-2 |
[tools] |
| 03:16 |
<dcaro> |
acking and silencing CPU capacity alerts to handle on Monday, they should not page |
[tools] |
| 01:46 |
<andrew@cloudcumin1001> |
END (PASS) - Cookbook wmcs.toolforge.add_k8s_node (exit_code=0) for a worker role in the tools cluster |
[tools] |
| 01:46 |
<andrew@cloudcumin1001> |
Added a new k8s worker tools-k8s-worker-113.tools.eqiad1.wikimedia.cloud to the cluster |
[tools] |
| 01:36 |
<andrewbogott> |
adding additional worker node in response to repeated capacity alerts |
[tools] |
| 01:35 |
<andrew@cloudcumin1001> |
START - Cookbook wmcs.toolforge.add_k8s_node for a worker role in the tools cluster |
[tools] |