|
2026-10-14
ยง
|
| 15:32 |
<oblivian@cumin1004> |
END (PASS) - Cookbook sre.k8s.pool-depool-node (exit_code=0) pool for host wikikube-worker2270.codfw.wmnet |
[production] |
| 15:31 |
<oblivian@cumin1004> |
START - Cookbook sre.k8s.pool-depool-node pool for host wikikube-worker2270.codfw.wmnet |
[production] |
| 15:31 |
<oblivian@cumin1004> |
END (PASS) - Cookbook sre.hosts.provision (exit_code=0) for host wikikube-worker2270.mgmt.codfw.wmnet with chassis set policy GRACEFUL_RESTART |
[production] |
| 15:26 |
<elukey@cumin1004> |
END (PASS) - Cookbook sre.hardware.upgrade-firmware (exit_code=0) upgrade firmware for hosts sretest2003.codfw.wmnet |
[production] |
| 15:26 |
<elukey@cumin1004> |
START - Cookbook sre.hardware.upgrade-firmware upgrade firmware for hosts sretest2003.codfw.wmnet |
[production] |
| 15:25 |
<oblivian@cumin1004> |
START - Cookbook sre.hosts.provision for host wikikube-worker2270.mgmt.codfw.wmnet with chassis set policy GRACEFUL_RESTART |
[production] |
| 15:25 |
<oblivian@cumin1004> |
END (PASS) - Cookbook sre.k8s.pool-depool-node (exit_code=0) depool for host wikikube-worker2270.codfw.wmnet |
[production] |
| 15:24 |
<oblivian@cumin1004> |
START - Cookbook sre.k8s.pool-depool-node depool for host wikikube-worker2270.codfw.wmnet |
[production] |
| 15:24 |
<oblivian@cumin1004> |
END (PASS) - Cookbook sre.k8s.pool-depool-node (exit_code=0) pool for host wikikube-worker2269.codfw.wmnet |
[production] |
| 15:24 |
<oblivian@cumin1004> |
START - Cookbook sre.hosts.provision for host wikikube-worker1307.mgmt.eqiad.wmnet with chassis set policy GRACEFUL_RESTART and with Dell SCP reboot policy GRACEFUL |
[production] |
| 15:24 |
<oblivian@cumin1004> |
END (PASS) - Cookbook sre.k8s.pool-depool-node (exit_code=0) depool for host wikikube-worker1307.eqiad.wmnet |
[production] |
| 15:23 |
<oblivian@cumin1004> |
START - Cookbook sre.k8s.pool-depool-node depool for host wikikube-worker1307.eqiad.wmnet |
[production] |
| 15:23 |
<oblivian@cumin1004> |
END (PASS) - Cookbook sre.k8s.pool-depool-node (exit_code=0) pool for host wikikube-worker1306.eqiad.wmnet |
[production] |
| 15:23 |
<oblivian@cumin1004> |
START - Cookbook sre.k8s.pool-depool-node pool for host wikikube-worker1306.eqiad.wmnet |
[production] |
| 15:23 |
<oblivian@cumin1004> |
START - Cookbook sre.k8s.pool-depool-node pool for host wikikube-worker2269.codfw.wmnet |
[production] |
| 15:23 |
<oblivian@cumin1004> |
END (PASS) - Cookbook sre.hosts.provision (exit_code=0) for host wikikube-worker2269.mgmt.codfw.wmnet with chassis set policy GRACEFUL_RESTART |
[production] |
| 15:23 |
<oblivian@cumin1004> |
END (PASS) - Cookbook sre.hosts.provision (exit_code=0) for host wikikube-worker1306.mgmt.eqiad.wmnet with chassis set policy GRACEFUL_RESTART and with Dell SCP reboot policy GRACEFUL |
[production] |
| 15:21 |
<aikochou@deploy1003> |
helmfile [ml-serve-eqiad] Ran 'sync' command on namespace 'experimental' for release 'main' . |
[production] |
| 15:18 |
<papaul> |
maintenance on mr1-eqiad complete |
[production] |
| 15:17 |
<oblivian@cumin1004> |
START - Cookbook sre.hosts.provision for host wikikube-worker2269.mgmt.codfw.wmnet with chassis set policy GRACEFUL_RESTART |
[production] |
| 15:17 |
<oblivian@cumin1004> |
END (PASS) - Cookbook sre.k8s.pool-depool-node (exit_code=0) depool for host wikikube-worker2269.codfw.wmnet |
[production] |
| 15:17 |
<oblivian@cumin1004> |
START - Cookbook sre.k8s.pool-depool-node depool for host wikikube-worker2269.codfw.wmnet |
[production] |
| 15:16 |
<oblivian@cumin1004> |
END (PASS) - Cookbook sre.k8s.pool-depool-node (exit_code=0) pool for host wikikube-worker2268.codfw.wmnet |
[production] |
| 15:15 |
<oblivian@cumin1004> |
START - Cookbook sre.k8s.pool-depool-node pool for host wikikube-worker2268.codfw.wmnet |
[production] |
| 15:15 |
<oblivian@cumin1004> |
END (PASS) - Cookbook sre.hosts.provision (exit_code=0) for host wikikube-worker2268.mgmt.codfw.wmnet with chassis set policy GRACEFUL_RESTART |
[production] |
| 15:14 |
<oblivian@cumin1004> |
START - Cookbook sre.hosts.provision for host wikikube-worker1306.mgmt.eqiad.wmnet with chassis set policy GRACEFUL_RESTART and with Dell SCP reboot policy GRACEFUL |
[production] |
| 15:13 |
<oblivian@cumin1004> |
END (PASS) - Cookbook sre.k8s.pool-depool-node (exit_code=0) depool for host wikikube-worker1306.eqiad.wmnet |
[production] |
| 15:13 |
<oblivian@cumin1004> |
START - Cookbook sre.k8s.pool-depool-node depool for host wikikube-worker1306.eqiad.wmnet |
[production] |
| 15:13 |
<oblivian@cumin1004> |
END (PASS) - Cookbook sre.k8s.pool-depool-node (exit_code=0) pool for host wikikube-worker1305.eqiad.wmnet |
[production] |
| 15:13 |
<oblivian@cumin1004> |
START - Cookbook sre.k8s.pool-depool-node pool for host wikikube-worker1305.eqiad.wmnet |
[production] |
| 15:12 |
<oblivian@cumin1004> |
END (PASS) - Cookbook sre.hosts.provision (exit_code=0) for host wikikube-worker1305.mgmt.eqiad.wmnet with chassis set policy GRACEFUL_RESTART and with Dell SCP reboot policy GRACEFUL |
[production] |
| 15:10 |
<oblivian@cumin1004> |
START - Cookbook sre.hosts.provision for host wikikube-worker2268.mgmt.codfw.wmnet with chassis set policy GRACEFUL_RESTART |
[production] |
| 15:09 |
<oblivian@cumin1004> |
END (PASS) - Cookbook sre.k8s.pool-depool-node (exit_code=0) depool for host wikikube-worker2268.codfw.wmnet |
[production] |
| 15:09 |
<oblivian@cumin1004> |
START - Cookbook sre.k8s.pool-depool-node depool for host wikikube-worker2268.codfw.wmnet |
[production] |
| 15:09 |
<oblivian@cumin1004> |
END (PASS) - Cookbook sre.k8s.pool-depool-node (exit_code=0) pool for host wikikube-worker2267.codfw.wmnet |
[production] |
| 15:08 |
<oblivian@cumin1004> |
START - Cookbook sre.k8s.pool-depool-node pool for host wikikube-worker2267.codfw.wmnet |
[production] |
| 15:08 |
<oblivian@cumin1004> |
END (PASS) - Cookbook sre.hosts.provision (exit_code=0) for host wikikube-worker2267.mgmt.codfw.wmnet with chassis set policy GRACEFUL_RESTART |
[production] |
| 15:04 |
<oblivian@cumin1004> |
START - Cookbook sre.hosts.provision for host wikikube-worker1305.mgmt.eqiad.wmnet with chassis set policy GRACEFUL_RESTART and with Dell SCP reboot policy GRACEFUL |
[production] |
| 15:04 |
<oblivian@cumin1004> |
END (PASS) - Cookbook sre.k8s.pool-depool-node (exit_code=0) depool for host wikikube-worker1305.eqiad.wmnet |
[production] |
| 15:03 |
<oblivian@cumin1004> |
START - Cookbook sre.k8s.pool-depool-node depool for host wikikube-worker1305.eqiad.wmnet |
[production] |
| 15:03 |
<oblivian@cumin1004> |
END (PASS) - Cookbook sre.k8s.pool-depool-node (exit_code=0) pool for host wikikube-worker1304.eqiad.wmnet |
[production] |
| 15:02 |
<oblivian@cumin1004> |
START - Cookbook sre.hosts.provision for host wikikube-worker2267.mgmt.codfw.wmnet with chassis set policy GRACEFUL_RESTART |
[production] |
| 15:02 |
<oblivian@cumin1004> |
END (PASS) - Cookbook sre.k8s.pool-depool-node (exit_code=0) depool for host wikikube-worker2267.codfw.wmnet |
[production] |
| 15:02 |
<oblivian@cumin1004> |
START - Cookbook sre.k8s.pool-depool-node depool for host wikikube-worker2267.codfw.wmnet |
[production] |
| 15:01 |
<oblivian@cumin1004> |
END (PASS) - Cookbook sre.k8s.pool-depool-node (exit_code=0) pool for host wikikube-worker2266.codfw.wmnet |
[production] |
| 15:01 |
<oblivian@cumin1004> |
START - Cookbook sre.k8s.pool-depool-node pool for host wikikube-worker2266.codfw.wmnet |
[production] |
| 15:00 |
<elukey> |
powercycle pki1002, unreachable via ssh, continuous stack dumps on the tty via mgmg console |
[production] |
| 15:00 |
<oblivian@cumin1004> |
START - Cookbook sre.k8s.pool-depool-node pool for host wikikube-worker1304.eqiad.wmnet |
[production] |
| 15:00 |
<oblivian@cumin1004> |
END (PASS) - Cookbook sre.hosts.provision (exit_code=0) for host wikikube-worker2266.mgmt.codfw.wmnet with chassis set policy GRACEFUL_RESTART |
[production] |
| 15:00 |
<oblivian@cumin1004> |
END (PASS) - Cookbook sre.hosts.provision (exit_code=0) for host wikikube-worker1304.mgmt.eqiad.wmnet with chassis set policy GRACEFUL_RESTART and with Dell SCP reboot policy GRACEFUL |
[production] |