|
2026-10-14
ยง
|
| 09:18 |
<oblivian@cumin1004> |
END (PASS) - Cookbook sre.k8s.pool-depool-node (exit_code=0) depool for host wikikube-worker1288.eqiad.wmnet |
[production] |
| 09:17 |
<oblivian@cumin1004> |
START - Cookbook sre.k8s.pool-depool-node depool for host wikikube-worker1288.eqiad.wmnet |
[production] |
| 09:17 |
<oblivian@cumin1004> |
END (PASS) - Cookbook sre.k8s.pool-depool-node (exit_code=0) pool for host wikikube-worker1287.eqiad.wmnet |
[production] |
| 09:16 |
<oblivian@cumin1004> |
START - Cookbook sre.k8s.pool-depool-node pool for host wikikube-worker1287.eqiad.wmnet |
[production] |
| 09:15 |
<oblivian@cumin1004> |
END (PASS) - Cookbook sre.hosts.provision (exit_code=0) for host wikikube-worker1287.mgmt.eqiad.wmnet with chassis set policy GRACEFUL_RESTART and with Dell SCP reboot policy GRACEFUL |
[production] |
| 09:05 |
<oblivian@cumin1004> |
START - Cookbook sre.hosts.provision for host wikikube-worker1287.mgmt.eqiad.wmnet with chassis set policy GRACEFUL_RESTART and with Dell SCP reboot policy GRACEFUL |
[production] |
| 09:05 |
<oblivian@cumin1004> |
END (PASS) - Cookbook sre.k8s.pool-depool-node (exit_code=0) depool for host wikikube-worker1287.eqiad.wmnet |
[production] |
| 09:04 |
<oblivian@cumin1004> |
START - Cookbook sre.k8s.pool-depool-node depool for host wikikube-worker1287.eqiad.wmnet |
[production] |
| 09:04 |
<oblivian@cumin1004> |
END (PASS) - Cookbook sre.k8s.pool-depool-node (exit_code=0) pool for host wikikube-worker1286.eqiad.wmnet |
[production] |
| 09:02 |
<oblivian@cumin1004> |
START - Cookbook sre.k8s.pool-depool-node pool for host wikikube-worker1286.eqiad.wmnet |
[production] |
| 09:02 |
<oblivian@cumin1004> |
END (PASS) - Cookbook sre.hosts.provision (exit_code=0) for host wikikube-worker1286.mgmt.eqiad.wmnet with chassis set policy GRACEFUL_RESTART and with Dell SCP reboot policy GRACEFUL |
[production] |
| 08:58 |
<arnaudb@cumin1004> |
DONE (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 1:00:00 on gerrit[1003,2002-2003].wikimedia.org with reason: Hashar unblocking mediawiki train |
[production] |
| 08:52 |
<oblivian@cumin1004> |
START - Cookbook sre.hosts.provision for host wikikube-worker1286.mgmt.eqiad.wmnet with chassis set policy GRACEFUL_RESTART and with Dell SCP reboot policy GRACEFUL |
[production] |
| 08:52 |
<oblivian@cumin1004> |
END (PASS) - Cookbook sre.k8s.pool-depool-node (exit_code=0) depool for host wikikube-worker1286.eqiad.wmnet |
[production] |
| 08:51 |
<oblivian@cumin1004> |
START - Cookbook sre.k8s.pool-depool-node depool for host wikikube-worker1286.eqiad.wmnet |
[production] |
| 08:51 |
<oblivian@cumin1004> |
END (PASS) - Cookbook sre.k8s.pool-depool-node (exit_code=0) pool for host wikikube-worker1285.eqiad.wmnet |
[production] |
| 08:49 |
<oblivian@cumin1004> |
START - Cookbook sre.k8s.pool-depool-node pool for host wikikube-worker1285.eqiad.wmnet |
[production] |
| 08:49 |
<oblivian@cumin1004> |
END (PASS) - Cookbook sre.hosts.provision (exit_code=0) for host wikikube-worker1285.mgmt.eqiad.wmnet with chassis set policy GRACEFUL_RESTART and with Dell SCP reboot policy GRACEFUL |
[production] |
| 08:41 |
<cgoubert@deploy1003> |
helmfile [staging] DONE helmfile.d/services/lac-lambdas: apply |
[production] |
| 08:40 |
<cgoubert@deploy1003> |
helmfile [staging] START helmfile.d/services/lac-lambdas: apply |
[production] |
| 08:39 |
<oblivian@cumin1004> |
START - Cookbook sre.hosts.provision for host wikikube-worker1285.mgmt.eqiad.wmnet with chassis set policy GRACEFUL_RESTART and with Dell SCP reboot policy GRACEFUL |
[production] |
| 08:38 |
<oblivian@cumin1004> |
END (PASS) - Cookbook sre.k8s.pool-depool-node (exit_code=0) depool for host wikikube-worker1285.eqiad.wmnet |
[production] |
| 08:37 |
<oblivian@cumin1004> |
START - Cookbook sre.k8s.pool-depool-node depool for host wikikube-worker1285.eqiad.wmnet |
[production] |
| 08:37 |
<oblivian@cumin1004> |
END (PASS) - Cookbook sre.k8s.pool-depool-node (exit_code=0) pool for host wikikube-worker1284.eqiad.wmnet |
[production] |
| 08:37 |
<oblivian@cumin1004> |
START - Cookbook sre.k8s.pool-depool-node pool for host wikikube-worker1284.eqiad.wmnet |
[production] |
| 08:37 |
<oblivian@cumin1004> |
END (PASS) - Cookbook sre.hosts.provision (exit_code=0) for host wikikube-worker1284.mgmt.eqiad.wmnet with chassis set policy GRACEFUL_RESTART and with Dell SCP reboot policy GRACEFUL |
[production] |
| 08:36 |
<oblivian@cumin1004> |
END (PASS) - Cookbook sre.k8s.pool-depool-node (exit_code=0) depool for host wikikube-worker2252.codfw.wmnet |
[production] |
| 08:35 |
<oblivian@cumin1004> |
START - Cookbook sre.k8s.pool-depool-node depool for host wikikube-worker2252.codfw.wmnet |
[production] |
| 08:35 |
<oblivian@cumin1004> |
END (PASS) - Cookbook sre.k8s.pool-depool-node (exit_code=0) pool for host wikikube-worker2251.codfw.wmnet |
[production] |
| 08:34 |
<oblivian@cumin1004> |
START - Cookbook sre.k8s.pool-depool-node pool for host wikikube-worker2251.codfw.wmnet |
[production] |
| 08:34 |
<oblivian@cumin1004> |
END (PASS) - Cookbook sre.hosts.provision (exit_code=0) for host wikikube-worker2251.mgmt.codfw.wmnet with chassis set policy GRACEFUL_RESTART |
[production] |
| 08:32 |
<arnaudb> |
gerrit2002: the spare Gerrit is back on ldap-ro.codfw, restarted - T440888 |
[production] |
| 08:31 |
<arnaudb@cumin1004> |
END (PASS) - Cookbook sre.gerrit.restart-gerrit (exit_code=0) Restarting Gerrit on gerrit2002 |
[production] |
| 08:30 |
<arnaudb@cumin1004> |
START - Cookbook sre.gerrit.restart-gerrit Restarting Gerrit on gerrit2002 |
[production] |
| 08:28 |
<oblivian@cumin1004> |
START - Cookbook sre.hosts.provision for host wikikube-worker2251.mgmt.codfw.wmnet with chassis set policy GRACEFUL_RESTART |
[production] |
| 08:27 |
<oblivian@cumin1004> |
START - Cookbook sre.hosts.provision for host wikikube-worker1284.mgmt.eqiad.wmnet with chassis set policy GRACEFUL_RESTART and with Dell SCP reboot policy GRACEFUL |
[production] |
| 08:27 |
<oblivian@cumin1004> |
END (PASS) - Cookbook sre.k8s.pool-depool-node (exit_code=0) depool for host wikikube-worker1284.eqiad.wmnet |
[production] |
| 08:26 |
<oblivian@cumin1004> |
START - Cookbook sre.k8s.pool-depool-node depool for host wikikube-worker1284.eqiad.wmnet |
[production] |
| 08:26 |
<oblivian@cumin1004> |
END (PASS) - Cookbook sre.k8s.pool-depool-node (exit_code=0) pool for host wikikube-worker1283.eqiad.wmnet |
[production] |
| 08:26 |
<oblivian@cumin1004> |
START - Cookbook sre.k8s.pool-depool-node pool for host wikikube-worker1283.eqiad.wmnet |
[production] |
| 08:25 |
<oblivian@cumin1004> |
END (PASS) - Cookbook sre.hosts.provision (exit_code=0) for host wikikube-worker1283.mgmt.eqiad.wmnet with chassis set policy GRACEFUL_RESTART and with Dell SCP reboot policy GRACEFUL |
[production] |
| 08:25 |
<arnaudb@cumin1004> |
END (PASS) - Cookbook sre.gerrit.restart-gerrit (exit_code=0) Restarting Gerrit on gerrit2002 |
[production] |
| 08:23 |
<arnaudb@cumin1004> |
START - Cookbook sre.gerrit.restart-gerrit Restarting Gerrit on gerrit2002 |
[production] |
| 08:22 |
<arnaudb> |
gerrit2002: point the spare Gerrit at ldap-ro-test.codfw and restart it - T440888 |
[production] |
| 08:17 |
<oblivian@cumin1004> |
END (PASS) - Cookbook sre.k8s.pool-depool-node (exit_code=0) depool for host wikikube-worker2251.codfw.wmnet |
[production] |
| 08:16 |
<oblivian@cumin1004> |
START - Cookbook sre.k8s.pool-depool-node depool for host wikikube-worker2251.codfw.wmnet |
[production] |
| 08:16 |
<oblivian@cumin1004> |
END (PASS) - Cookbook sre.k8s.pool-depool-node (exit_code=0) pool for host wikikube-worker2250.codfw.wmnet |
[production] |
| 08:16 |
<oblivian@cumin1004> |
START - Cookbook sre.hosts.provision for host wikikube-worker1283.mgmt.eqiad.wmnet with chassis set policy GRACEFUL_RESTART and with Dell SCP reboot policy GRACEFUL |
[production] |
| 08:15 |
<oblivian@cumin1004> |
END (PASS) - Cookbook sre.k8s.pool-depool-node (exit_code=0) depool for host wikikube-worker1283.eqiad.wmnet |
[production] |
| 08:15 |
<oblivian@cumin1004> |
START - Cookbook sre.k8s.pool-depool-node pool for host wikikube-worker2250.codfw.wmnet |
[production] |