|
2024-09-25
ยง
|
| 08:27 |
<jmm@cumin2002> |
START - Cookbook sre.idm.logout Logging DNdubane out of all services on: 1540 hosts |
[production] |
| 08:26 |
<wmbot~raymondndibe@wmf3402> |
END (PASS) - Cookbook wmcs.toolforge.component.deploy (exit_code=0) for component maintain-kubeusers |
[toolsbeta] |
| 08:24 |
<wmbot~raymondndibe@wmf3402> |
START - Cookbook wmcs.toolforge.component.deploy for component maintain-kubeusers |
[toolsbeta] |
| 08:06 |
<elukey> |
set max-catalog-entries (changes the default catalog pagination) to 50 for docker-registry - T348876 |
[production] |
| 08:06 |
<hashar@deploy1003> |
Finished deploy [integration/docroot@0482d53]: zuul: show change queues window value (duration: 00m 07s) |
[production] |
| 08:06 |
<hashar@deploy1003> |
Started deploy [integration/docroot@0482d53]: zuul: show change queues window value |
[production] |
| 08:00 |
<wmbot~dcaro@urcuchillay> |
END (PASS) - Cookbook wmcs.toolforge.k8s.reboot (exit_code=0) for tools-k8s-worker-nfs-7 |
[tools] |
| 07:59 |
<wmbot~dcaro@urcuchillay> |
START - Cookbook wmcs.toolforge.k8s.reboot for tools-k8s-worker-nfs-7 |
[tools] |
| 07:58 |
<jynus> |
running REPLACE into dtpwiki db2123 (s5) T375507 |
[production] |
| 07:55 |
<dcausse@deploy1003> |
helmfile [eqiad] DONE helmfile.d/services/rdf-streaming-updater: apply |
[production] |
| 07:55 |
<dcausse@deploy1003> |
helmfile [eqiad] START helmfile.d/services/rdf-streaming-updater: apply |
[production] |
| 07:51 |
<dcausse@deploy1003> |
helmfile [codfw] DONE helmfile.d/services/rdf-streaming-updater: apply |
[production] |
| 07:51 |
<dcausse@deploy1003> |
helmfile [codfw] START helmfile.d/services/rdf-streaming-updater: apply |
[production] |
| 07:47 |
<dcausse@deploy1003> |
helmfile [staging] DONE helmfile.d/services/rdf-streaming-updater: apply |
[production] |
| 07:47 |
<dcausse@deploy1003> |
helmfile [staging] START helmfile.d/services/rdf-streaming-updater: apply |
[production] |
| 07:46 |
<wmbot~raymondndibe@wmf3402> |
END (PASS) - Cookbook wmcs.toolforge.remove_k8s_node (exit_code=0) for host toolsbeta-test-k8s-worker-nfs-7 |
[toolsbeta] |
| 07:42 |
<kartik@deploy1003> |
Finished scap sync-world: Backport for [[gerrit:1075501|Revert "Enable message group subscription feature for Test Wikipedia"]] (duration: 06m 48s) |
[production] |
| 07:37 |
<jmm@cumin2002> |
END (PASS) - Cookbook sre.ldap.roll-restart-reboot-replica (exit_code=0) rolling restart_daemons on A:ldap-replicas-eqiad |
[production] |
| 07:37 |
<moritzm> |
restarting slapd on r/w LDAP servers to pick up GNUTLS security updates |
[production] |
| 07:37 |
<kartik@deploy1003> |
kartik, trainbranchbot: Continuing with sync |
[production] |
| 07:37 |
<kartik@deploy1003> |
kartik, trainbranchbot: Backport for [[gerrit:1075501|Revert "Enable message group subscription feature for Test Wikipedia"]] synced to the testservers (https://wikitech.wikimedia.org/wiki/Mwdebug) |
[production] |
| 07:36 |
<jmm@cumin2002> |
START - Cookbook sre.ldap.roll-restart-reboot-replica rolling restart_daemons on A:ldap-replicas-eqiad |
[production] |
| 07:35 |
<kartik@deploy1003> |
Started scap sync-world: Backport for [[gerrit:1075501|Revert "Enable message group subscription feature for Test Wikipedia"]] |
[production] |
| 07:34 |
<jmm@cumin2002> |
END (PASS) - Cookbook sre.ldap.roll-restart-reboot-replica (exit_code=0) rolling restart_daemons on A:ldap-replicas-codfw |
[production] |
| 07:32 |
<jmm@cumin2002> |
START - Cookbook sre.ldap.roll-restart-reboot-replica rolling restart_daemons on A:ldap-replicas-codfw |
[production] |
| 07:32 |
<kartik@deploy1003> |
Sync cancelled. |
[production] |
| 07:32 |
<wmbot~raymondndibe@wmf3402> |
END (FAIL) - Cookbook wmcs.toolforge.remove_k8s_node (exit_code=99) for host toolsbeta-test-k8s-worker-nfs-7 |
[toolsbeta] |
| 07:19 |
<jmm@cumin2002> |
END (PASS) - Cookbook sre.o11y.roll-restart-reboot-logstash-collectors (exit_code=0) rolling restart_daemons on A:logstash-collector |
[production] |
| 07:15 |
<wmbot~raymondndibe@wmf3402> |
END (PASS) - Cookbook wmcs.toolforge.remove_k8s_node (exit_code=0) for host toolsbeta-test-k8s-worker-nfs-7 |
[toolsbeta] |
| 07:06 |
<kartik@deploy1003> |
abi, kartik: Backport for [[gerrit:1072166|Enable message group subscription feature for Test Wikipedia (T372386)]] synced to the testservers (https://wikitech.wikimedia.org/wiki/Mwdebug) |
[production] |
| 07:04 |
<kartik@deploy1003> |
Started scap sync-world: Backport for [[gerrit:1072166|Enable message group subscription feature for Test Wikipedia (T372386)]] |
[production] |
| 07:02 |
<wmbot~raymondndibe@wmf3402> |
END (FAIL) - Cookbook wmcs.toolforge.remove_k8s_node (exit_code=99) for host toolsbeta-test-k8s-worker-nfs-7 |
[toolsbeta] |
| 07:02 |
<jmm@cumin2002> |
START - Cookbook sre.o11y.roll-restart-reboot-logstash-collectors rolling restart_daemons on A:logstash-collector |
[production] |
| 06:55 |
<wmbot~raymondndibe@wmf3402> |
END (FAIL) - Cookbook wmcs.toolforge.remove_k8s_node (exit_code=99) for host toolsbeta-test-k8s-worker-nfs-7 |
[toolsbeta] |
| 06:51 |
<moritzm> |
installing gnutls security updates on bullseye/bookworm |
[production] |
| 06:48 |
<wmbot~raymondndibe@wmf3402> |
END (FAIL) - Cookbook wmcs.toolforge.remove_k8s_node (exit_code=99) for host toolsbeta-test-k8s-worker-nfs-7 |
[toolsbeta] |
| 06:33 |
<wmbot~raymondndibe@wmf3402> |
START - Cookbook wmcs.toolforge.remove_k8s_node for host toolsbeta-test-k8s-worker-nfs-7 |
[toolsbeta] |
| 06:32 |
<wmbot~raymondndibe@wmf3402> |
END (FAIL) - Cookbook wmcs.toolforge.remove_k8s_node (exit_code=99) for host toolsbeta-test-k8s-worker-nfs-7 |
[toolsbeta] |
| 06:25 |
<wmbot~raymondndibe@wmf3402> |
START - Cookbook wmcs.toolforge.remove_k8s_node for host toolsbeta-test-k8s-worker-nfs-7 |
[toolsbeta] |
| 06:23 |
<wmbot~raymondndibe@wmf3402> |
END (FAIL) - Cookbook wmcs.toolforge.remove_k8s_node (exit_code=99) for host toolsbeta-test-k8s-worker-nfs-7 |
[toolsbeta] |
| 06:16 |
<wmbot~raymondndibe@wmf3402> |
START - Cookbook wmcs.toolforge.remove_k8s_node for host toolsbeta-test-k8s-worker-nfs-7 |
[toolsbeta] |
| 06:06 |
<wmbot~raymondndibe@wmf3402> |
END (FAIL) - Cookbook wmcs.toolforge.remove_k8s_node (exit_code=99) for host toolsbeta-test-k8s-worker-nfs-7 |
[toolsbeta] |
| 05:59 |
<wmbot~raymondndibe@wmf3402> |
START - Cookbook wmcs.toolforge.remove_k8s_node for host toolsbeta-test-k8s-worker-nfs-7 |
[toolsbeta] |
| 05:50 |
<wmbot~raymondndibe@wmf3402> |
END (FAIL) - Cookbook wmcs.toolforge.remove_k8s_node (exit_code=99) for host toolsbeta-test-k8s-worker-nfs-7 |
[toolsbeta] |
| 05:49 |
<wmbot~raymondndibe@wmf3402> |
START - Cookbook wmcs.toolforge.remove_k8s_node for host toolsbeta-test-k8s-worker-nfs-7 |
[toolsbeta] |
| 05:48 |
<raymond-ndibe@cloudcumin1001> |
END (PASS) - Cookbook wmcs.toolforge.add_k8s_node (exit_code=0) for a worker-nfs role in the toolsbeta cluster |
[toolsbeta] |
| 05:48 |
<raymond-ndibe@cloudcumin1001> |
Added a new k8s worker-nfs toolsbeta-test-k8s-worker-nfs-10.toolsbeta.eqiad1.wikimedia.cloud to the cluster |
[toolsbeta] |
| 05:38 |
<raymond-ndibe@cloudcumin1001> |
START - Cookbook wmcs.toolforge.add_k8s_node for a worker-nfs role in the toolsbeta cluster |
[toolsbeta] |
| 05:38 |
<raymond-ndibe@cloudcumin1001> |
END (FAIL) - Cookbook wmcs.toolforge.remove_k8s_node (exit_code=99) for host toolsbeta-test-k8s-worker-nfs-10 |
[toolsbeta] |
| 05:38 |
<raymond-ndibe@cloudcumin1001> |
START - Cookbook wmcs.toolforge.remove_k8s_node for host toolsbeta-test-k8s-worker-nfs-10 |
[toolsbeta] |