2151-2200 of 10000 results (28ms)
2024-09-25 ยง
07:51 <dcausse@deploy1003> helmfile [codfw] START helmfile.d/services/rdf-streaming-updater: apply [production]
07:47 <dcausse@deploy1003> helmfile [staging] DONE helmfile.d/services/rdf-streaming-updater: apply [production]
07:47 <dcausse@deploy1003> helmfile [staging] START helmfile.d/services/rdf-streaming-updater: apply [production]
07:46 <wmbot~raymondndibe@wmf3402> END (PASS) - Cookbook wmcs.toolforge.remove_k8s_node (exit_code=0) for host toolsbeta-test-k8s-worker-nfs-7 [toolsbeta]
07:42 <kartik@deploy1003> Finished scap sync-world: Backport for [[gerrit:1075501|Revert "Enable message group subscription feature for Test Wikipedia"]] (duration: 06m 48s) [production]
07:37 <jmm@cumin2002> END (PASS) - Cookbook sre.ldap.roll-restart-reboot-replica (exit_code=0) rolling restart_daemons on A:ldap-replicas-eqiad [production]
07:37 <moritzm> restarting slapd on r/w LDAP servers to pick up GNUTLS security updates [production]
07:37 <kartik@deploy1003> kartik, trainbranchbot: Continuing with sync [production]
07:37 <kartik@deploy1003> kartik, trainbranchbot: Backport for [[gerrit:1075501|Revert "Enable message group subscription feature for Test Wikipedia"]] synced to the testservers (https://wikitech.wikimedia.org/wiki/Mwdebug) [production]
07:36 <jmm@cumin2002> START - Cookbook sre.ldap.roll-restart-reboot-replica rolling restart_daemons on A:ldap-replicas-eqiad [production]
07:35 <kartik@deploy1003> Started scap sync-world: Backport for [[gerrit:1075501|Revert "Enable message group subscription feature for Test Wikipedia"]] [production]
07:34 <jmm@cumin2002> END (PASS) - Cookbook sre.ldap.roll-restart-reboot-replica (exit_code=0) rolling restart_daemons on A:ldap-replicas-codfw [production]
07:32 <jmm@cumin2002> START - Cookbook sre.ldap.roll-restart-reboot-replica rolling restart_daemons on A:ldap-replicas-codfw [production]
07:32 <kartik@deploy1003> Sync cancelled. [production]
07:32 <wmbot~raymondndibe@wmf3402> END (FAIL) - Cookbook wmcs.toolforge.remove_k8s_node (exit_code=99) for host toolsbeta-test-k8s-worker-nfs-7 [toolsbeta]
07:19 <jmm@cumin2002> END (PASS) - Cookbook sre.o11y.roll-restart-reboot-logstash-collectors (exit_code=0) rolling restart_daemons on A:logstash-collector [production]
07:15 <wmbot~raymondndibe@wmf3402> END (PASS) - Cookbook wmcs.toolforge.remove_k8s_node (exit_code=0) for host toolsbeta-test-k8s-worker-nfs-7 [toolsbeta]
07:06 <kartik@deploy1003> abi, kartik: Backport for [[gerrit:1072166|Enable message group subscription feature for Test Wikipedia (T372386)]] synced to the testservers (https://wikitech.wikimedia.org/wiki/Mwdebug) [production]
07:04 <kartik@deploy1003> Started scap sync-world: Backport for [[gerrit:1072166|Enable message group subscription feature for Test Wikipedia (T372386)]] [production]
07:02 <wmbot~raymondndibe@wmf3402> END (FAIL) - Cookbook wmcs.toolforge.remove_k8s_node (exit_code=99) for host toolsbeta-test-k8s-worker-nfs-7 [toolsbeta]
07:02 <jmm@cumin2002> START - Cookbook sre.o11y.roll-restart-reboot-logstash-collectors rolling restart_daemons on A:logstash-collector [production]
06:55 <wmbot~raymondndibe@wmf3402> END (FAIL) - Cookbook wmcs.toolforge.remove_k8s_node (exit_code=99) for host toolsbeta-test-k8s-worker-nfs-7 [toolsbeta]
06:51 <moritzm> installing gnutls security updates on bullseye/bookworm [production]
06:48 <wmbot~raymondndibe@wmf3402> END (FAIL) - Cookbook wmcs.toolforge.remove_k8s_node (exit_code=99) for host toolsbeta-test-k8s-worker-nfs-7 [toolsbeta]
06:33 <wmbot~raymondndibe@wmf3402> START - Cookbook wmcs.toolforge.remove_k8s_node for host toolsbeta-test-k8s-worker-nfs-7 [toolsbeta]
06:32 <wmbot~raymondndibe@wmf3402> END (FAIL) - Cookbook wmcs.toolforge.remove_k8s_node (exit_code=99) for host toolsbeta-test-k8s-worker-nfs-7 [toolsbeta]
06:25 <wmbot~raymondndibe@wmf3402> START - Cookbook wmcs.toolforge.remove_k8s_node for host toolsbeta-test-k8s-worker-nfs-7 [toolsbeta]
06:23 <wmbot~raymondndibe@wmf3402> END (FAIL) - Cookbook wmcs.toolforge.remove_k8s_node (exit_code=99) for host toolsbeta-test-k8s-worker-nfs-7 [toolsbeta]
06:16 <wmbot~raymondndibe@wmf3402> START - Cookbook wmcs.toolforge.remove_k8s_node for host toolsbeta-test-k8s-worker-nfs-7 [toolsbeta]
06:06 <wmbot~raymondndibe@wmf3402> END (FAIL) - Cookbook wmcs.toolforge.remove_k8s_node (exit_code=99) for host toolsbeta-test-k8s-worker-nfs-7 [toolsbeta]
05:59 <wmbot~raymondndibe@wmf3402> START - Cookbook wmcs.toolforge.remove_k8s_node for host toolsbeta-test-k8s-worker-nfs-7 [toolsbeta]
05:50 <wmbot~raymondndibe@wmf3402> END (FAIL) - Cookbook wmcs.toolforge.remove_k8s_node (exit_code=99) for host toolsbeta-test-k8s-worker-nfs-7 [toolsbeta]
05:49 <wmbot~raymondndibe@wmf3402> START - Cookbook wmcs.toolforge.remove_k8s_node for host toolsbeta-test-k8s-worker-nfs-7 [toolsbeta]
05:48 <raymond-ndibe@cloudcumin1001> END (PASS) - Cookbook wmcs.toolforge.add_k8s_node (exit_code=0) for a worker-nfs role in the toolsbeta cluster [toolsbeta]
05:48 <raymond-ndibe@cloudcumin1001> Added a new k8s worker-nfs toolsbeta-test-k8s-worker-nfs-10.toolsbeta.eqiad1.wikimedia.cloud to the cluster [toolsbeta]
05:38 <raymond-ndibe@cloudcumin1001> START - Cookbook wmcs.toolforge.add_k8s_node for a worker-nfs role in the toolsbeta cluster [toolsbeta]
05:38 <raymond-ndibe@cloudcumin1001> END (FAIL) - Cookbook wmcs.toolforge.remove_k8s_node (exit_code=99) for host toolsbeta-test-k8s-worker-nfs-10 [toolsbeta]
05:38 <raymond-ndibe@cloudcumin1001> START - Cookbook wmcs.toolforge.remove_k8s_node for host toolsbeta-test-k8s-worker-nfs-10 [toolsbeta]
05:37 <raymond-ndibe@cloudcumin1001> END (FAIL) - Cookbook wmcs.toolforge.remove_k8s_node (exit_code=99) for host toolsbeta-test-k8s-worker-nfs-10 [toolsbeta]
05:37 <raymond-ndibe@cloudcumin1001> START - Cookbook wmcs.toolforge.remove_k8s_node for host toolsbeta-test-k8s-worker-nfs-10 [toolsbeta]
05:33 <raymond-ndibe@cloudcumin1001> END (FAIL) - Cookbook wmcs.toolforge.add_k8s_node (exit_code=99) for a worker-nfs role in the toolsbeta cluster [toolsbeta]
05:32 <raymond-ndibe@cloudcumin1001> START - Cookbook wmcs.toolforge.add_k8s_node for a worker-nfs role in the toolsbeta cluster [toolsbeta]
05:32 <raymond-ndibe@cloudcumin1001> END (ERROR) - Cookbook wmcs.toolforge.add_k8s_node (exit_code=97) for a worker-nfs role in the toolsbeta cluster [toolsbeta]
05:29 <raymond-ndibe@cloudcumin1001> START - Cookbook wmcs.toolforge.add_k8s_node for a worker-nfs role in the toolsbeta cluster [toolsbeta]
05:18 <wmbot~raymondndibe@wmf3402> END (FAIL) - Cookbook wmcs.toolforge.remove_k8s_node (exit_code=99) for host toolsbeta-test-k8s-worker-nfs-7 [toolsbeta]
05:17 <wmbot~raymondndibe@wmf3402> START - Cookbook wmcs.toolforge.remove_k8s_node for host toolsbeta-test-k8s-worker-nfs-7 [toolsbeta]
05:16 <wmbot~raymondndibe@wmf3402> END (FAIL) - Cookbook wmcs.toolforge.remove_k8s_node (exit_code=99) for host toolsbeta-test-k8s-worker-nfs-7 [toolsbeta]
05:15 <wmbot~raymondndibe@wmf3402> START - Cookbook wmcs.toolforge.remove_k8s_node for host toolsbeta-test-k8s-worker-nfs-7 [toolsbeta]
04:42 <wmbot~raymondndibe@wmf3402> END (PASS) - Cookbook wmcs.toolforge.component.deploy (exit_code=0) for component maintain-kubeusers [toolsbeta]
04:40 <wmbot~raymondndibe@wmf3402> START - Cookbook wmcs.toolforge.component.deploy for component maintain-kubeusers [toolsbeta]