| 2024-09-25
      
      ยง | 
    
  | 07:55 | <dcausse@deploy1003> | helmfile [eqiad] DONE helmfile.d/services/rdf-streaming-updater: apply | [production] | 
            
  | 07:55 | <dcausse@deploy1003> | helmfile [eqiad] START helmfile.d/services/rdf-streaming-updater: apply | [production] | 
            
  | 07:51 | <dcausse@deploy1003> | helmfile [codfw] DONE helmfile.d/services/rdf-streaming-updater: apply | [production] | 
            
  | 07:51 | <dcausse@deploy1003> | helmfile [codfw] START helmfile.d/services/rdf-streaming-updater: apply | [production] | 
            
  | 07:47 | <dcausse@deploy1003> | helmfile [staging] DONE helmfile.d/services/rdf-streaming-updater: apply | [production] | 
            
  | 07:47 | <dcausse@deploy1003> | helmfile [staging] START helmfile.d/services/rdf-streaming-updater: apply | [production] | 
            
  | 07:46 | <wmbot~raymondndibe@wmf3402> | END (PASS) - Cookbook wmcs.toolforge.remove_k8s_node (exit_code=0) for host toolsbeta-test-k8s-worker-nfs-7 | [toolsbeta] | 
            
  | 07:42 | <kartik@deploy1003> | Finished scap sync-world: Backport for [[gerrit:1075501|Revert "Enable message group subscription feature for Test Wikipedia"]] (duration: 06m 48s) | [production] | 
            
  | 07:37 | <jmm@cumin2002> | END (PASS) - Cookbook sre.ldap.roll-restart-reboot-replica (exit_code=0) rolling restart_daemons on A:ldap-replicas-eqiad | [production] | 
            
  | 07:37 | <moritzm> | restarting slapd on r/w LDAP servers to pick up GNUTLS security updates | [production] | 
            
  | 07:37 | <kartik@deploy1003> | kartik, trainbranchbot: Continuing with sync | [production] | 
            
  | 07:37 | <kartik@deploy1003> | kartik, trainbranchbot: Backport for [[gerrit:1075501|Revert "Enable message group subscription feature for Test Wikipedia"]] synced to the testservers (https://wikitech.wikimedia.org/wiki/Mwdebug) | [production] | 
            
  | 07:36 | <jmm@cumin2002> | START - Cookbook sre.ldap.roll-restart-reboot-replica rolling restart_daemons on A:ldap-replicas-eqiad | [production] | 
            
  | 07:35 | <kartik@deploy1003> | Started scap sync-world: Backport for [[gerrit:1075501|Revert "Enable message group subscription feature for Test Wikipedia"]] | [production] | 
            
  | 07:34 | <jmm@cumin2002> | END (PASS) - Cookbook sre.ldap.roll-restart-reboot-replica (exit_code=0) rolling restart_daemons on A:ldap-replicas-codfw | [production] | 
            
  | 07:32 | <jmm@cumin2002> | START - Cookbook sre.ldap.roll-restart-reboot-replica rolling restart_daemons on A:ldap-replicas-codfw | [production] | 
            
  | 07:32 | <kartik@deploy1003> | Sync cancelled. | [production] | 
            
  | 07:32 | <wmbot~raymondndibe@wmf3402> | END (FAIL) - Cookbook wmcs.toolforge.remove_k8s_node (exit_code=99) for host toolsbeta-test-k8s-worker-nfs-7 | [toolsbeta] | 
            
  | 07:19 | <jmm@cumin2002> | END (PASS) - Cookbook sre.o11y.roll-restart-reboot-logstash-collectors (exit_code=0) rolling restart_daemons on A:logstash-collector | [production] | 
            
  | 07:15 | <wmbot~raymondndibe@wmf3402> | END (PASS) - Cookbook wmcs.toolforge.remove_k8s_node (exit_code=0) for host toolsbeta-test-k8s-worker-nfs-7 | [toolsbeta] | 
            
  | 07:06 | <kartik@deploy1003> | abi, kartik: Backport for [[gerrit:1072166|Enable message group subscription feature for Test Wikipedia (T372386)]] synced to the testservers (https://wikitech.wikimedia.org/wiki/Mwdebug) | [production] | 
            
  | 07:04 | <kartik@deploy1003> | Started scap sync-world: Backport for [[gerrit:1072166|Enable message group subscription feature for Test Wikipedia (T372386)]] | [production] | 
            
  | 07:02 | <wmbot~raymondndibe@wmf3402> | END (FAIL) - Cookbook wmcs.toolforge.remove_k8s_node (exit_code=99) for host toolsbeta-test-k8s-worker-nfs-7 | [toolsbeta] | 
            
  | 07:02 | <jmm@cumin2002> | START - Cookbook sre.o11y.roll-restart-reboot-logstash-collectors rolling restart_daemons on A:logstash-collector | [production] | 
            
  | 06:55 | <wmbot~raymondndibe@wmf3402> | END (FAIL) - Cookbook wmcs.toolforge.remove_k8s_node (exit_code=99) for host toolsbeta-test-k8s-worker-nfs-7 | [toolsbeta] | 
            
  | 06:51 | <moritzm> | installing gnutls security updates on bullseye/bookworm | [production] | 
            
  | 06:48 | <wmbot~raymondndibe@wmf3402> | END (FAIL) - Cookbook wmcs.toolforge.remove_k8s_node (exit_code=99) for host toolsbeta-test-k8s-worker-nfs-7 | [toolsbeta] | 
            
  | 06:33 | <wmbot~raymondndibe@wmf3402> | START - Cookbook wmcs.toolforge.remove_k8s_node for host toolsbeta-test-k8s-worker-nfs-7 | [toolsbeta] | 
            
  | 06:32 | <wmbot~raymondndibe@wmf3402> | END (FAIL) - Cookbook wmcs.toolforge.remove_k8s_node (exit_code=99) for host toolsbeta-test-k8s-worker-nfs-7 | [toolsbeta] | 
            
  | 06:25 | <wmbot~raymondndibe@wmf3402> | START - Cookbook wmcs.toolforge.remove_k8s_node for host toolsbeta-test-k8s-worker-nfs-7 | [toolsbeta] | 
            
  | 06:23 | <wmbot~raymondndibe@wmf3402> | END (FAIL) - Cookbook wmcs.toolforge.remove_k8s_node (exit_code=99) for host toolsbeta-test-k8s-worker-nfs-7 | [toolsbeta] | 
            
  | 06:16 | <wmbot~raymondndibe@wmf3402> | START - Cookbook wmcs.toolforge.remove_k8s_node for host toolsbeta-test-k8s-worker-nfs-7 | [toolsbeta] | 
            
  | 06:06 | <wmbot~raymondndibe@wmf3402> | END (FAIL) - Cookbook wmcs.toolforge.remove_k8s_node (exit_code=99) for host toolsbeta-test-k8s-worker-nfs-7 | [toolsbeta] | 
            
  | 05:59 | <wmbot~raymondndibe@wmf3402> | START - Cookbook wmcs.toolforge.remove_k8s_node for host toolsbeta-test-k8s-worker-nfs-7 | [toolsbeta] | 
            
  | 05:50 | <wmbot~raymondndibe@wmf3402> | END (FAIL) - Cookbook wmcs.toolforge.remove_k8s_node (exit_code=99) for host toolsbeta-test-k8s-worker-nfs-7 | [toolsbeta] | 
            
  | 05:49 | <wmbot~raymondndibe@wmf3402> | START - Cookbook wmcs.toolforge.remove_k8s_node for host toolsbeta-test-k8s-worker-nfs-7 | [toolsbeta] | 
            
  | 05:48 | <raymond-ndibe@cloudcumin1001> | END (PASS) - Cookbook wmcs.toolforge.add_k8s_node (exit_code=0) for a worker-nfs role in the toolsbeta cluster | [toolsbeta] | 
            
  | 05:48 | <raymond-ndibe@cloudcumin1001> | Added a new k8s worker-nfs toolsbeta-test-k8s-worker-nfs-10.toolsbeta.eqiad1.wikimedia.cloud to the cluster | [toolsbeta] | 
            
  | 05:38 | <raymond-ndibe@cloudcumin1001> | START - Cookbook wmcs.toolforge.add_k8s_node for a worker-nfs role in the toolsbeta cluster | [toolsbeta] | 
            
  | 05:38 | <raymond-ndibe@cloudcumin1001> | END (FAIL) - Cookbook wmcs.toolforge.remove_k8s_node (exit_code=99) for host toolsbeta-test-k8s-worker-nfs-10 | [toolsbeta] | 
            
  | 05:38 | <raymond-ndibe@cloudcumin1001> | START - Cookbook wmcs.toolforge.remove_k8s_node for host toolsbeta-test-k8s-worker-nfs-10 | [toolsbeta] | 
            
  | 05:37 | <raymond-ndibe@cloudcumin1001> | END (FAIL) - Cookbook wmcs.toolforge.remove_k8s_node (exit_code=99) for host toolsbeta-test-k8s-worker-nfs-10 | [toolsbeta] | 
            
  | 05:37 | <raymond-ndibe@cloudcumin1001> | START - Cookbook wmcs.toolforge.remove_k8s_node for host toolsbeta-test-k8s-worker-nfs-10 | [toolsbeta] | 
            
  | 05:33 | <raymond-ndibe@cloudcumin1001> | END (FAIL) - Cookbook wmcs.toolforge.add_k8s_node (exit_code=99) for a worker-nfs role in the toolsbeta cluster | [toolsbeta] | 
            
  | 05:32 | <raymond-ndibe@cloudcumin1001> | START - Cookbook wmcs.toolforge.add_k8s_node for a worker-nfs role in the toolsbeta cluster | [toolsbeta] | 
            
  | 05:32 | <raymond-ndibe@cloudcumin1001> | END (ERROR) - Cookbook wmcs.toolforge.add_k8s_node (exit_code=97) for a worker-nfs role in the toolsbeta cluster | [toolsbeta] | 
            
  | 05:29 | <raymond-ndibe@cloudcumin1001> | START - Cookbook wmcs.toolforge.add_k8s_node for a worker-nfs role in the toolsbeta cluster | [toolsbeta] | 
            
  | 05:18 | <wmbot~raymondndibe@wmf3402> | END (FAIL) - Cookbook wmcs.toolforge.remove_k8s_node (exit_code=99) for host toolsbeta-test-k8s-worker-nfs-7 | [toolsbeta] | 
            
  | 05:17 | <wmbot~raymondndibe@wmf3402> | START - Cookbook wmcs.toolforge.remove_k8s_node for host toolsbeta-test-k8s-worker-nfs-7 | [toolsbeta] | 
            
  | 05:16 | <wmbot~raymondndibe@wmf3402> | END (FAIL) - Cookbook wmcs.toolforge.remove_k8s_node (exit_code=99) for host toolsbeta-test-k8s-worker-nfs-7 | [toolsbeta] |