| 2025-09-25
      
      ยง | 
    
  | 09:38 | <elukey@deploy1003> | helmfile [staging-codfw] DONE helmfile.d/admin 'sync'. | [production] | 
            
  | 09:38 | <elukey@deploy1003> | helmfile [staging-codfw] START helmfile.d/admin 'sync'. | [production] | 
            
  | 09:29 | <dcaro@cloudcumin1001> | END (PASS) - Cookbook wmcs.toolforge.component.deploy (exit_code=0) for component jobs-api | [tools] | 
            
  | 09:29 | <elukey@deploy1003> | helmfile [staging] START helmfile.d/services/tegola-vector-tiles: sync | [production] | 
            
  | 09:25 | <jmm@cumin2002> | END (PASS) - Cookbook sre.ganeti.drain-node (exit_code=0) for draining ganeti node ganeti1035.eqiad.wmnet | [production] | 
            
  | 09:25 | <jmm@cumin2002> | END (PASS) - Cookbook sre.hosts.reboot-single (exit_code=0) for host ganeti1035.eqiad.wmnet | [production] | 
            
  | 09:18 | <elukey@deploy1003> | helmfile [codfw] DONE helmfile.d/admin 'sync'. | [production] | 
            
  | 09:18 | <elukey@deploy1003> | helmfile [codfw] START helmfile.d/admin 'sync'. | [production] | 
            
  | 09:17 | <jmm@cumin2002> | START - Cookbook sre.hosts.reboot-single for host ganeti1035.eqiad.wmnet | [production] | 
            
  | 09:14 | <dcaro@cloudcumin1001> | START - Cookbook wmcs.toolforge.component.deploy for component jobs-api | [tools] | 
            
  | 09:13 | <jmm@cumin2002> | START - Cookbook sre.ganeti.drain-node for draining ganeti node ganeti1035.eqiad.wmnet | [production] | 
            
  | 09:12 | <jmm@cumin2002> | END (PASS) - Cookbook sre.ganeti.drain-node (exit_code=0) for draining ganeti node ganeti1034.eqiad.wmnet | [production] | 
            
  | 09:12 | <jmm@cumin2002> | END (PASS) - Cookbook sre.hosts.reboot-single (exit_code=0) for host ganeti1034.eqiad.wmnet | [production] | 
            
  | 09:06 | <jmm@cumin2002> | START - Cookbook sre.hosts.reboot-single for host ganeti1034.eqiad.wmnet | [production] | 
            
  | 08:59 | <jmm@cumin2002> | START - Cookbook sre.ganeti.drain-node for draining ganeti node ganeti1034.eqiad.wmnet | [production] | 
            
  | 08:57 | <jmm@cumin2002> | END (PASS) - Cookbook sre.ganeti.drain-node (exit_code=0) for draining ganeti node ganeti1033.eqiad.wmnet | [production] | 
            
  | 08:57 | <jmm@cumin2002> | END (PASS) - Cookbook sre.hosts.reboot-single (exit_code=0) for host ganeti1033.eqiad.wmnet | [production] | 
            
  | 08:54 | <dcaro@cloudcumin1001> | END (PASS) - Cookbook wmcs.toolforge.component.deploy (exit_code=0) for component jobs-api | [toolsbeta] | 
            
  | 08:51 | <jmm@cumin2002> | START - Cookbook sre.hosts.reboot-single for host ganeti1033.eqiad.wmnet | [production] | 
            
  | 08:49 | <jmm@cumin2002> | START - Cookbook sre.ganeti.drain-node for draining ganeti node ganeti1033.eqiad.wmnet | [production] | 
            
  | 08:49 | <jmm@cumin2002> | END (PASS) - Cookbook sre.ganeti.drain-node (exit_code=0) for draining ganeti node ganeti1032.eqiad.wmnet | [production] | 
            
  | 08:48 | <jmm@cumin2002> | END (PASS) - Cookbook sre.hosts.reboot-single (exit_code=0) for host ganeti1032.eqiad.wmnet | [production] | 
            
  | 08:42 | <jmm@cumin2002> | START - Cookbook sre.hosts.reboot-single for host ganeti1032.eqiad.wmnet | [production] | 
            
  | 08:41 | <godog> | test reboot of toolsbeta-nfs-4 | [toolsbeta] | 
            
  | 08:41 | <dcaro@cloudcumin1001> | START - Cookbook wmcs.toolforge.component.deploy for component jobs-api | [toolsbeta] | 
            
  | 08:39 | <jmm@cumin2002> | START - Cookbook sre.ganeti.drain-node for draining ganeti node ganeti1032.eqiad.wmnet | [production] | 
            
  | 08:36 | <jmm@cumin2002> | END (PASS) - Cookbook sre.ganeti.drain-node (exit_code=0) for draining ganeti node ganeti1031.eqiad.wmnet | [production] | 
            
  | 08:36 | <jmm@cumin2002> | END (PASS) - Cookbook sre.hosts.reboot-single (exit_code=0) for host ganeti1031.eqiad.wmnet | [production] | 
            
  | 08:34 | <jforrester@deploy1003> | Finished scap sync-world: Backport for [[gerrit:1184797|Stop loading the Graph extension anywhere (T362317)]] (duration: 39m 14s) | [production] | 
            
  | 08:30 | <jmm@cumin2002> | START - Cookbook sre.hosts.reboot-single for host ganeti1031.eqiad.wmnet | [production] | 
            
  | 08:26 | <jmm@cumin2002> | START - Cookbook sre.ganeti.drain-node for draining ganeti node ganeti1031.eqiad.wmnet | [production] | 
            
  | 08:25 | <jmm@cumin2002> | END (FAIL) - Cookbook sre.ganeti.drain-node (exit_code=99) for draining ganeti node ganeti1030.eqiad.wmnet | [production] | 
            
  | 08:24 | <jmm@cumin2002> | START - Cookbook sre.ganeti.drain-node for draining ganeti node ganeti1030.eqiad.wmnet | [production] | 
            
  | 08:24 | <jmm@cumin2002> | END (FAIL) - Cookbook sre.ganeti.drain-node (exit_code=99) for draining ganeti node ganeti1030.eqiad.wmnet | [production] | 
            
  | 08:22 | <jmm@cumin2002> | START - Cookbook sre.ganeti.drain-node for draining ganeti node ganeti1030.eqiad.wmnet | [production] | 
            
  | 08:22 | <jforrester@deploy1003> | jforrester: Continuing with sync | [production] | 
            
  | 08:21 | <jforrester@deploy1003> | jforrester: Backport for [[gerrit:1184797|Stop loading the Graph extension anywhere (T362317)]] synced to the testservers (see https://wikitech.wikimedia.org/wiki/Mwdebug). Changes can now be verified there. | [production] | 
            
  | 08:20 | <jmm@cumin2002> | END (PASS) - Cookbook sre.ganeti.drain-node (exit_code=0) for draining ganeti node ganeti1029.eqiad.wmnet | [production] | 
            
  | 08:20 | <jmm@cumin2002> | END (PASS) - Cookbook sre.hosts.reboot-single (exit_code=0) for host ganeti1029.eqiad.wmnet | [production] | 
            
  | 08:14 | <jmm@cumin2002> | START - Cookbook sre.hosts.reboot-single for host ganeti1029.eqiad.wmnet | [production] | 
            
  | 08:01 | <jmm@cumin2002> | START - Cookbook sre.ganeti.drain-node for draining ganeti node ganeti1029.eqiad.wmnet | [production] | 
            
  | 08:01 | <jmm@cumin2002> | END (PASS) - Cookbook sre.ganeti.drain-node (exit_code=0) for draining ganeti node ganeti1028.eqiad.wmnet | [production] | 
            
  | 08:01 | <jmm@cumin2002> | END (PASS) - Cookbook sre.hosts.reboot-single (exit_code=0) for host ganeti1028.eqiad.wmnet | [production] | 
            
  | 07:58 | <kart_> | staging: Updated cxserver to 2025-09-25-074241-production (T394982) | [production] | 
            
  | 07:57 | <James_F> | Zuul: [mediawiki/extensions/Graph] Drop from production listing, for T362317 | [releng] | 
            
  | 07:56 | <brouberol@deploy1003> | helmfile [codfw] DONE helmfile.d/services/eventstreams-internal: apply | [production] | 
            
  | 07:56 | <kartik@deploy1003> | helmfile [staging] DONE helmfile.d/services/cxserver: apply | [production] | 
            
  | 07:56 | <kartik@deploy1003> | helmfile [staging] START helmfile.d/services/cxserver: apply | [production] | 
            
  | 07:55 | <brouberol@deploy1003> | helmfile [codfw] START helmfile.d/services/eventstreams-internal: apply | [production] | 
            
  | 07:55 | <jforrester@deploy1003> | Started scap sync-world: Backport for [[gerrit:1184797|Stop loading the Graph extension anywhere (T362317)]] | [production] |