| 
      
        2025-09-25
      
      ยง
     | 
  
    
  | 13:07 | 
  <dreamyjazz@deploy1003> | 
  dreamyjazz: Backport for [[gerrit:1191312|CheckUser: Enable SI special page on enwiki and frwiki (T405556)]] synced to the testservers (see https://wikitech.wikimedia.org/wiki/Mwdebug). Changes can now be verified there. | 
  [production] | 
            
  | 13:02 | 
  <jmm@cumin2002> | 
  START - Cookbook sre.hosts.reboot-single for host ganeti1039.eqiad.wmnet | 
  [production] | 
            
  | 13:00 | 
  <dreamyjazz@deploy1003> | 
  Started scap sync-world: Backport for [[gerrit:1191312|CheckUser: Enable SI special page on enwiki and frwiki (T405556)]] | 
  [production] | 
            
  | 12:55 | 
  <jmm@cumin2002> | 
  START - Cookbook sre.ganeti.drain-node for draining ganeti node ganeti1039.eqiad.wmnet | 
  [production] | 
            
  | 12:54 | 
  <elukey@cumin1003> | 
  DONE (FAIL) - Cookbook sre.puppet.renew-cert (exit_code=99) for puppetserver1001.eqiad.wmnet: Renew puppet certificate - elukey@cumin1003 | 
  [production] | 
            
  | 12:53 | 
  <jmm@cumin2002> | 
  END (PASS) - Cookbook sre.ganeti.drain-node (exit_code=0) for draining ganeti node ganeti1038.eqiad.wmnet | 
  [production] | 
            
  | 12:53 | 
  <jmm@cumin2002> | 
  END (PASS) - Cookbook sre.hosts.reboot-single (exit_code=0) for host ganeti1038.eqiad.wmnet | 
  [production] | 
            
  | 12:49 | 
  <jynus> | 
  swap read only for db1176/db2230 (test-s4) T403966 | 
  [production] | 
            
  | 12:45 | 
  <jmm@cumin2002> | 
  START - Cookbook sre.hosts.reboot-single for host ganeti1038.eqiad.wmnet | 
  [production] | 
            
  | 12:38 | 
  <elukey@cumin1003> | 
  DONE (FAIL) - Cookbook sre.puppet.renew-cert (exit_code=99) for puppetserver1001.eqiad.wmnet: Renew puppet certificate - elukey@cumin1003 | 
  [production] | 
            
  | 12:22 | 
  <dcaro@cloudcumin1001> | 
  END (PASS) - Cookbook wmcs.toolforge.component.deploy (exit_code=0) for component jobs-api | 
  [tools] | 
            
  | 12:16 | 
  <dbrant@deploy1003> | 
  helmfile [codfw] DONE helmfile.d/services/wikifeeds: apply | 
  [production] | 
            
  | 12:15 | 
  <dbrant@deploy1003> | 
  helmfile [codfw] START helmfile.d/services/wikifeeds: apply | 
  [production] | 
            
  | 12:15 | 
  <dbrant@deploy1003> | 
  helmfile [eqiad] DONE helmfile.d/services/wikifeeds: apply | 
  [production] | 
            
  | 12:15 | 
  <dbrant@deploy1003> | 
  helmfile [eqiad] START helmfile.d/services/wikifeeds: apply | 
  [production] | 
            
  | 12:10 | 
  <jmm@cumin2002> | 
  START - Cookbook sre.ganeti.drain-node for draining ganeti node ganeti1038.eqiad.wmnet | 
  [production] | 
            
  | 12:10 | 
  <dcaro@cloudcumin1001> | 
  START - Cookbook wmcs.toolforge.component.deploy for component jobs-api | 
  [tools] | 
            
  | 12:09 | 
  <dbrant@deploy1003> | 
  helmfile [staging] DONE helmfile.d/services/wikifeeds: apply | 
  [production] | 
            
  | 12:09 | 
  <dbrant@deploy1003> | 
  helmfile [staging] START helmfile.d/services/wikifeeds: apply | 
  [production] | 
            
  | 12:04 | 
  <dcaro@cloudcumin1001> | 
  END (ERROR) - Cookbook wmcs.toolforge.component.deploy (exit_code=97) for component jobs-api | 
  [tools] | 
            
  | 11:57 | 
  <jmm@cumin2002> | 
  END (PASS) - Cookbook sre.ganeti.drain-node (exit_code=0) for draining ganeti node ganeti1037.eqiad.wmnet | 
  [production] | 
            
  | 11:57 | 
  <jmm@cumin2002> | 
  END (PASS) - Cookbook sre.hosts.reboot-single (exit_code=0) for host ganeti1037.eqiad.wmnet | 
  [production] | 
            
  | 11:54 | 
  <dcaro@cloudcumin1001> | 
  START - Cookbook wmcs.toolforge.component.deploy for component jobs-api | 
  [tools] | 
            
  | 11:47 | 
  <ladsgroup@cumin1003> | 
  END (PASS) - Cookbook sre.switchdc.databases.finalize (exit_code=0) for the switch from eqiad to codfw for all core sections | 
  [production] | 
            
  | 11:47 | 
  <jmm@cumin2002> | 
  START - Cookbook sre.hosts.reboot-single for host ganeti1037.eqiad.wmnet | 
  [production] | 
            
  | 11:42 | 
  <ladsgroup@cumin1003> | 
  START - Cookbook sre.switchdc.databases.finalize for the switch from eqiad to codfw for all core sections | 
  [production] | 
            
  | 11:40 | 
  <jmm@cumin2002> | 
  START - Cookbook sre.ganeti.drain-node for draining ganeti node ganeti1037.eqiad.wmnet | 
  [production] | 
            
  | 11:29 | 
  <jmm@cumin2002> | 
  END (PASS) - Cookbook sre.ganeti.drain-node (exit_code=0) for draining ganeti node ganeti1036.eqiad.wmnet | 
  [production] | 
            
  | 11:29 | 
  <jmm@cumin2002> | 
  END (PASS) - Cookbook sre.hosts.reboot-single (exit_code=0) for host ganeti1036.eqiad.wmnet | 
  [production] | 
            
  | 11:26 | 
  <stevemunene@deploy1003> | 
  helmfile [dse-k8s-eqiad] DONE helmfile.d/admin 'apply'. | 
  [production] | 
            
  | 11:25 | 
  <stevemunene@deploy1003> | 
  helmfile [dse-k8s-eqiad] START helmfile.d/admin 'apply'. | 
  [production] | 
            
  | 11:21 | 
  <jclark@cumin1002> | 
  END (FAIL) - Cookbook sre.hosts.reimage (exit_code=99) for host an-worker1210.eqiad.wmnet with OS bullseye | 
  [production] | 
            
  | 11:21 | 
  <jclark@cumin1002> | 
  START - Cookbook sre.hosts.reimage for host an-worker1210.eqiad.wmnet with OS bullseye | 
  [production] | 
            
  | 11:21 | 
  <jmm@cumin2002> | 
  START - Cookbook sre.hosts.reboot-single for host ganeti1036.eqiad.wmnet | 
  [production] | 
            
  | 11:18 | 
  <jmm@cumin2002> | 
  START - Cookbook sre.ganeti.drain-node for draining ganeti node ganeti1036.eqiad.wmnet | 
  [production] | 
            
  | 11:07 | 
  <James_F> | 
  Zuul: Simplify WebAuthn removal to only be on REL1_39 | 
  [releng] | 
            
  | 10:35 | 
  <dcaro@cloudcumin1001> | 
  END (PASS) - Cookbook wmcs.toolforge.component.deploy (exit_code=0) for component jobs-api | 
  [toolsbeta] | 
            
  | 10:23 | 
  <dcaro@cloudcumin1001> | 
  START - Cookbook wmcs.toolforge.component.deploy for component jobs-api | 
  [toolsbeta] | 
            
  | 09:52 | 
  <elukey@deploy1003> | 
  helmfile [staging] DONE helmfile.d/services/tegola-vector-tiles: sync | 
  [production] | 
            
  | 09:42 | 
  <elukey@deploy1003> | 
  helmfile [staging] START helmfile.d/services/tegola-vector-tiles: sync | 
  [production] | 
            
  | 09:40 | 
  <elukey@deploy1003> | 
  helmfile [staging-eqiad] DONE helmfile.d/admin 'sync'. | 
  [production] | 
            
  | 09:39 | 
  <elukey@deploy1003> | 
  helmfile [staging-eqiad] START helmfile.d/admin 'sync'. | 
  [production] | 
            
  | 09:39 | 
  <elukey@deploy1003> | 
  helmfile [staging] DONE helmfile.d/services/tegola-vector-tiles: sync | 
  [production] | 
            
  | 09:38 | 
  <elukey@deploy1003> | 
  helmfile [staging-codfw] DONE helmfile.d/admin 'sync'. | 
  [production] | 
            
  | 09:38 | 
  <elukey@deploy1003> | 
  helmfile [staging-codfw] START helmfile.d/admin 'sync'. | 
  [production] | 
            
  | 09:29 | 
  <dcaro@cloudcumin1001> | 
  END (PASS) - Cookbook wmcs.toolforge.component.deploy (exit_code=0) for component jobs-api | 
  [tools] | 
            
  | 09:29 | 
  <elukey@deploy1003> | 
  helmfile [staging] START helmfile.d/services/tegola-vector-tiles: sync | 
  [production] | 
            
  | 09:25 | 
  <jmm@cumin2002> | 
  END (PASS) - Cookbook sre.ganeti.drain-node (exit_code=0) for draining ganeti node ganeti1035.eqiad.wmnet | 
  [production] | 
            
  | 09:25 | 
  <jmm@cumin2002> | 
  END (PASS) - Cookbook sre.hosts.reboot-single (exit_code=0) for host ganeti1035.eqiad.wmnet | 
  [production] | 
            
  | 09:18 | 
  <elukey@deploy1003> | 
  helmfile [codfw] DONE helmfile.d/admin 'sync'. | 
  [production] |