| 
      
        2025-09-25
      
      ยง
     | 
  
    
  | 20:47 | 
  <tchin@deploy1003> | 
  helmfile [codfw] DONE helmfile.d/services/eventgate-logging-external: apply | 
  [production] | 
            
  | 20:47 | 
  <cjming@deploy2002> | 
  cjming: Backport for [[gerrit:1191447|xLab: instrument page visits with delayed events]] synced to the testservers (see https://wikitech.wikimedia.org/wiki/Mwdebug). Changes can now be verified there. | 
  [production] | 
            
  | 20:46 | 
  <tchin@deploy1003> | 
  helmfile [codfw] START helmfile.d/services/eventgate-logging-external: apply | 
  [production] | 
            
  | 20:44 | 
  <tchin@deploy1003> | 
  helmfile [staging] DONE helmfile.d/services/eventgate-logging-external: apply | 
  [production] | 
            
  | 20:44 | 
  <tchin@deploy1003> | 
  helmfile [staging] START helmfile.d/services/eventgate-logging-external: apply | 
  [production] | 
            
  | 20:41 | 
  <cjming@deploy2002> | 
  Started scap sync-world: Backport for [[gerrit:1191447|xLab: instrument page visits with delayed events]] | 
  [production] | 
            
  | 20:38 | 
  <tchin@deploy1003> | 
  helmfile [staging] DONE helmfile.d/services/eventgate-logging-external: apply | 
  [production] | 
            
  | 20:35 | 
  <tchin@deploy1003> | 
  helmfile [staging] START helmfile.d/services/eventgate-logging-external: apply | 
  [production] | 
            
  | 20:34 | 
  <mutante> | 
  [releases2003:~] $ sudo systemctl reset-failed - monitoring alerted about failed rsync from deploy1003 after active deployment server switched to deploy2002 today - T405646 | 
  [production] | 
            
  | 20:31 | 
  <dani@deploy2002> | 
  Finished scap sync-world: Backport for [[gerrit:1191454|Pre-deploy reader foundational survey on enwiki (T405410)]], [[gerrit:1191425|Deploy Design Research participant recruitment survey on jawiki (T405577)]] (duration: 12m 35s) | 
  [production] | 
            
  | 20:26 | 
  <dani@deploy2002> | 
  dani: Continuing with sync | 
  [production] | 
            
  | 20:24 | 
  <dani@deploy2002> | 
  dani: Backport for [[gerrit:1191454|Pre-deploy reader foundational survey on enwiki (T405410)]], [[gerrit:1191425|Deploy Design Research participant recruitment survey on jawiki (T405577)]] synced to the testservers (see https://wikitech.wikimedia.org/wiki/Mwdebug). Changes can now be verified there. | 
  [production] | 
            
  | 20:18 | 
  <dani@deploy2002> | 
  Started scap sync-world: Backport for [[gerrit:1191454|Pre-deploy reader foundational survey on enwiki (T405410)]], [[gerrit:1191425|Deploy Design Research participant recruitment survey on jawiki (T405577)]] | 
  [production] | 
            
  | 20:16 | 
  <mutante> | 
  deploy1003 alerted because /srv/ is at 98% - T401647 | 
  [production] | 
            
  | 20:15 | 
  <sbisson@deploy2002> | 
  Finished scap sync-world: Backport for [[gerrit:1191377|Special:Contribute: configure new page target title for enwiki (T327063)]] (duration: 11m 31s) | 
  [production] | 
            
  | 20:10 | 
  <sbisson@deploy2002> | 
  sbisson: Continuing with sync | 
  [production] | 
            
  | 20:10 | 
  <sbisson@deploy2002> | 
  sbisson: Backport for [[gerrit:1191377|Special:Contribute: configure new page target title for enwiki (T327063)]] synced to the testservers (see https://wikitech.wikimedia.org/wiki/Mwdebug). Changes can now be verified there. | 
  [production] | 
            
  | 20:04 | 
  <sbisson@deploy2002> | 
  Started scap sync-world: Backport for [[gerrit:1191377|Special:Contribute: configure new page target title for enwiki (T327063)]] | 
  [production] | 
            
  | 19:36 | 
  <jhathaway@cumin2002> | 
  END (PASS) - Cookbook sre.hosts.provision (exit_code=0) for host sretest2010.mgmt.codfw.wmnet with chassis set policy FORCE_RESTART | 
  [production] | 
            
  | 19:36 | 
  <jhathaway@cumin2002> | 
  START - Cookbook sre.hosts.provision for host sretest2010.mgmt.codfw.wmnet with chassis set policy FORCE_RESTART | 
  [production] | 
            
  | 19:35 | 
  <brennen@deploy2002> | 
  rebuilt and synchronized wikiversions files: group2 to 1.45.0-wmf.20  refs T396381 | 
  [production] | 
            
  | 19:31 | 
  <jhancock@cumin1002> | 
  END (FAIL) - Cookbook sre.hosts.reimage (exit_code=99) for host wikikube-ctrl2006.codfw.wmnet with OS bookworm | 
  [production] | 
            
  | 19:30 | 
  <jhathaway@cumin2002> | 
  END (FAIL) - Cookbook sre.hosts.reimage (exit_code=99) for host sretest2010.codfw.wmnet with OS trixie | 
  [production] | 
            
  | 19:24 | 
  <jhathaway@cumin2002> | 
  START - Cookbook sre.hosts.reimage for host sretest2010.codfw.wmnet with OS trixie | 
  [production] | 
            
  | 19:19 | 
  <brennen@deploy2002> | 
  Finished scap sync-world: Backport for [[gerrit:1191334|fix: provide a eventType fallback for already scheduled jobs (T405514)]], [[gerrit:1191414|fix: prevent type-error from outdated serialization (T405511)]] (duration: 54m 29s) | 
  [production] | 
            
  | 19:17 | 
  <wmbot~damian-scripts@tools-bastion-15> | 
  bot deployed @ refs/tags/v1.2.1 | 
  [tools.cluebotng] | 
            
  | 19:16 | 
  <wmbot~damian-scripts@tools-bastion-15> | 
  bot deployed @ refs/tags/v1.2.0 | 
  [tools.cluebotng] | 
            
  | 19:11 | 
  <jhancock@cumin1002> | 
  END (FAIL) - Cookbook sre.hosts.reimage (exit_code=99) for host dse-k8s-worker2003.codfw.wmnet with OS bookworm | 
  [production] | 
            
  | 19:05 | 
  <brennen@deploy2002> | 
  sgimeno, migr, brennen: Continuing with sync | 
  [production] | 
            
  | 19:04 | 
  <brennen@deploy2002> | 
  sgimeno, migr, brennen: Backport for [[gerrit:1191334|fix: provide a eventType fallback for already scheduled jobs (T405514)]], [[gerrit:1191414|fix: prevent type-error from outdated serialization (T405511)]] synced to the testservers (see https://wikitech.wikimedia.org/wiki/Mwdebug). Changes can now be verified there. | 
  [production] | 
            
  | 18:56 | 
  <mutante> | 
  LDAP - added uid=elishacohenwmde to 'wmde' and 'nda' T404359 | 
  [production] | 
            
  | 18:55 | 
  <mutante> | 
  LDAP - added member: uid=elishacohenwmde,ou=people,dc=wikimedia,dc=org | 
  [production] | 
            
  | 18:29 | 
  <wm-bot2> | 
  Deployment completed: https://github.com/cluebotng/component-configs/actions/runs/18017003184 (https://github.com/cluebotng/component-configs/commits/e9fc8d46ac1a0ff0ac6203458fa171c6430492ce) | 
  [tools.cluebotng] | 
            
  | 18:25 | 
  <wm-bot2> | 
  Deployment completed: https://github.com/cluebotng/component-configs/actions/runs/18016894528 (https://github.com/cluebotng/component-configs/commits/cfc9adc9516df0f11c8b6d1df68232d0a46cb4eb) | 
  [tools.cluebotng] | 
            
  | 18:24 | 
  <brennen@deploy2002> | 
  Started scap sync-world: Backport for [[gerrit:1191334|fix: provide a eventType fallback for already scheduled jobs (T405514)]], [[gerrit:1191414|fix: prevent type-error from outdated serialization (T405511)]] | 
  [production] | 
            
  | 18:11 | 
  <jhancock@cumin1002> | 
  START - Cookbook sre.hosts.reimage for host wikikube-ctrl2006.codfw.wmnet with OS bookworm | 
  [production] | 
            
  | 18:08 | 
  <jhancock@cumin1002> | 
  START - Cookbook sre.hosts.reimage for host dse-k8s-worker2003.codfw.wmnet with OS bookworm | 
  [production] | 
            
  | 18:04 | 
  <raymond-ndibe@cloudcumin1001> | 
  END (PASS) - Cookbook wmcs.toolforge.component.deploy (exit_code=0) for component components-api | 
  [tools] | 
            
  | 17:59 | 
  <raymond-ndibe@cloudcumin1001> | 
  START - Cookbook wmcs.toolforge.component.deploy for component components-api | 
  [tools] | 
            
  | 17:58 | 
  <raymond-ndibe@cloudcumin1001> | 
  END (PASS) - Cookbook wmcs.toolforge.component.deploy (exit_code=0) for component components-api | 
  [toolsbeta] | 
            
  | 17:57 | 
  <sfaci@deploy2002> | 
  helmfile [dse-k8s-eqiad] DONE helmfile.d/dse-k8s-services/mpic: apply | 
  [production] | 
            
  | 17:56 | 
  <sfaci@deploy2002> | 
  helmfile [dse-k8s-eqiad] START helmfile.d/dse-k8s-services/mpic: apply | 
  [production] | 
            
  | 17:53 | 
  <raymond-ndibe@cloudcumin1001> | 
  START - Cookbook wmcs.toolforge.component.deploy for component components-api | 
  [toolsbeta] | 
            
  | 17:47 | 
  <wm-bot2> | 
  Deployment completed: https://github.com/cluebotng/component-configs/actions/runs/18016018062 (https://github.com/cluebotng/component-configs/commits/150020d96f0c95173ba88c382221223a0c1f7a8d) | 
  [tools.cluebotng-review] | 
            
  | 17:46 | 
  <wm-bot2> | 
  Deployment completed: https://github.com/cluebotng/component-configs/actions/runs/18015998407 (https://github.com/cluebotng/component-configs/commits/5592cdfcdc7e683a993c8e784d83fb1a71a0b04c) | 
  [tools.cluebotng] | 
            
  | 17:44 | 
  <wm-bot2> | 
  Deployment completed: https://github.com/cluebotng/component-configs/actions/runs/18015998408 (https://github.com/cluebotng/component-configs/commits/5592cdfcdc7e683a993c8e784d83fb1a71a0b04c) | 
  [tools.cluebotng-staging] | 
            
  | 17:44 | 
  <wm-bot2> | 
  Deployment completed: https://github.com/cluebotng/component-configs/actions/runs/18015998409 (https://github.com/cluebotng/component-configs/commits/5592cdfcdc7e683a993c8e784d83fb1a71a0b04c) | 
  [tools.cluebotng-review] | 
            
  | 17:42 | 
  <dcaro@cloudcumin1001> | 
  END (PASS) - Cookbook wmcs.toolforge.component.deploy (exit_code=0) for component jobs-api | 
  [tools] | 
            
  | 17:32 | 
  <jasmine@deploy2002> | 
  Finished scap sync-world: Test deployment to validate deployment server switchover - T399891. (duration: 39m 28s) | 
  [production] | 
            
  | 17:32 | 
  <wm-bot2> | 
  Deployment completed: https://github.com/cluebotng/component-configs/actions/runs/18015392766 (https://github.com/cluebotng/component-configs/commits/61a7ceac210077c3d81bc064c37f8d8668cc2cfb) | 
  [tools.cluebotng] |