| 2025-09-25
      
      ยง | 
    
  | 21:21 | <rzl@deploy1003> | helmfile [staging] START helmfile.d/services/wikifeeds: apply | [production] | 
            
  | 21:20 | <wmbot~damian@tools-bastion-15> | bot deployed @ v1.2.2 | [tools.cluebotng] | 
            
  | 21:20 | <wmbot~damian-scripts@tools-bastion-15> | bot deployed @ refs/tags/v1.2.2 | [tools.cluebotng] | 
            
  | 20:55 | <cjming> | end of UTC late backport window | [production] | 
            
  | 20:52 | <cjming@deploy2002> | Finished scap sync-world: Backport for [[gerrit:1191447|xLab: instrument page visits with delayed events]] (duration: 11m 17s) | [production] | 
            
  | 20:47 | <cjming@deploy2002> | cjming: Continuing with sync | [production] | 
            
  | 20:47 | <tchin@deploy1003> | helmfile [codfw] DONE helmfile.d/services/eventgate-logging-external: apply | [production] | 
            
  | 20:47 | <cjming@deploy2002> | cjming: Backport for [[gerrit:1191447|xLab: instrument page visits with delayed events]] synced to the testservers (see https://wikitech.wikimedia.org/wiki/Mwdebug). Changes can now be verified there. | [production] | 
            
  | 20:46 | <tchin@deploy1003> | helmfile [codfw] START helmfile.d/services/eventgate-logging-external: apply | [production] | 
            
  | 20:44 | <tchin@deploy1003> | helmfile [staging] DONE helmfile.d/services/eventgate-logging-external: apply | [production] | 
            
  | 20:44 | <tchin@deploy1003> | helmfile [staging] START helmfile.d/services/eventgate-logging-external: apply | [production] | 
            
  | 20:41 | <cjming@deploy2002> | Started scap sync-world: Backport for [[gerrit:1191447|xLab: instrument page visits with delayed events]] | [production] | 
            
  | 20:38 | <tchin@deploy1003> | helmfile [staging] DONE helmfile.d/services/eventgate-logging-external: apply | [production] | 
            
  | 20:35 | <tchin@deploy1003> | helmfile [staging] START helmfile.d/services/eventgate-logging-external: apply | [production] | 
            
  | 20:34 | <mutante> | [releases2003:~] $ sudo systemctl reset-failed - monitoring alerted about failed rsync from deploy1003 after active deployment server switched to deploy2002 today - T405646 | [production] | 
            
  | 20:31 | <dani@deploy2002> | Finished scap sync-world: Backport for [[gerrit:1191454|Pre-deploy reader foundational survey on enwiki (T405410)]], [[gerrit:1191425|Deploy Design Research participant recruitment survey on jawiki (T405577)]] (duration: 12m 35s) | [production] | 
            
  | 20:26 | <dani@deploy2002> | dani: Continuing with sync | [production] | 
            
  | 20:24 | <dani@deploy2002> | dani: Backport for [[gerrit:1191454|Pre-deploy reader foundational survey on enwiki (T405410)]], [[gerrit:1191425|Deploy Design Research participant recruitment survey on jawiki (T405577)]] synced to the testservers (see https://wikitech.wikimedia.org/wiki/Mwdebug). Changes can now be verified there. | [production] | 
            
  | 20:18 | <dani@deploy2002> | Started scap sync-world: Backport for [[gerrit:1191454|Pre-deploy reader foundational survey on enwiki (T405410)]], [[gerrit:1191425|Deploy Design Research participant recruitment survey on jawiki (T405577)]] | [production] | 
            
  | 20:16 | <mutante> | deploy1003 alerted because /srv/ is at 98% - T401647 | [production] | 
            
  | 20:15 | <sbisson@deploy2002> | Finished scap sync-world: Backport for [[gerrit:1191377|Special:Contribute: configure new page target title for enwiki (T327063)]] (duration: 11m 31s) | [production] | 
            
  | 20:10 | <sbisson@deploy2002> | sbisson: Continuing with sync | [production] | 
            
  | 20:10 | <sbisson@deploy2002> | sbisson: Backport for [[gerrit:1191377|Special:Contribute: configure new page target title for enwiki (T327063)]] synced to the testservers (see https://wikitech.wikimedia.org/wiki/Mwdebug). Changes can now be verified there. | [production] | 
            
  | 20:04 | <sbisson@deploy2002> | Started scap sync-world: Backport for [[gerrit:1191377|Special:Contribute: configure new page target title for enwiki (T327063)]] | [production] | 
            
  | 19:36 | <jhathaway@cumin2002> | END (PASS) - Cookbook sre.hosts.provision (exit_code=0) for host sretest2010.mgmt.codfw.wmnet with chassis set policy FORCE_RESTART | [production] | 
            
  | 19:36 | <jhathaway@cumin2002> | START - Cookbook sre.hosts.provision for host sretest2010.mgmt.codfw.wmnet with chassis set policy FORCE_RESTART | [production] | 
            
  | 19:35 | <brennen@deploy2002> | rebuilt and synchronized wikiversions files: group2 to 1.45.0-wmf.20  refs T396381 | [production] | 
            
  | 19:31 | <jhancock@cumin1002> | END (FAIL) - Cookbook sre.hosts.reimage (exit_code=99) for host wikikube-ctrl2006.codfw.wmnet with OS bookworm | [production] | 
            
  | 19:30 | <jhathaway@cumin2002> | END (FAIL) - Cookbook sre.hosts.reimage (exit_code=99) for host sretest2010.codfw.wmnet with OS trixie | [production] | 
            
  | 19:24 | <jhathaway@cumin2002> | START - Cookbook sre.hosts.reimage for host sretest2010.codfw.wmnet with OS trixie | [production] | 
            
  | 19:19 | <brennen@deploy2002> | Finished scap sync-world: Backport for [[gerrit:1191334|fix: provide a eventType fallback for already scheduled jobs (T405514)]], [[gerrit:1191414|fix: prevent type-error from outdated serialization (T405511)]] (duration: 54m 29s) | [production] | 
            
  | 19:17 | <wmbot~damian-scripts@tools-bastion-15> | bot deployed @ refs/tags/v1.2.1 | [tools.cluebotng] | 
            
  | 19:16 | <wmbot~damian-scripts@tools-bastion-15> | bot deployed @ refs/tags/v1.2.0 | [tools.cluebotng] | 
            
  | 19:11 | <jhancock@cumin1002> | END (FAIL) - Cookbook sre.hosts.reimage (exit_code=99) for host dse-k8s-worker2003.codfw.wmnet with OS bookworm | [production] | 
            
  | 19:05 | <brennen@deploy2002> | sgimeno, migr, brennen: Continuing with sync | [production] | 
            
  | 19:04 | <brennen@deploy2002> | sgimeno, migr, brennen: Backport for [[gerrit:1191334|fix: provide a eventType fallback for already scheduled jobs (T405514)]], [[gerrit:1191414|fix: prevent type-error from outdated serialization (T405511)]] synced to the testservers (see https://wikitech.wikimedia.org/wiki/Mwdebug). Changes can now be verified there. | [production] | 
            
  | 18:56 | <mutante> | LDAP - added uid=elishacohenwmde to 'wmde' and 'nda' T404359 | [production] | 
            
  | 18:55 | <mutante> | LDAP - added member: uid=elishacohenwmde,ou=people,dc=wikimedia,dc=org | [production] | 
            
  | 18:29 | <wm-bot2> | Deployment completed: https://github.com/cluebotng/component-configs/actions/runs/18017003184 (https://github.com/cluebotng/component-configs/commits/e9fc8d46ac1a0ff0ac6203458fa171c6430492ce) | [tools.cluebotng] | 
            
  | 18:25 | <wm-bot2> | Deployment completed: https://github.com/cluebotng/component-configs/actions/runs/18016894528 (https://github.com/cluebotng/component-configs/commits/cfc9adc9516df0f11c8b6d1df68232d0a46cb4eb) | [tools.cluebotng] | 
            
  | 18:24 | <brennen@deploy2002> | Started scap sync-world: Backport for [[gerrit:1191334|fix: provide a eventType fallback for already scheduled jobs (T405514)]], [[gerrit:1191414|fix: prevent type-error from outdated serialization (T405511)]] | [production] | 
            
  | 18:11 | <jhancock@cumin1002> | START - Cookbook sre.hosts.reimage for host wikikube-ctrl2006.codfw.wmnet with OS bookworm | [production] | 
            
  | 18:08 | <jhancock@cumin1002> | START - Cookbook sre.hosts.reimage for host dse-k8s-worker2003.codfw.wmnet with OS bookworm | [production] | 
            
  | 18:04 | <raymond-ndibe@cloudcumin1001> | END (PASS) - Cookbook wmcs.toolforge.component.deploy (exit_code=0) for component components-api | [tools] | 
            
  | 17:59 | <raymond-ndibe@cloudcumin1001> | START - Cookbook wmcs.toolforge.component.deploy for component components-api | [tools] | 
            
  | 17:58 | <raymond-ndibe@cloudcumin1001> | END (PASS) - Cookbook wmcs.toolforge.component.deploy (exit_code=0) for component components-api | [toolsbeta] | 
            
  | 17:57 | <sfaci@deploy2002> | helmfile [dse-k8s-eqiad] DONE helmfile.d/dse-k8s-services/mpic: apply | [production] | 
            
  | 17:56 | <sfaci@deploy2002> | helmfile [dse-k8s-eqiad] START helmfile.d/dse-k8s-services/mpic: apply | [production] | 
            
  | 17:53 | <raymond-ndibe@cloudcumin1001> | START - Cookbook wmcs.toolforge.component.deploy for component components-api | [toolsbeta] | 
            
  | 17:47 | <wm-bot2> | Deployment completed: https://github.com/cluebotng/component-configs/actions/runs/18016018062 (https://github.com/cluebotng/component-configs/commits/150020d96f0c95173ba88c382221223a0c1f7a8d) | [tools.cluebotng-review] |