| 2024-01-03
      
      § | 
    
  | 09:35 | <pfischer@deploy2002> | helmfile [staging] START helmfile.d/services/cirrus-streaming-updater: apply | [production] | 
            
  | 09:33 | <pfischer@deploy2002> | helmfile [staging] DONE helmfile.d/services/cirrus-streaming-updater: apply | [production] | 
            
  | 09:33 | <pfischer@deploy2002> | helmfile [staging] START helmfile.d/services/cirrus-streaming-updater: apply | [production] | 
            
  | 09:32 | <pfischer@deploy2002> | helmfile [staging] DONE helmfile.d/services/cirrus-streaming-updater: apply | [production] | 
            
  | 09:32 | <pfischer@deploy2002> | helmfile [staging] START helmfile.d/services/cirrus-streaming-updater: apply | [production] | 
            
  | 09:31 | <pfischer@deploy2002> | helmfile [staging] DONE helmfile.d/services/cirrus-streaming-updater: apply | [production] | 
            
  | 09:31 | <pfischer@deploy2002> | helmfile [staging] START helmfile.d/services/cirrus-streaming-updater: apply | [production] | 
            
  | 09:21 | <pfischer@deploy2002> | helmfile [staging] DONE helmfile.d/services/cirrus-streaming-updater: apply | [production] | 
            
  | 09:21 | <pfischer@deploy2002> | helmfile [staging] START helmfile.d/services/cirrus-streaming-updater: apply | [production] | 
            
  | 09:21 | <pfischer@deploy2002> | helmfile [staging] DONE helmfile.d/services/cirrus-streaming-updater: apply | [production] | 
            
  | 09:21 | <pfischer@deploy2002> | helmfile [staging] START helmfile.d/services/cirrus-streaming-updater: apply | [production] | 
            
  | 09:21 | <pfischer@deploy2002> | helmfile [staging] DONE helmfile.d/services/cirrus-streaming-updater: apply | [production] | 
            
  | 09:13 | <pfischer@deploy2002> | helmfile [staging] START helmfile.d/services/cirrus-streaming-updater: apply | [production] | 
            
  | 09:10 | <pfischer@deploy2002> | helmfile [staging] DONE helmfile.d/services/cirrus-streaming-updater: apply | [production] | 
            
  | 09:10 | <pfischer@deploy2002> | helmfile [staging] START helmfile.d/services/cirrus-streaming-updater: apply | [production] | 
            
  | 09:08 | <pfischer@deploy2002> | helmfile [staging] DONE helmfile.d/services/cirrus-streaming-updater: apply | [production] | 
            
  | 09:07 | <pfischer@deploy2002> | helmfile [staging] START helmfile.d/services/cirrus-streaming-updater: apply | [production] | 
            
  | 09:03 | <pfischer@deploy2002> | helmfile [staging] START helmfile.d/services/cirrus-streaming-updater: apply | [production] | 
            
  | 01:16 | <rzl@deploy2002> | helmfile [codfw] DONE helmfile.d/admin 'apply'. | [production] | 
            
  | 01:16 | <rzl@deploy2002> | helmfile [codfw] START helmfile.d/admin 'apply'. | [production] | 
            
  | 01:13 | <rzl@deploy2002> | helmfile [codfw] DONE helmfile.d/admin 'apply'. | [production] | 
            
  | 01:13 | <rzl@deploy2002> | helmfile [codfw] START helmfile.d/admin 'apply'. | [production] | 
            
  | 00:55 | <rzl@deploy2002> | helmfile [codfw] DONE helmfile.d/admin 'apply'. | [production] | 
            
  | 00:55 | <rzl@deploy2002> | helmfile [codfw] START helmfile.d/admin 'apply'. | [production] | 
            
  | 00:08 | <rzl@deploy2002> | helmfile [codfw] DONE helmfile.d/admin 'apply'. | [production] | 
            
  | 00:08 | <rzl@deploy2002> | helmfile [codfw] START helmfile.d/admin 'apply'. | [production] | 
            
  
    | 2024-01-02
      
      § | 
    
  | 22:42 | <urbanecm> | mwmaint2002: Restart `mwscript extensions/GrowthExperiments/maintenance/reassignMentees.php --wiki=enwiki --mentor 'FormalDude' --performer 'Martin Urbanec (WMF)'` (T354220) | [production] | 
            
  | 22:29 | <bking@cumin2002> | END (FAIL) - Cookbook sre.hosts.reimage (exit_code=99) for host elastic2087.codfw.wmnet with OS bullseye | [production] | 
            
  | 21:08 | <bking@cumin2002> | START - Cookbook sre.hosts.reimage for host elastic2087.codfw.wmnet with OS bullseye | [production] | 
            
  | 20:52 | <urbanecm> | mwmaint2002: `mwscript extensions/GrowthExperiments/maintenance/reassignMentees.php --wiki=enwiki --mentor 'FormalDude' --performer 'Martin Urbanec (WMF)'` (T354220) | [production] | 
            
  | 20:32 | <mutante> | phab2002 - synced /srv/homes tfrom phab1004 to /srv/homes on phab2002 | [production] | 
            
  | 19:38 | <dduvall@deploy2002> | rebuilt and synchronized wikiversions files: group0 wikis to 1.42.0-wmf.12  refs T350088 | [production] | 
            
  | 18:29 | <mutante> | confctl select 'name=mw2394.codfw.wmnet' set/pooled=inactive | T354193#9430654 - seems like 2396 was previously depooled instead of this 2394 | [production] | 
            
  | 17:29 | <dancy@deploy2002> | Installation of scap version "4.65.1" completed for 566 hosts | [production] | 
            
  | 17:28 | <dancy@deploy2002> | Installing scap version "4.65.1" for 566 hosts | [production] | 
            
  | 17:26 | <dancy@deploy2002> | Installing scap version "4.65.1" for 567 hosts | [production] | 
            
  | 14:59 | <btullis@cumin1001> | END (PASS) - Cookbook sre.hosts.reimage (exit_code=0) for host dbstore1008.eqiad.wmnet with OS bookworm | [production] | 
            
  | 14:58 | <btullis@cumin1001> | END (PASS) - Cookbook sre.hosts.reimage (exit_code=0) for host dbstore1009.eqiad.wmnet with OS bookworm | [production] | 
            
  | 14:44 | <urbanecm> | [urbanecm@mwmaint2002 ~]$ mwscript namespaceDupes.php --wiki=csbwiktionary --fix # T354114 | [production] | 
            
  | 14:43 | <btullis@cumin1001> | END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 2:00:00 on dbstore1009.eqiad.wmnet with reason: host reimage | [production] | 
            
  | 14:40 | <btullis@cumin1001> | START - Cookbook sre.hosts.downtime for 2:00:00 on dbstore1009.eqiad.wmnet with reason: host reimage | [production] | 
            
  | 14:37 | <btullis@cumin1001> | END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 2:00:00 on dbstore1008.eqiad.wmnet with reason: host reimage | [production] | 
            
  | 14:34 | <btullis@cumin1001> | START - Cookbook sre.hosts.downtime for 2:00:00 on dbstore1008.eqiad.wmnet with reason: host reimage | [production] | 
            
  | 14:32 | <_joe_> | confctl select 'name=mw2396.codfw.wmnet' set/pooled=inactive | [production] | 
            
  | 14:26 | <btullis@cumin1001> | START - Cookbook sre.hosts.reimage for host dbstore1009.eqiad.wmnet with OS bookworm | [production] | 
            
  | 14:20 | <btullis@cumin1001> | START - Cookbook sre.hosts.reimage for host dbstore1008.eqiad.wmnet with OS bookworm | [production] | 
            
  | 14:16 | <urbanecm@deploy2002> | Finished scap: Backport for [[gerrit:985384|cswiki: Grant patrolmarks to autopatrolled (T354004)]], [[gerrit:986640|csbwiktionary: Set MetaNamespaceName to Wikisłowôrz (T354114)]] (duration: 13m 46s) | [production] | 
            
  | 14:04 | <urbanecm@deploy2002> | urbanecm: Continuing with sync | [production] | 
            
  | 14:04 | <urbanecm@deploy2002> | urbanecm: Backport for [[gerrit:985384|cswiki: Grant patrolmarks to autopatrolled (T354004)]], [[gerrit:986640|csbwiktionary: Set MetaNamespaceName to Wikisłowôrz (T354114)]] synced to the testservers (https://wikitech.wikimedia.org/wiki/Mwdebug) | [production] | 
            
  | 14:02 | <urbanecm@deploy2002> | Started scap: Backport for [[gerrit:985384|cswiki: Grant patrolmarks to autopatrolled (T354004)]], [[gerrit:986640|csbwiktionary: Set MetaNamespaceName to Wikisłowôrz (T354114)]] | [production] |