| 2024-02-19
      
      § | 
    
  | 06:17 | <marostegui@deploy2002> | Finished scap: Backport for [[gerrit:1004181|Revert "ProductionServices.php: Promote pc2014 to pc1 master"]] (duration: 19m 02s) | [production] | 
            
  | 06:15 | <marostegui@cumin1002> | dbctl commit (dc=all): 'Place db1170 in s7 T354826', diff saved to https://phabricator.wikimedia.org/P56952 and previous config saved to /var/cache/conftool/dbconfig/20240219-061548-marostegui.json | [production] | 
            
  | 06:11 | <marostegui@cumin1002> | dbctl commit (dc=all): 'Depool db1170 T354826', diff saved to https://phabricator.wikimedia.org/P56951 and previous config saved to /var/cache/conftool/dbconfig/20240219-061121-root.json | [production] | 
            
  | 06:08 | <marostegui@deploy2002> | marostegui: Continuing with sync | [production] | 
            
  | 06:08 | <marostegui@deploy2002> | marostegui: Backport for [[gerrit:1004181|Revert "ProductionServices.php: Promote pc2014 to pc1 master"]] synced to the testservers (https://wikitech.wikimedia.org/wiki/Mwdebug) | [production] | 
            
  | 05:58 | <marostegui@deploy2002> | Started scap: Backport for [[gerrit:1004181|Revert "ProductionServices.php: Promote pc2014 to pc1 master"]] | [production] | 
            
  | 05:53 | <marostegui@cumin1002> | END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 1:00:00 on pc[2011,2014].codfw.wmnet,pc[1011,1014].eqiad.wmnet with reason: Primary switchover pc1 T356371 | [production] | 
            
  | 05:53 | <marostegui@cumin1002> | START - Cookbook sre.hosts.downtime for 1:00:00 on pc[2011,2014].codfw.wmnet,pc[1011,1014].eqiad.wmnet with reason: Primary switchover pc1 T356371 | [production] | 
            
  | 02:57 | <TimStarling> | on deployment-deploy03 running foreachwiki maintenance/migrateBlocks.php again (T355034, T357366) | [releng] | 
            
  | 02:54 | <TimStarling> | on deployment-deploy03 truncate tables block and block_target on all beta wikis T357366 | [releng] | 
            
  | 01:44 | <wmbot~anticomposite@tools-sgebastion-10> | ./stewardbots/StewardBot/manage.sh restart # RC reader not reading RC | [tools.stewardbots] | 
            
  | 01:41 | <wmbot~anticomposite@tools-sgebastion-10> | SULWatcher/manage.sh restart # SULWatchers disconnected | [tools.stewardbots] | 
            
  
    | 2024-02-18
      
      § | 
    
  | 23:11 | <ladsgroup@cumin1002> | dbctl commit (dc=all): 'Repooling after maintenance db2172 (T352010)', diff saved to https://phabricator.wikimedia.org/P56950 and previous config saved to /var/cache/conftool/dbconfig/20240218-231102-ladsgroup.json | [production] | 
            
  | 22:55 | <ladsgroup@cumin1002> | dbctl commit (dc=all): 'Repooling after maintenance db2172', diff saved to https://phabricator.wikimedia.org/P56949 and previous config saved to /var/cache/conftool/dbconfig/20240218-225556-ladsgroup.json | [production] | 
            
  | 22:40 | <ladsgroup@cumin1002> | dbctl commit (dc=all): 'Repooling after maintenance db2172', diff saved to https://phabricator.wikimedia.org/P56948 and previous config saved to /var/cache/conftool/dbconfig/20240218-224049-ladsgroup.json | [production] | 
            
  | 22:25 | <ladsgroup@cumin1002> | dbctl commit (dc=all): 'Repooling after maintenance db2172 (T352010)', diff saved to https://phabricator.wikimedia.org/P56947 and previous config saved to /var/cache/conftool/dbconfig/20240218-222543-ladsgroup.json | [production] | 
            
  | 21:10 | <eileen> | civicrm upgraded from 45a0138c to 5af300d4 | [production] | 
            
  | 17:15 | <ladsgroup@cumin1002> | dbctl commit (dc=all): 'Depooling db2172 (T352010)', diff saved to https://phabricator.wikimedia.org/P56945 and previous config saved to /var/cache/conftool/dbconfig/20240218-171526-ladsgroup.json | [production] | 
            
  | 17:15 | <ladsgroup@cumin1002> | END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 1 day, 0:00:00 on db2172.codfw.wmnet with reason: Maintenance | [production] | 
            
  | 17:15 | <ladsgroup@cumin1002> | START - Cookbook sre.hosts.downtime for 1 day, 0:00:00 on db2172.codfw.wmnet with reason: Maintenance | [production] | 
            
  | 17:15 | <ladsgroup@cumin1002> | dbctl commit (dc=all): 'Repooling after maintenance db2155 (T352010)', diff saved to https://phabricator.wikimedia.org/P56944 and previous config saved to /var/cache/conftool/dbconfig/20240218-171502-ladsgroup.json | [production] | 
            
  | 16:59 | <ladsgroup@cumin1002> | dbctl commit (dc=all): 'Repooling after maintenance db2155', diff saved to https://phabricator.wikimedia.org/P56943 and previous config saved to /var/cache/conftool/dbconfig/20240218-165955-ladsgroup.json | [production] | 
            
  | 16:44 | <ladsgroup@cumin1002> | dbctl commit (dc=all): 'Repooling after maintenance db2155', diff saved to https://phabricator.wikimedia.org/P56942 and previous config saved to /var/cache/conftool/dbconfig/20240218-164448-ladsgroup.json | [production] | 
            
  | 16:29 | <ladsgroup@cumin1002> | dbctl commit (dc=all): 'Repooling after maintenance db2155 (T352010)', diff saved to https://phabricator.wikimedia.org/P56941 and previous config saved to /var/cache/conftool/dbconfig/20240218-162942-ladsgroup.json | [production] | 
            
  | 15:44 | <wmbot~taavi@tools-sgebastion-11> | 'kubectl delete pod flr-6d74b958d9-b28dz' after reports of FlickreviewR 2 not working on IRC | [tools.yifeibot] | 
            
  | 15:44 | <wmbot~taavi@tools-sgebastion-11> | after reports of FlickreviewR 2 not working on IRC | [tools.yifeibot] | 
            
  | 11:19 | <ladsgroup@cumin1002> | dbctl commit (dc=all): 'Depooling db2155 (T352010)', diff saved to https://phabricator.wikimedia.org/P56940 and previous config saved to /var/cache/conftool/dbconfig/20240218-111954-ladsgroup.json | [production] | 
            
  | 11:19 | <ladsgroup@cumin1002> | END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 2 days, 0:00:00 on db2187.codfw.wmnet with reason: Maintenance | [production] | 
            
  | 11:19 | <ladsgroup@cumin1002> | START - Cookbook sre.hosts.downtime for 2 days, 0:00:00 on db2187.codfw.wmnet with reason: Maintenance | [production] | 
            
  | 11:19 | <ladsgroup@cumin1002> | END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 1 day, 0:00:00 on db2155.codfw.wmnet with reason: Maintenance | [production] | 
            
  | 11:19 | <ladsgroup@cumin1002> | START - Cookbook sre.hosts.downtime for 1 day, 0:00:00 on db2155.codfw.wmnet with reason: Maintenance | [production] | 
            
  | 11:19 | <ladsgroup@cumin1002> | dbctl commit (dc=all): 'Repooling after maintenance db2147 (T352010)', diff saved to https://phabricator.wikimedia.org/P56939 and previous config saved to /var/cache/conftool/dbconfig/20240218-111915-ladsgroup.json | [production] | 
            
  | 11:04 | <ladsgroup@cumin1002> | dbctl commit (dc=all): 'Repooling after maintenance db2147', diff saved to https://phabricator.wikimedia.org/P56938 and previous config saved to /var/cache/conftool/dbconfig/20240218-110408-ladsgroup.json | [production] | 
            
  | 10:49 | <ladsgroup@cumin1002> | dbctl commit (dc=all): 'Repooling after maintenance db2147', diff saved to https://phabricator.wikimedia.org/P56937 and previous config saved to /var/cache/conftool/dbconfig/20240218-104901-ladsgroup.json | [production] | 
            
  | 10:33 | <ladsgroup@cumin1002> | dbctl commit (dc=all): 'Repooling after maintenance db2147 (T352010)', diff saved to https://phabricator.wikimedia.org/P56936 and previous config saved to /var/cache/conftool/dbconfig/20240218-103355-ladsgroup.json | [production] | 
            
  | 09:52 | <wmbot~taavi@tools-sgebastion-11> | toolforge jobs restart redis2irc | [tools.wikibugs] | 
            
  | 09:33 | <ladsgroup@cumin1002> | dbctl commit (dc=all): 'Depooling db2147 (T352010)', diff saved to https://phabricator.wikimedia.org/P56935 and previous config saved to /var/cache/conftool/dbconfig/20240218-093323-ladsgroup.json | [production] | 
            
  | 09:33 | <ladsgroup@cumin1002> | END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 1 day, 0:00:00 on db2147.codfw.wmnet with reason: Maintenance | [production] | 
            
  | 09:33 | <ladsgroup@cumin1002> | START - Cookbook sre.hosts.downtime for 1 day, 0:00:00 on db2147.codfw.wmnet with reason: Maintenance | [production] | 
            
  | 09:33 | <ladsgroup@cumin1002> | dbctl commit (dc=all): 'Repooling after maintenance db2140 (T352010)', diff saved to https://phabricator.wikimedia.org/P56934 and previous config saved to /var/cache/conftool/dbconfig/20240218-093301-ladsgroup.json | [production] | 
            
  | 09:17 | <ladsgroup@cumin1002> | dbctl commit (dc=all): 'Repooling after maintenance db2140', diff saved to https://phabricator.wikimedia.org/P56933 and previous config saved to /var/cache/conftool/dbconfig/20240218-091754-ladsgroup.json | [production] | 
            
  | 09:02 | <ladsgroup@cumin1002> | dbctl commit (dc=all): 'Repooling after maintenance db2140', diff saved to https://phabricator.wikimedia.org/P56932 and previous config saved to /var/cache/conftool/dbconfig/20240218-090248-ladsgroup.json | [production] | 
            
  | 08:47 | <ladsgroup@cumin1002> | dbctl commit (dc=all): 'Repooling after maintenance db2140 (T352010)', diff saved to https://phabricator.wikimedia.org/P56931 and previous config saved to /var/cache/conftool/dbconfig/20240218-084741-ladsgroup.json | [production] | 
            
  | 03:55 | <ladsgroup@cumin1002> | dbctl commit (dc=all): 'Depooling db2140 (T352010)', diff saved to https://phabricator.wikimedia.org/P56930 and previous config saved to /var/cache/conftool/dbconfig/20240218-035542-ladsgroup.json | [production] | 
            
  | 03:55 | <ladsgroup@cumin1002> | END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 1 day, 0:00:00 on db2140.codfw.wmnet with reason: Maintenance | [production] | 
            
  | 03:55 | <ladsgroup@cumin1002> | START - Cookbook sre.hosts.downtime for 1 day, 0:00:00 on db2140.codfw.wmnet with reason: Maintenance | [production] |