| 
      
        2024-04-01
      
      §
     | 
  
    
  | 05:14 | 
  <marostegui@cumin1002> | 
  dbctl commit (dc=all): 'Depooling db1165 (T356166)', diff saved to https://phabricator.wikimedia.org/P59041 and previous config saved to /var/cache/conftool/dbconfig/20240401-051402-marostegui.json | 
  [production] | 
            
  | 05:13 | 
  <marostegui@cumin1002> | 
  END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 16:00:00 on clouddb[1015,1019,1021].eqiad.wmnet,db1155.eqiad.wmnet with reason: Maintenance | 
  [production] | 
            
  | 05:13 | 
  <marostegui@cumin1002> | 
  START - Cookbook sre.hosts.downtime for 16:00:00 on clouddb[1015,1019,1021].eqiad.wmnet,db1155.eqiad.wmnet with reason: Maintenance | 
  [production] | 
            
  | 05:13 | 
  <marostegui@cumin1002> | 
  END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 8:00:00 on db1165.eqiad.wmnet with reason: Maintenance | 
  [production] | 
            
  | 05:13 | 
  <marostegui@cumin1002> | 
  START - Cookbook sre.hosts.downtime for 8:00:00 on db1165.eqiad.wmnet with reason: Maintenance | 
  [production] | 
            
  | 05:03 | 
  <marostegui@cumin1002> | 
  END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 5:00:00 on 9 hosts with reason: Fixing intermediate master | 
  [production] | 
            
  | 05:03 | 
  <marostegui@cumin1002> | 
  START - Cookbook sre.hosts.downtime for 5:00:00 on 9 hosts with reason: Fixing intermediate master | 
  [production] | 
            
  | 02:17 | 
  <wmbot~anticomposite@tools-sgebastion-10> | 
  ./stewardbots/StewardBot/manage.sh restart # RC reader not reading RC | 
  [tools.stewardbots] | 
            
  | 02:12 | 
  <wmbot~anticomposite@tools-sgebastion-10> | 
  SULWatcher/manage.sh restart # SULWatchers disconnected | 
  [tools.stewardbots] | 
            
  
    | 
      
        2024-03-31
      
      §
     | 
  
    
  | 23:20 | 
  <wmbot~bd808@tools-bastion-12> | 
  Updated all to f31b4bd and buildservice for everything (T360860) | 
  [tools.wikibugs] | 
            
  | 23:16 | 
  <wikibugs> | 
  Updated gerrit-channels.yaml to: f31b4bd1456762a012ed0c2059a12832beac3ff0 channelfilter: fix self._read_from_url call | 
  [tools.wikibugs] | 
            
  | 21:05 | 
  <ladsgroup@cumin1002> | 
  END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 1 day, 0:00:00 on dbstore1008.eqiad.wmnet with reason: Maintenance | 
  [production] | 
            
  | 21:05 | 
  <ladsgroup@cumin1002> | 
  START - Cookbook sre.hosts.downtime for 1 day, 0:00:00 on dbstore1008.eqiad.wmnet with reason: Maintenance | 
  [production] | 
            
  | 21:05 | 
  <ladsgroup@cumin1002> | 
  dbctl commit (dc=all): 'Repooling after maintenance db1236 (T352010)', diff saved to https://phabricator.wikimedia.org/P59040 and previous config saved to /var/cache/conftool/dbconfig/20240331-210533-ladsgroup.json | 
  [production] | 
            
  | 20:50 | 
  <ladsgroup@cumin1002> | 
  dbctl commit (dc=all): 'Repooling after maintenance db1236', diff saved to https://phabricator.wikimedia.org/P59039 and previous config saved to /var/cache/conftool/dbconfig/20240331-205025-ladsgroup.json | 
  [production] | 
            
  | 20:35 | 
  <ladsgroup@cumin1002> | 
  dbctl commit (dc=all): 'Repooling after maintenance db1236', diff saved to https://phabricator.wikimedia.org/P59038 and previous config saved to /var/cache/conftool/dbconfig/20240331-203518-ladsgroup.json | 
  [production] | 
            
  | 20:20 | 
  <ladsgroup@cumin1002> | 
  dbctl commit (dc=all): 'Repooling after maintenance db1236 (T352010)', diff saved to https://phabricator.wikimedia.org/P59037 and previous config saved to /var/cache/conftool/dbconfig/20240331-202010-ladsgroup.json | 
  [production] | 
            
  | 15:52 | 
  <wmbot~mdaniels5757@tools-sgebastion-10> | 
  Restarted all jobs because Testing restart script | 
  [tools.commons-delinquent] | 
            
  | 12:18 | 
  <ladsgroup@cumin1002> | 
  dbctl commit (dc=all): 'Depooling db1236 (T352010)', diff saved to https://phabricator.wikimedia.org/P59036 and previous config saved to /var/cache/conftool/dbconfig/20240331-121815-ladsgroup.json | 
  [production] | 
            
  | 12:18 | 
  <ladsgroup@cumin1002> | 
  END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 1 day, 0:00:00 on db1236.eqiad.wmnet with reason: Maintenance | 
  [production] | 
            
  | 12:17 | 
  <ladsgroup@cumin1002> | 
  START - Cookbook sre.hosts.downtime for 1 day, 0:00:00 on db1236.eqiad.wmnet with reason: Maintenance | 
  [production] | 
            
  | 12:17 | 
  <ladsgroup@cumin1002> | 
  dbctl commit (dc=all): 'Repooling after maintenance db1227 (T352010)', diff saved to https://phabricator.wikimedia.org/P59035 and previous config saved to /var/cache/conftool/dbconfig/20240331-121751-ladsgroup.json | 
  [production] | 
            
  | 12:02 | 
  <ladsgroup@cumin1002> | 
  dbctl commit (dc=all): 'Repooling after maintenance db1227', diff saved to https://phabricator.wikimedia.org/P59034 and previous config saved to /var/cache/conftool/dbconfig/20240331-120243-ladsgroup.json | 
  [production] | 
            
  | 11:47 | 
  <ladsgroup@cumin1002> | 
  dbctl commit (dc=all): 'Repooling after maintenance db1227', diff saved to https://phabricator.wikimedia.org/P59033 and previous config saved to /var/cache/conftool/dbconfig/20240331-114736-ladsgroup.json | 
  [production] | 
            
  | 11:32 | 
  <ladsgroup@cumin1002> | 
  dbctl commit (dc=all): 'Repooling after maintenance db1227 (T352010)', diff saved to https://phabricator.wikimedia.org/P59032 and previous config saved to /var/cache/conftool/dbconfig/20240331-113228-ladsgroup.json | 
  [production] | 
            
  | 05:53 | 
  <DannyS712> | 
  disabled, gerrit now allows this (since v3.7) | 
  [tools.force-rebase] | 
            
  | 05:43 | 
  <DannyS712> | 
  restart Redirect patrolling, enwikivoyage graffiti wall, and remindme | 
  [tools.dannys712-bot] | 
            
  | 01:54 | 
  <wmbot~anticomposite@tools-sgebastion-10> | 
  ./stewardbots/StewardBot/manage.sh restart # RC reader not reading RC | 
  [tools.stewardbots] | 
            
  | 01:54 | 
  <wmbot~melos@tools-sgebastion-10> | 
  SULWatcher/manage.sh restart # SULWatchers disconnected | 
  [tools.stewardbots] | 
            
  | 01:54 | 
  <wmbot~anticomposite@tools-sgebastion-10> | 
  SULWatcher/manage.sh restart # SULWatchers disconnected | 
  [tools.stewardbots] | 
            
  | 00:01 | 
  <ladsgroup@cumin1002> | 
  dbctl commit (dc=all): 'Depooling db1227 (T352010)', diff saved to https://phabricator.wikimedia.org/P59031 and previous config saved to /var/cache/conftool/dbconfig/20240331-000134-ladsgroup.json | 
  [production] | 
            
  | 00:01 | 
  <ladsgroup@cumin1002> | 
  END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 1 day, 0:00:00 on db1227.eqiad.wmnet with reason: Maintenance | 
  [production] | 
            
  | 00:01 | 
  <ladsgroup@cumin1002> | 
  START - Cookbook sre.hosts.downtime for 1 day, 0:00:00 on db1227.eqiad.wmnet with reason: Maintenance | 
  [production] | 
            
  | 00:01 | 
  <ladsgroup@cumin1002> | 
  dbctl commit (dc=all): 'Repooling after maintenance db1202 (T352010)', diff saved to https://phabricator.wikimedia.org/P59030 and previous config saved to /var/cache/conftool/dbconfig/20240331-000112-ladsgroup.json | 
  [production] | 
            
  
    | 
      
        2024-03-30
      
      §
     | 
  
    
  | 23:46 | 
  <ladsgroup@cumin1002> | 
  dbctl commit (dc=all): 'Repooling after maintenance db1202', diff saved to https://phabricator.wikimedia.org/P59029 and previous config saved to /var/cache/conftool/dbconfig/20240330-234604-ladsgroup.json | 
  [production] | 
            
  | 23:30 | 
  <ladsgroup@cumin1002> | 
  dbctl commit (dc=all): 'Repooling after maintenance db1202', diff saved to https://phabricator.wikimedia.org/P59028 and previous config saved to /var/cache/conftool/dbconfig/20240330-233056-ladsgroup.json | 
  [production] | 
            
  | 23:15 | 
  <ladsgroup@cumin1002> | 
  dbctl commit (dc=all): 'Repooling after maintenance db1202 (T352010)', diff saved to https://phabricator.wikimedia.org/P59027 and previous config saved to /var/cache/conftool/dbconfig/20240330-231549-ladsgroup.json | 
  [production] | 
            
  | 22:02 | 
  <Krinkle> | 
  Reloading Zuul to deploy https://gerrit.wikimedia.org/r/1015597, T361412 | 
  [releng] | 
            
  | 22:02 | 
  <Krinkle> | 
  Reloading Zuul to deploy https://gerrit.wikimedia.org/r/1015632, T331817 | 
  [releng] | 
            
  | 22:02 | 
  <Krinkle> | 
  Reloading Zuul to deploy Ic3d0d473270, T249949 | 
  [releng] | 
            
  | 14:24 | 
  <wmbot~melos@tools-sgebastion-10> | 
  ./stewardbots/StewardBot/manage.sh restart # RC reader not reading RC | 
  [tools.stewardbots] | 
            
  | 14:22 | 
  <wmbot~melos@tools-sgebastion-10> | 
  SULWatcher/manage.sh restart # SULWatchers disconnected | 
  [tools.stewardbots] | 
            
  | 13:31 | 
  <ladsgroup@cumin1002> | 
  dbctl commit (dc=all): 'Depooling db1202 (T352010)', diff saved to https://phabricator.wikimedia.org/P59026 and previous config saved to /var/cache/conftool/dbconfig/20240330-133129-ladsgroup.json | 
  [production] | 
            
  | 13:31 | 
  <ladsgroup@cumin1002> | 
  END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 1 day, 0:00:00 on db1202.eqiad.wmnet with reason: Maintenance | 
  [production] | 
            
  | 13:31 | 
  <ladsgroup@cumin1002> | 
  START - Cookbook sre.hosts.downtime for 1 day, 0:00:00 on db1202.eqiad.wmnet with reason: Maintenance | 
  [production] | 
            
  | 13:31 | 
  <ladsgroup@cumin1002> | 
  dbctl commit (dc=all): 'Repooling after maintenance db1194 (T352010)', diff saved to https://phabricator.wikimedia.org/P59025 and previous config saved to /var/cache/conftool/dbconfig/20240330-133116-ladsgroup.json | 
  [production] | 
            
  | 13:16 | 
  <ladsgroup@cumin1002> | 
  dbctl commit (dc=all): 'Repooling after maintenance db1194', diff saved to https://phabricator.wikimedia.org/P59024 and previous config saved to /var/cache/conftool/dbconfig/20240330-131609-ladsgroup.json | 
  [production] | 
            
  | 13:01 | 
  <ladsgroup@cumin1002> | 
  dbctl commit (dc=all): 'Repooling after maintenance db1194', diff saved to https://phabricator.wikimedia.org/P59023 and previous config saved to /var/cache/conftool/dbconfig/20240330-130102-ladsgroup.json | 
  [production] | 
            
  | 12:45 | 
  <ladsgroup@cumin1002> | 
  dbctl commit (dc=all): 'Repooling after maintenance db1194 (T352010)', diff saved to https://phabricator.wikimedia.org/P59022 and previous config saved to /var/cache/conftool/dbconfig/20240330-124554-ladsgroup.json | 
  [production] | 
            
  | 05:19 | 
  <TimStarling> | 
  on releases1003 uploaded mediawiki 1.19.0 - 1.19.8, 1.20.0 - 1.20.6 T190369 | 
  [production] |