| 
      
        2023-08-24
      
      ยง
     | 
  
    
  | 07:42 | 
  <jayme@deploy1002> | 
  helmfile [eqiad] DONE helmfile.d/services/wikifunctions: apply | 
  [production] | 
            
  | 07:42 | 
  <ladsgroup@cumin1001> | 
  dbctl commit (dc=all): 'Repooling after maintenance db2138:3314 (T344589)', diff saved to https://phabricator.wikimedia.org/P51221 and previous config saved to /var/cache/conftool/dbconfig/20230824-074216-ladsgroup.json | 
  [production] | 
            
  | 07:41 | 
  <jmm@cumin2002> | 
  END (PASS) - Cookbook sre.hosts.reboot-single (exit_code=0) for host install6002.wikimedia.org | 
  [production] | 
            
  | 07:41 | 
  <jayme@deploy1002> | 
  helmfile [eqiad] START helmfile.d/services/wikifunctions: apply | 
  [production] | 
            
  | 07:41 | 
  <jayme@deploy1002> | 
  helmfile [codfw] DONE helmfile.d/services/wikifunctions: apply | 
  [production] | 
            
  | 07:39 | 
  <ladsgroup@cumin1001> | 
  dbctl commit (dc=all): 'Repooling after maintenance es1024', diff saved to https://phabricator.wikimedia.org/P51220 and previous config saved to /var/cache/conftool/dbconfig/20230824-073959-ladsgroup.json | 
  [production] | 
            
  | 07:39 | 
  <jayme@deploy1002> | 
  helmfile [codfw] START helmfile.d/services/wikifunctions: apply | 
  [production] | 
            
  | 07:39 | 
  <jayme@deploy1002> | 
  helmfile [codfw] DONE helmfile.d/admin 'apply'. | 
  [production] | 
            
  | 07:39 | 
  <jayme@deploy1002> | 
  helmfile [codfw] START helmfile.d/admin 'apply'. | 
  [production] | 
            
  | 07:39 | 
  <jayme@deploy1002> | 
  helmfile [eqiad] DONE helmfile.d/admin 'apply'. | 
  [production] | 
            
  | 07:38 | 
  <jayme@deploy1002> | 
  helmfile [eqiad] START helmfile.d/admin 'apply'. | 
  [production] | 
            
  | 07:37 | 
  <jmm@cumin2002> | 
  START - Cookbook sre.hosts.reboot-single for host install6002.wikimedia.org | 
  [production] | 
            
  | 07:35 | 
  <jmm@cumin2002> | 
  END (PASS) - Cookbook sre.hosts.reboot-single (exit_code=0) for host install5002.wikimedia.org | 
  [production] | 
            
  | 07:33 | 
  <ladsgroup@cumin1001> | 
  dbctl commit (dc=all): 'Repooling after maintenance db2138:3312 (T344589)', diff saved to https://phabricator.wikimedia.org/P51219 and previous config saved to /var/cache/conftool/dbconfig/20230824-073355-ladsgroup.json | 
  [production] | 
            
  | 07:33 | 
  <ladsgroup@cumin1001> | 
  dbctl commit (dc=all): 'Repooling after maintenance db1170:3317', diff saved to https://phabricator.wikimedia.org/P51218 and previous config saved to /var/cache/conftool/dbconfig/20230824-073304-ladsgroup.json | 
  [production] | 
            
  | 07:31 | 
  <jmm@cumin2002> | 
  START - Cookbook sre.hosts.reboot-single for host install5002.wikimedia.org | 
  [production] | 
            
  | 07:30 | 
  <apergos> | 
  UTC morning backport and config deployment window complete | 
  [production] | 
            
  | 07:30 | 
  <jmm@cumin2002> | 
  END (PASS) - Cookbook sre.hosts.reboot-single (exit_code=0) for host install4002.wikimedia.org | 
  [production] | 
            
  | 07:28 | 
  <ladsgroup@cumin1001> | 
  dbctl commit (dc=all): 'Repooling after maintenance db1188', diff saved to https://phabricator.wikimedia.org/P51217 and previous config saved to /var/cache/conftool/dbconfig/20230824-072829-ladsgroup.json | 
  [production] | 
            
  | 07:26 | 
  <jmm@cumin2002> | 
  START - Cookbook sre.hosts.reboot-single for host install4002.wikimedia.org | 
  [production] | 
            
  | 07:24 | 
  <ladsgroup@cumin1001> | 
  dbctl commit (dc=all): 'Repooling after maintenance es1024', diff saved to https://phabricator.wikimedia.org/P51216 and previous config saved to /var/cache/conftool/dbconfig/20230824-072453-ladsgroup.json | 
  [production] | 
            
  | 07:23 | 
  <ariel@deploy1002> | 
  Finished scap: Backport for [[gerrit:951914|[enwiktionary] Remove the Index and Index_talk namespaces (T344816)]] (duration: 10m 01s) | 
  [production] | 
            
  | 07:23 | 
  <ladsgroup@cumin1001> | 
  dbctl commit (dc=all): 'Deool es2025', diff saved to https://phabricator.wikimedia.org/P51215 and previous config saved to /var/cache/conftool/dbconfig/20230824-072301-ladsgroup.json | 
  [production] | 
            
  | 07:22 | 
  <jayme@deploy1002> | 
  helmfile [staging-eqiad] DONE helmfile.d/admin 'apply'. | 
  [production] | 
            
  | 07:22 | 
  <jayme@deploy1002> | 
  helmfile [staging-eqiad] START helmfile.d/admin 'apply'. | 
  [production] | 
            
  | 07:21 | 
  <jmm@cumin2002> | 
  END (PASS) - Cookbook sre.hosts.reboot-single (exit_code=0) for host install3003.wikimedia.org | 
  [production] | 
            
  | 07:18 | 
  <ladsgroup@cumin1001> | 
  dbctl commit (dc=all): 'Repooling after maintenance db2138:3312', diff saved to https://phabricator.wikimedia.org/P51214 and previous config saved to /var/cache/conftool/dbconfig/20230824-071849-ladsgroup.json | 
  [production] | 
            
  | 07:17 | 
  <ladsgroup@cumin1001> | 
  dbctl commit (dc=all): 'Repooling after maintenance db1170:3317 (T343718)', diff saved to https://phabricator.wikimedia.org/P51213 and previous config saved to /var/cache/conftool/dbconfig/20230824-071757-ladsgroup.json | 
  [production] | 
            
  | 07:17 | 
  <ariel@deploy1002> | 
  zoranzoki21 and ariel: Continuing with sync | 
  [production] | 
            
  | 07:14 | 
  <ariel@deploy1002> | 
  zoranzoki21 and ariel: Backport for [[gerrit:951914|[enwiktionary] Remove the Index and Index_talk namespaces (T344816)]] synced to the testservers mwdebug2001.codfw.wmnet, mwdebug1001.eqiad.wmnet, mwdebug2002.codfw.wmnet, mwdebug1002.eqiad.wmnet, and mw-debug kubernetes deployment (accessible via k8s-experimental XWD option) | 
  [production] | 
            
  | 07:14 | 
  <jmm@cumin2002> | 
  START - Cookbook sre.hosts.reboot-single for host install3003.wikimedia.org | 
  [production] | 
            
  | 07:13 | 
  <ladsgroup@cumin1001> | 
  dbctl commit (dc=all): 'Repooling after maintenance db1188 (T344589)', diff saved to https://phabricator.wikimedia.org/P51212 and previous config saved to /var/cache/conftool/dbconfig/20230824-071323-ladsgroup.json | 
  [production] | 
            
  | 07:13 | 
  <ariel@deploy1002> | 
  Started scap: Backport for [[gerrit:951914|[enwiktionary] Remove the Index and Index_talk namespaces (T344816)]] | 
  [production] | 
            
  | 07:12 | 
  <ladsgroup@cumin1001> | 
  dbctl commit (dc=all): 'Repooling after maintenance db2179 (T344589)', diff saved to https://phabricator.wikimedia.org/P51211 and previous config saved to /var/cache/conftool/dbconfig/20230824-071204-ladsgroup.json | 
  [production] | 
            
  | 07:09 | 
  <jayme@deploy1002> | 
  helmfile [staging] DONE helmfile.d/services/wikifunctions: apply | 
  [production] | 
            
  | 07:09 | 
  <ladsgroup@cumin1001> | 
  dbctl commit (dc=all): 'Repooling after maintenance es1024 (T344589)', diff saved to https://phabricator.wikimedia.org/P51210 and previous config saved to /var/cache/conftool/dbconfig/20230824-070946-ladsgroup.json | 
  [production] | 
            
  | 07:08 | 
  <jayme@deploy1002> | 
  helmfile [staging] START helmfile.d/services/wikifunctions: apply | 
  [production] | 
            
  | 07:07 | 
  <ladsgroup@cumin1001> | 
  dbctl commit (dc=all): 'Depooling db2121 (T343718)', diff saved to https://phabricator.wikimedia.org/P51209 and previous config saved to /var/cache/conftool/dbconfig/20230824-070723-ladsgroup.json | 
  [production] | 
            
  | 07:07 | 
  <ladsgroup@cumin1001> | 
  END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 1 day, 0:00:00 on db2121.codfw.wmnet with reason: Maintenance | 
  [production] | 
            
  | 07:07 | 
  <ladsgroup@cumin1001> | 
  dbctl commit (dc=all): 'Depooling db1188 (T344589)', diff saved to https://phabricator.wikimedia.org/P51208 and previous config saved to /var/cache/conftool/dbconfig/20230824-070710-ladsgroup.json | 
  [production] | 
            
  | 07:07 | 
  <ladsgroup@cumin1001> | 
  END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 1 day, 0:00:00 on db1188.eqiad.wmnet with reason: Maintenance | 
  [production] | 
            
  | 07:07 | 
  <ladsgroup@cumin1001> | 
  START - Cookbook sre.hosts.downtime for 1 day, 0:00:00 on db2121.codfw.wmnet with reason: Maintenance | 
  [production] | 
            
  | 07:07 | 
  <ladsgroup@cumin1001> | 
  dbctl commit (dc=all): 'Repooling after maintenance db2120 (T343718)', diff saved to https://phabricator.wikimedia.org/P51207 and previous config saved to /var/cache/conftool/dbconfig/20230824-070702-ladsgroup.json | 
  [production] | 
            
  | 07:06 | 
  <ladsgroup@cumin1001> | 
  START - Cookbook sre.hosts.downtime for 1 day, 0:00:00 on db1188.eqiad.wmnet with reason: Maintenance | 
  [production] | 
            
  | 07:06 | 
  <ladsgroup@cumin1001> | 
  dbctl commit (dc=all): 'Repooling after maintenance db1182 (T344589)', diff saved to https://phabricator.wikimedia.org/P51206 and previous config saved to /var/cache/conftool/dbconfig/20230824-070646-ladsgroup.json | 
  [production] | 
            
  | 07:05 | 
  <jmm@cumin2002> | 
  END (PASS) - Cookbook sre.hosts.reboot-single (exit_code=0) for host install2004.wikimedia.org | 
  [production] | 
            
  | 07:04 | 
  <ladsgroup@cumin1001> | 
  dbctl commit (dc=all): 'Pool es2025', diff saved to https://phabricator.wikimedia.org/P51205 and previous config saved to /var/cache/conftool/dbconfig/20230824-070417-ladsgroup.json | 
  [production] | 
            
  | 07:03 | 
  <ladsgroup@cumin1001> | 
  dbctl commit (dc=all): 'Repooling after maintenance db2138:3312', diff saved to https://phabricator.wikimedia.org/P51204 and previous config saved to /var/cache/conftool/dbconfig/20230824-070343-ladsgroup.json | 
  [production] | 
            
  | 07:03 | 
  <ladsgroup@cumin1001> | 
  dbctl commit (dc=all): 'Depooling es2025 (T344589)', diff saved to https://phabricator.wikimedia.org/P51203 and previous config saved to /var/cache/conftool/dbconfig/20230824-070332-ladsgroup.json | 
  [production] | 
            
  | 07:03 | 
  <ladsgroup@cumin1001> | 
  END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 1 day, 0:00:00 on es2025.codfw.wmnet with reason: Maintenance | 
  [production] |