| 
      
        2022-07-27
      
      §
     | 
  
    
  | 23:59 | 
  <tstarling@deploy1002> | 
  Synchronized wmf-config/InitialiseSettings.php: sync again now that scap proxy list is fixed T313730 T313496 (duration: 03m 25s) | 
  [production] | 
            
  | 23:49 | 
  <mwdebug-deploy@deploy1002> | 
  helmfile [codfw] DONE helmfile.d/services/mwdebug: apply | 
  [production] | 
            
  | 23:49 | 
  <mwdebug-deploy@deploy1002> | 
  helmfile [codfw] START helmfile.d/services/mwdebug: apply | 
  [production] | 
            
  | 23:49 | 
  <mwdebug-deploy@deploy1002> | 
  helmfile [eqiad] DONE helmfile.d/services/mwdebug: apply | 
  [production] | 
            
  | 23:48 | 
  <mwdebug-deploy@deploy1002> | 
  helmfile [eqiad] START helmfile.d/services/mwdebug: apply | 
  [production] | 
            
  | 23:45 | 
  <tstarling@deploy1002> | 
  Synchronized wmf-config/InitialiseSettings.php: move CentralAuth sessions to Kask T313496 (duration: 05m 34s) | 
  [production] | 
            
  | 23:45 | 
  <rzl@cumin2002> | 
  END (PASS) - Cookbook sre.hosts.decommission (exit_code=0) for hosts mw[2251-2255,2257-2258].codfw.wmnet | 
  [production] | 
            
  | 23:45 | 
  <rzl@cumin2002> | 
  END (PASS) - Cookbook sre.dns.netbox (exit_code=0) | 
  [production] | 
            
  | 23:43 | 
  <mwdebug-deploy@deploy1002> | 
  helmfile [codfw] DONE helmfile.d/services/mwdebug: apply | 
  [production] | 
            
  | 23:42 | 
  <mwdebug-deploy@deploy1002> | 
  helmfile [codfw] START helmfile.d/services/mwdebug: apply | 
  [production] | 
            
  | 23:42 | 
  <mwdebug-deploy@deploy1002> | 
  helmfile [eqiad] DONE helmfile.d/services/mwdebug: apply | 
  [production] | 
            
  | 23:41 | 
  <mwdebug-deploy@deploy1002> | 
  helmfile [eqiad] START helmfile.d/services/mwdebug: apply | 
  [production] | 
            
  | 23:38 | 
  <rzl@cumin2002> | 
  START - Cookbook sre.dns.netbox | 
  [production] | 
            
  | 23:36 | 
  <mwdebug-deploy@deploy1002> | 
  helmfile [codfw] DONE helmfile.d/services/mwdebug: apply | 
  [production] | 
            
  | 23:35 | 
  <mwdebug-deploy@deploy1002> | 
  helmfile [codfw] START helmfile.d/services/mwdebug: apply | 
  [production] | 
            
  | 23:35 | 
  <mwdebug-deploy@deploy1002> | 
  helmfile [eqiad] DONE helmfile.d/services/mwdebug: apply | 
  [production] | 
            
  | 23:34 | 
  <mwdebug-deploy@deploy1002> | 
  helmfile [eqiad] START helmfile.d/services/mwdebug: apply | 
  [production] | 
            
  | 23:29 | 
  <tstarling@deploy1002> | 
  Synchronized wmf-config/CommonSettings.php: increase wgObjectCacheSessionExpiry to 86400 (duration: 03m 30s) | 
  [production] | 
            
  | 23:29 | 
  <mwdebug-deploy@deploy1002> | 
  helmfile [codfw] DONE helmfile.d/services/mwdebug: apply | 
  [production] | 
            
  | 23:28 | 
  <mwdebug-deploy@deploy1002> | 
  helmfile [codfw] START helmfile.d/services/mwdebug: apply | 
  [production] | 
            
  | 23:28 | 
  <mwdebug-deploy@deploy1002> | 
  helmfile [eqiad] DONE helmfile.d/services/mwdebug: apply | 
  [production] | 
            
  | 23:27 | 
  <mwdebug-deploy@deploy1002> | 
  helmfile [eqiad] START helmfile.d/services/mwdebug: apply | 
  [production] | 
            
  | 23:26 | 
  <rzl@cumin2002> | 
  START - Cookbook sre.hosts.decommission for hosts mw[2251-2255,2257-2258].codfw.wmnet | 
  [production] | 
            
  | 23:18 | 
  <rzl@cumin2002> | 
  conftool action : set/pooled=inactive; selector: name=mw225[1-57-8].codfw.wmnet | 
  [production] | 
            
  | 23:17 | 
  <rzl@cumin2002> | 
  END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 2:00:00 on 7 hosts with reason: Decom | 
  [production] | 
            
  | 23:17 | 
  <rzl@cumin2002> | 
  START - Cookbook sre.hosts.downtime for 2:00:00 on 7 hosts with reason: Decom | 
  [production] | 
            
  | 23:14 | 
  <tstarling@deploy1002> | 
  helmfile [eqiad] DONE helmfile.d/services/sessionstore: apply | 
  [production] | 
            
  | 23:14 | 
  <tstarling@deploy1002> | 
  helmfile [eqiad] START helmfile.d/services/sessionstore: apply | 
  [production] | 
            
  | 23:14 | 
  <tstarling@deploy1002> | 
  helmfile [codfw] DONE helmfile.d/services/sessionstore: apply | 
  [production] | 
            
  | 23:13 | 
  <tstarling@deploy1002> | 
  helmfile [codfw] START helmfile.d/services/sessionstore: apply | 
  [production] | 
            
  | 23:13 | 
  <rzl@cumin2002> | 
  conftool action : set/pooled=no; selector: name=mw225[1-57-8].codfw.wmnet | 
  [production] | 
            
  | 23:08 | 
  <tstarling@deploy1002> | 
  helmfile [staging] DONE helmfile.d/services/sessionstore: apply | 
  [production] | 
            
  | 23:08 | 
  <tstarling@deploy1002> | 
  helmfile [staging] START helmfile.d/services/sessionstore: apply | 
  [production] | 
            
  | 22:11 | 
  <mwdebug-deploy@deploy1002> | 
  helmfile [codfw] DONE helmfile.d/services/mwdebug: apply | 
  [production] | 
            
  | 22:10 | 
  <mwdebug-deploy@deploy1002> | 
  helmfile [codfw] START helmfile.d/services/mwdebug: apply | 
  [production] | 
            
  | 22:10 | 
  <mwdebug-deploy@deploy1002> | 
  helmfile [eqiad] DONE helmfile.d/services/mwdebug: apply | 
  [production] | 
            
  | 22:09 | 
  <mwdebug-deploy@deploy1002> | 
  helmfile [eqiad] START helmfile.d/services/mwdebug: apply | 
  [production] | 
            
  | 22:08 | 
  <brennen@deploy1002> | 
  Synchronized php: group1 wikis to 1.39.0-wmf.22  refs T308075 (duration: 03m 08s) | 
  [production] | 
            
  | 22:05 | 
  <brennen@deploy1002> | 
  rebuilt and synchronized wikiversions files: group1 wikis to 1.39.0-wmf.22  refs T308075 | 
  [production] | 
            
  | 22:04 | 
  <mwdebug-deploy@deploy1002> | 
  helmfile [codfw] DONE helmfile.d/services/mwdebug: apply | 
  [production] | 
            
  | 22:03 | 
  <mwdebug-deploy@deploy1002> | 
  helmfile [codfw] START helmfile.d/services/mwdebug: apply | 
  [production] | 
            
  | 22:03 | 
  <mwdebug-deploy@deploy1002> | 
  helmfile [eqiad] DONE helmfile.d/services/mwdebug: apply | 
  [production] | 
            
  | 22:02 | 
  <mwdebug-deploy@deploy1002> | 
  helmfile [eqiad] START helmfile.d/services/mwdebug: apply | 
  [production] | 
            
  | 21:59 | 
  <brennen@deploy1002> | 
  Synchronized php-1.39.0-wmf.22/extensions/Translate/src/TtmServer: Backport: [[gerrit:817855|SearchTranslationsApi: Change the way we fetch TTM services (T313836)]] (duration: 03m 19s) | 
  [production] | 
            
  | 21:33 | 
  <cjming> | 
  end of UTC late backport window | 
  [production] | 
            
  | 21:32 | 
  <cjming@deploy1002> | 
  Synchronized php-1.39.0-wmf.22/extensions/TemplateWizard/resources/ext.TemplateWizard.Dialog.js: Backport: [[gerrit:817851|Delay template insertion until after closing the dialog (T33780)]] (duration: 03m 36s) | 
  [production] | 
            
  | 21:28 | 
  <cjming@deploy1002> | 
  Synchronized php-1.39.0-wmf.21/extensions/TemplateWizard/resources/ext.TemplateWizard.Dialog.js: Backport: [[gerrit:817850|Delay template insertion until after closing the dialog (T33780)]] (duration: 03m 27s) | 
  [production] | 
            
  | 21:27 | 
  <urandom> | 
  Removing reserved space on sessionstore storage volumes -- T313991 | 
  [production] |