| 
      
        2022-06-16
      
      ยง
     | 
  
    
  | 20:49 | 
  <mwdebug-deploy@deploy1002> | 
  helmfile [codfw] DONE helmfile.d/services/mwdebug: apply | 
  [production] | 
            
  | 20:48 | 
  <mwdebug-deploy@deploy1002> | 
  helmfile [codfw] START helmfile.d/services/mwdebug: apply | 
  [production] | 
            
  | 20:48 | 
  <mwdebug-deploy@deploy1002> | 
  helmfile [eqiad] DONE helmfile.d/services/mwdebug: apply | 
  [production] | 
            
  | 20:47 | 
  <mwdebug-deploy@deploy1002> | 
  helmfile [eqiad] START helmfile.d/services/mwdebug: apply | 
  [production] | 
            
  | 20:42 | 
  <mwdebug-deploy@deploy1002> | 
  helmfile [codfw] DONE helmfile.d/services/mwdebug: apply | 
  [production] | 
            
  | 20:42 | 
  <thcipriani@deploy1002> | 
  Started scap: Config: [[gerrit:806248|phpcs: enable PrefixedGlobalFunctions.allowedPrefix and rename functions (T171115)]] | 
  [production] | 
            
  | 20:41 | 
  <mwdebug-deploy@deploy1002> | 
  helmfile [codfw] START helmfile.d/services/mwdebug: apply | 
  [production] | 
            
  | 20:41 | 
  <mwdebug-deploy@deploy1002> | 
  helmfile [eqiad] DONE helmfile.d/services/mwdebug: apply | 
  [production] | 
            
  | 20:40 | 
  <mwdebug-deploy@deploy1002> | 
  helmfile [eqiad] START helmfile.d/services/mwdebug: apply | 
  [production] | 
            
  | 20:27 | 
  <cjming@deploy1002> | 
  Synchronized phpcs.xml: Config: [[gerrit:805432|phpcs: move SpaceBeforeSingleLineComment.NewLineComment exclusions (T171115)]] (duration: 03m 27s) | 
  [production] | 
            
  | 20:25 | 
  <mwdebug-deploy@deploy1002> | 
  helmfile [codfw] DONE helmfile.d/services/mwdebug: apply | 
  [production] | 
            
  | 20:24 | 
  <mwdebug-deploy@deploy1002> | 
  helmfile [codfw] START helmfile.d/services/mwdebug: apply | 
  [production] | 
            
  | 20:24 | 
  <mwdebug-deploy@deploy1002> | 
  helmfile [eqiad] DONE helmfile.d/services/mwdebug: apply | 
  [production] | 
            
  | 20:23 | 
  <mwdebug-deploy@deploy1002> | 
  helmfile [eqiad] START helmfile.d/services/mwdebug: apply | 
  [production] | 
            
  | 20:23 | 
  <cjming@deploy1002> | 
  Synchronized wmf-config/: Config: [[gerrit:805432|phpcs: move SpaceBeforeSingleLineComment.NewLineComment exclusions (T171115)]] (duration: 03m 22s) | 
  [production] | 
            
  | 20:18 | 
  <mwdebug-deploy@deploy1002> | 
  helmfile [codfw] DONE helmfile.d/services/mwdebug: apply | 
  [production] | 
            
  | 20:14 | 
  <mwdebug-deploy@deploy1002> | 
  helmfile [codfw] START helmfile.d/services/mwdebug: apply | 
  [production] | 
            
  | 20:14 | 
  <mwdebug-deploy@deploy1002> | 
  helmfile [eqiad] DONE helmfile.d/services/mwdebug: apply | 
  [production] | 
            
  | 20:13 | 
  <mwdebug-deploy@deploy1002> | 
  helmfile [eqiad] START helmfile.d/services/mwdebug: apply | 
  [production] | 
            
  | 20:12 | 
  <cjming@deploy1002> | 
  Synchronized wmf-config/InitialiseSettings.php: Config: [[gerrit:805179|Turn off TOC A/B test for pilot wikis (T309683)]] (duration: 03m 37s) | 
  [production] | 
            
  | 19:39 | 
  <aokoth@cumin1001> | 
  END (PASS) - Cookbook sre.hosts.decommission (exit_code=0) for hosts gitlab-runner2001.codfw.wmnet | 
  [production] | 
            
  | 19:39 | 
  <aokoth@cumin1001> | 
  END (FAIL) - Cookbook sre.dns.netbox (exit_code=99) | 
  [production] | 
            
  | 19:23 | 
  <aokoth@cumin1001> | 
  START - Cookbook sre.dns.netbox | 
  [production] | 
            
  | 19:03 | 
  <aokoth@cumin1001> | 
  START - Cookbook sre.hosts.decommission for hosts gitlab-runner2001.codfw.wmnet | 
  [production] | 
            
  | 19:00 | 
  <dzahn@cumin2002> | 
  END (FAIL) - Cookbook sre.hosts.decommission (exit_code=1) for hosts gitlab-runner1001.eqiad.wmnet | 
  [production] | 
            
  | 19:00 | 
  <dzahn@cumin2002> | 
  END (FAIL) - Cookbook sre.dns.netbox (exit_code=99) | 
  [production] | 
            
  | 18:57 | 
  <mwdebug-deploy@deploy1002> | 
  helmfile [codfw] DONE helmfile.d/services/mwdebug: apply | 
  [production] | 
            
  | 18:57 | 
  <dzahn@cumin2002> | 
  START - Cookbook sre.dns.netbox | 
  [production] | 
            
  | 18:55 | 
  <marostegui@cumin1001> | 
  dbctl commit (dc=all): 'Repooling after maintenance db1158 (T302659)', diff saved to https://phabricator.wikimedia.org/P29904 and previous config saved to /var/cache/conftool/dbconfig/20220616-185520-marostegui.json | 
  [production] | 
            
  | 18:54 | 
  <mwdebug-deploy@deploy1002> | 
  helmfile [codfw] START helmfile.d/services/mwdebug: apply | 
  [production] | 
            
  | 18:54 | 
  <mwdebug-deploy@deploy1002> | 
  helmfile [eqiad] DONE helmfile.d/services/mwdebug: apply | 
  [production] | 
            
  | 18:54 | 
  <dzahn@cumin2002> | 
  START - Cookbook sre.hosts.decommission for hosts gitlab-runner1001.eqiad.wmnet | 
  [production] | 
            
  | 18:53 | 
  <dzahn@cumin2002> | 
  END (PASS) - Cookbook sre.hosts.decommission (exit_code=0) for hosts gitlab-runner1001.eqiad.wmnet | 
  [production] | 
            
  | 18:53 | 
  <dzahn@cumin2002> | 
  END (FAIL) - Cookbook sre.dns.netbox (exit_code=99) | 
  [production] | 
            
  | 18:53 | 
  <mwdebug-deploy@deploy1002> | 
  helmfile [eqiad] START helmfile.d/services/mwdebug: apply | 
  [production] | 
            
  | 18:50 | 
  <dzahn@cumin2002> | 
  START - Cookbook sre.dns.netbox | 
  [production] | 
            
  | 18:49 | 
  <brennen@deploy1002> | 
  rebuilt and synchronized wikiversions files: all wikis to 1.39.0-wmf.16  refs T308069 | 
  [production] | 
            
  | 18:48 | 
  <mwdebug-deploy@deploy1002> | 
  helmfile [codfw] DONE helmfile.d/services/mwdebug: apply | 
  [production] | 
            
  | 18:44 | 
  <mwdebug-deploy@deploy1002> | 
  helmfile [codfw] START helmfile.d/services/mwdebug: apply | 
  [production] | 
            
  | 18:44 | 
  <brennen> | 
  train 1.39.0-wmf.16 (T308069): no current blockers - rolling to all wikis | 
  [production] | 
            
  | 18:44 | 
  <mwdebug-deploy@deploy1002> | 
  helmfile [eqiad] DONE helmfile.d/services/mwdebug: apply | 
  [production] | 
            
  | 18:42 | 
  <brennen@deploy1002> | 
  Synchronized php-1.39.0-wmf.16/extensions/CheckUser/src/Hooks.php: Backport: [[gerrit:806246|Only try to create User object if username is not null (T310747)]] (duration: 03m 23s) | 
  [production] | 
            
  | 18:40 | 
  <mwdebug-deploy@deploy1002> | 
  helmfile [eqiad] START helmfile.d/services/mwdebug: apply | 
  [production] | 
            
  | 18:40 | 
  <marostegui@cumin1001> | 
  dbctl commit (dc=all): 'Repooling after maintenance db1158', diff saved to https://phabricator.wikimedia.org/P29903 and previous config saved to /var/cache/conftool/dbconfig/20220616-184015-marostegui.json | 
  [production] | 
            
  | 18:29 | 
  <dzahn@cumin2002> | 
  START - Cookbook sre.hosts.decommission for hosts gitlab-runner1001.eqiad.wmnet | 
  [production] | 
            
  | 18:25 | 
  <marostegui@cumin1001> | 
  dbctl commit (dc=all): 'Repooling after maintenance db1158', diff saved to https://phabricator.wikimedia.org/P29902 and previous config saved to /var/cache/conftool/dbconfig/20220616-182510-marostegui.json | 
  [production] | 
            
  | 18:13 | 
  <btullis@deploy1002> | 
  helmfile [codfw] DONE helmfile.d/services/datahub: sync on main | 
  [production] | 
            
  | 18:12 | 
  <btullis@deploy1002> | 
  helmfile [codfw] START helmfile.d/services/datahub: sync on main | 
  [production] | 
            
  | 18:12 | 
  <btullis@deploy1002> | 
  helmfile [eqiad] DONE helmfile.d/services/datahub: sync on main | 
  [production] | 
            
  | 18:11 | 
  <btullis@deploy1002> | 
  helmfile [eqiad] START helmfile.d/services/datahub: sync on main | 
  [production] |