| 2022-08-23
      
      ยง | 
    
  | 16:01 | <mwdebug-deploy@deploy1002> | helmfile [codfw] START helmfile.d/services/mwdebug: apply | [production] | 
            
  | 16:01 | <mwdebug-deploy@deploy1002> | helmfile [eqiad] DONE helmfile.d/services/mwdebug: apply | [production] | 
            
  | 16:00 | <mwdebug-deploy@deploy1002> | helmfile [eqiad] START helmfile.d/services/mwdebug: apply | [production] | 
            
  | 15:55 | <mwdebug-deploy@deploy1002> | helmfile [codfw] DONE helmfile.d/services/mwdebug: apply | [production] | 
            
  | 15:54 | <mwdebug-deploy@deploy1002> | helmfile [codfw] START helmfile.d/services/mwdebug: apply | [production] | 
            
  | 15:54 | <mwdebug-deploy@deploy1002> | helmfile [eqiad] DONE helmfile.d/services/mwdebug: apply | [production] | 
            
  | 15:50 | <marostegui@cumin1001> | dbctl commit (dc=all): 'db1160 (re)pooling @ 100%: Repooling after schema change', diff saved to https://phabricator.wikimedia.org/P32854 and previous config saved to /var/cache/conftool/dbconfig/20220823-155013-root.json | [production] | 
            
  | 15:49 | <mwdebug-deploy@deploy1002> | helmfile [eqiad] START helmfile.d/services/mwdebug: apply | [production] | 
            
  | 15:44 | <mwdebug-deploy@deploy1002> | helmfile [codfw] DONE helmfile.d/services/mwdebug: apply | [production] | 
            
  | 15:44 | <krinkle@deploy1002> | Synchronized wmf-config/: I1c5b0597817eb02 (duration: 03m 25s) | [production] | 
            
  | 15:43 | <mwdebug-deploy@deploy1002> | helmfile [codfw] START helmfile.d/services/mwdebug: apply | [production] | 
            
  | 15:43 | <mwdebug-deploy@deploy1002> | helmfile [eqiad] DONE helmfile.d/services/mwdebug: apply | [production] | 
            
  | 15:42 | <mwdebug-deploy@deploy1002> | helmfile [eqiad] START helmfile.d/services/mwdebug: apply | [production] | 
            
  | 15:41 | <mutante> | gerrit - service restart | [production] | 
            
  | 15:36 | <mutante> | gerrit2002 - service restart | [production] | 
            
  | 15:35 | <marostegui@cumin1001> | dbctl commit (dc=all): 'db1160 (re)pooling @ 75%: Repooling after schema change', diff saved to https://phabricator.wikimedia.org/P32853 and previous config saved to /var/cache/conftool/dbconfig/20220823-153508-root.json | [production] | 
            
  | 15:30 | <sbassett> | Deployed security patch for T307278 to wmf.25 | [production] | 
            
  | 15:25 | <sbassett> | Deployed security patch for T307278 to wmf.26 | [production] | 
            
  | 15:20 | <marostegui@cumin1001> | dbctl commit (dc=all): 'db1160 (re)pooling @ 50%: Repooling after schema change', diff saved to https://phabricator.wikimedia.org/P32852 and previous config saved to /var/cache/conftool/dbconfig/20220823-152003-root.json | [production] | 
            
  | 15:09 | <jmm@cumin2002> | END (PASS) - Cookbook sre.idm.logout (exit_code=0) Logging Dave Pifke out of all services on: 774 hosts | [production] | 
            
  | 15:09 | <jmm@cumin2002> | START - Cookbook sre.idm.logout Logging Dave Pifke out of all services on: 774 hosts | [production] | 
            
  | 15:08 | <jmm@cumin2002> | END (PASS) - Cookbook sre.idm.logout (exit_code=0) Logging Dave Pifke out of all services on: 1238 hosts | [production] | 
            
  | 15:08 | <jmm@cumin2002> | START - Cookbook sre.idm.logout Logging Dave Pifke out of all services on: 1238 hosts | [production] | 
            
  | 15:07 | <jmm@cumin2002> | END (PASS) - Cookbook sre.idm.logout (exit_code=0) Logging Erin Yener out of all services on: 774 hosts | [production] | 
            
  | 15:06 | <jmm@cumin2002> | START - Cookbook sre.idm.logout Logging Erin Yener out of all services on: 774 hosts | [production] | 
            
  | 15:06 | <jmm@cumin2002> | END (PASS) - Cookbook sre.idm.logout (exit_code=0) Logging Erin Yener out of all services on: 1238 hosts | [production] | 
            
  | 15:06 | <mutante> | gerrit - service restart - T315942 - added sshd.enableDeprecatedKexAlgorithms = true | [production] | 
            
  | 15:05 | <jmm@cumin2002> | START - Cookbook sre.idm.logout Logging Erin Yener out of all services on: 1238 hosts | [production] | 
            
  | 15:05 | <marostegui@cumin1001> | dbctl commit (dc=all): 'db1160 (re)pooling @ 25%: Repooling after schema change', diff saved to https://phabricator.wikimedia.org/P32851 and previous config saved to /var/cache/conftool/dbconfig/20220823-150459-root.json | [production] | 
            
  | 15:04 | <jmm@cumin2002> | END (PASS) - Cookbook sre.idm.logout (exit_code=0) Logging Effeietsanders out of all services on: 1238 hosts | [production] | 
            
  | 15:04 | <jmm@cumin2002> | START - Cookbook sre.idm.logout Logging Effeietsanders out of all services on: 1238 hosts | [production] | 
            
  | 15:04 | <jmm@cumin2002> | END (PASS) - Cookbook sre.idm.logout (exit_code=0) Logging Effeietsanders out of all services on: 774 hosts | [production] | 
            
  | 15:02 | <jmm@cumin2002> | START - Cookbook sre.idm.logout Logging Effeietsanders out of all services on: 774 hosts | [production] | 
            
  | 15:01 | <pt1979@cumin2002> | END (PASS) - Cookbook sre.dns.netbox (exit_code=0) | [production] | 
            
  | 14:58 | <pt1979@cumin2002> | START - Cookbook sre.dns.netbox | [production] | 
            
  | 14:57 | <mwdebug-deploy@deploy1002> | helmfile [codfw] DONE helmfile.d/services/mwdebug: apply | [production] | 
            
  | 14:56 | <mwdebug-deploy@deploy1002> | helmfile [codfw] START helmfile.d/services/mwdebug: apply | [production] | 
            
  | 14:56 | <mwdebug-deploy@deploy1002> | helmfile [eqiad] DONE helmfile.d/services/mwdebug: apply | [production] | 
            
  | 14:55 | <pt1979@cumin2002> | END (PASS) - Cookbook sre.dns.netbox (exit_code=0) | [production] | 
            
  | 14:51 | <mwdebug-deploy@deploy1002> | helmfile [eqiad] START helmfile.d/services/mwdebug: apply | [production] | 
            
  | 14:49 | <marostegui@cumin1001> | dbctl commit (dc=all): 'db1160 (re)pooling @ 10%: Repooling after schema change', diff saved to https://phabricator.wikimedia.org/P32850 and previous config saved to /var/cache/conftool/dbconfig/20220823-144954-root.json | [production] | 
            
  | 14:49 | <pt1979@cumin2002> | START - Cookbook sre.dns.netbox | [production] | 
            
  | 14:48 | <moritzm> | installing libtirpc security updates | [production] | 
            
  | 14:46 | <mwdebug-deploy@deploy1002> | helmfile [codfw] DONE helmfile.d/services/mwdebug: apply | [production] | 
            
  | 14:43 | <mwdebug-deploy@deploy1002> | helmfile [codfw] START helmfile.d/services/mwdebug: apply | [production] | 
            
  | 14:43 | <mwdebug-deploy@deploy1002> | helmfile [eqiad] DONE helmfile.d/services/mwdebug: apply | [production] | 
            
  | 14:42 | <urbanecm@deploy1002> | Synchronized wmf-config/InitialiseSettings.php: bcef1d56ef7c43e82121c7e70fae58784203e33d: Start writing to cuc_actor everywhere (T233004) (duration: 03m 18s) | [production] | 
            
  | 14:39 | <krinkle@deploy1002> | Synchronized wmf-config/redis.php: Ib9947993bd5710a4 (duration: 03m 47s) | [production] | 
            
  | 14:35 | <mwdebug-deploy@deploy1002> | helmfile [eqiad] START helmfile.d/services/mwdebug: apply | [production] | 
            
  | 14:34 | <marostegui@cumin1001> | dbctl commit (dc=all): 'db1160 (re)pooling @ 5%: Repooling after schema change', diff saved to https://phabricator.wikimedia.org/P32849 and previous config saved to /var/cache/conftool/dbconfig/20220823-143450-root.json | [production] |