| 2019-09-20
      
      § | 
    
  | 21:30 | <urbanecm@deploy1001> | Synchronized php-1.34.0-wmf.22/extensions/CheckUser: fix T233453 (duration: 00m 56s) | [production] | 
            
  | 21:29 | <urbanecm@deploy1001> | Synchronized php-1.34.0-wmf.23/extensions/CheckUser: fix T233453 (duration: 00m 58s) | [production] | 
            
  | 19:26 | <XioNoX> | update eqsin firewall filters - T233268 | [production] | 
            
  | 16:35 | <krinkle@deploy1001> | Synchronized vendor/: ead70240892e9 (duration: 00m 59s) | [production] | 
            
  | 16:14 | <XioNoX> | update eqiad firewall filters - T233268 | [production] | 
            
  | 16:11 | <XioNoX> | update esams firewall filters - T233268 | [production] | 
            
  | 15:17 | <Urbanecm> | mwscript extensions/CentralAuth/maintenance/fixStuckGlobalRename.php --wiki=bgwiki --logwiki=metawiki 'Newrdkter' 'NRdk' (T233313) | [production] | 
            
  | 15:03 | <XioNoX> | remove AS-PATH prepending in ams | [production] | 
            
  | 11:29 | <@> | helmfile [STAGING] Ran 'sync' command on namespace 'restrouter' for release 'staging' . | [production] | 
            
  | 11:22 | <@> | helmfile [STAGING] Ran 'sync' command on namespace 'restrouter' for release 'staging' . | [production] | 
            
  | 11:22 | <@> | helmfile [STAGING] Ran 'sync' command on namespace 'restrouter' for release 'staging' . | [production] | 
            
  | 11:22 | <@> | helmfile [STAGING] Ran 'sync' command on namespace 'restrouter' for release 'staging' . | [production] | 
            
  | 11:16 | <@> | helmfile [STAGING] Ran 'sync' command on namespace 'restrouter' for release 'staging' . | [production] | 
            
  | 11:15 | <@> | helmfile [STAGING] Ran 'sync' command on namespace 'restrouter' for release 'staging' . | [production] | 
            
  | 10:17 | <jbond@cumin1001> | END (PASS) - Cookbook sre.hosts.ipmi-password-reset (exit_code=0) | [production] | 
            
  | 10:17 | <jbond@cumin1001> | Updating IPMI password on 1 hosts - jbond@cumin1001 | [production] | 
            
  | 10:17 | <jbond@cumin1001> | START - Cookbook sre.hosts.ipmi-password-reset | [production] | 
            
  | 10:17 | <jbond@cumin1001> | END (PASS) - Cookbook sre.hosts.ipmi-password-reset (exit_code=0) | [production] | 
            
  | 10:17 | <jbond@cumin1001> | Updating IPMI password on 1 hosts - jbond@cumin1001 | [production] | 
            
  | 10:17 | <jbond@cumin1001> | START - Cookbook sre.hosts.ipmi-password-reset | [production] | 
            
  | 10:17 | <jbond@cumin1001> | END (FAIL) - Cookbook sre.hosts.ipmi-password-reset (exit_code=99) | [production] | 
            
  | 10:17 | <jbond@cumin1001> | START - Cookbook sre.hosts.ipmi-password-reset | [production] | 
            
  | 09:31 | <jbond@cumin1001> | END (PASS) - Cookbook sre.hosts.ipmi-password-reset (exit_code=0) | [production] | 
            
  | 09:31 | <jbond@cumin1001> | Updating IPMI password on 1 hosts - jbond@cumin1001 | [production] | 
            
  | 09:31 | <jbond@cumin1001> | START - Cookbook sre.hosts.ipmi-password-reset | [production] | 
            
  | 09:30 | <jbond@cumin1001> | END (ERROR) - Cookbook sre.hosts.ipmi-password-reset (exit_code=97) | [production] | 
            
  | 09:30 | <jbond@cumin1001> | START - Cookbook sre.hosts.ipmi-password-reset | [production] | 
            
  | 09:30 | <jbond@cumin1001> | END (FAIL) - Cookbook sre.hosts.ipmi-password-reset (exit_code=99) | [production] | 
            
  | 09:30 | <jbond@cumin1001> | START - Cookbook sre.hosts.ipmi-password-reset | [production] | 
            
  | 08:52 | <jynus> | creating new database on m1 "bacula9" T229209 | [production] | 
            
  | 08:28 | <hashar> | Killed zuul-server process on contint2001 which was establishing connections to Gerrit and filling the pool of allowed ssh connections # T233390 | [production] | 
            
  | 08:23 | <hashar> | CI in default since it is somehow no more able to fetch from Gerrit T233390 | [production] | 
            
  | 08:20 | <hashar> | contint1001: upgrade zuul to 2.5.1-wmf10 # T203846 | [production] | 
            
  | 08:12 | <hashar> | contint2001: upgrade zuul to 2.5.1-wmf10 # T203846 | [production] | 
            
  | 07:46 | <jmm@cumin1001> | END (PASS) - Cookbook sre.hosts.decommission (exit_code=False) | [production] | 
            
  | 07:46 | <jmm@cumin1001> | START - Cookbook sre.hosts.decommission | [production] | 
            
  | 07:46 | <jmm@cumin1001> | END (PASS) - Cookbook sre.hosts.decommission (exit_code=False) | [production] | 
            
  | 07:45 | <jmm@cumin1001> | START - Cookbook sre.hosts.decommission | [production] | 
            
  | 07:29 | <marostegui@cumin1001> | END (PASS) - Cookbook sre.hosts.decommission (exit_code=False) | [production] | 
            
  | 07:28 | <marostegui@cumin1001> | START - Cookbook sre.hosts.decommission | [production] | 
            
  | 07:14 | <godog> | eqiad-prod: start ms-be1027 decom - T233289 | [production] | 
            
  | 05:29 | <marostegui@cumin1001> | dbctl commit (dc=all): 'Remove db1089 from logpager and contributions after testing, repool back with normal weight on main traffic T223151', diff saved to https://phabricator.wikimedia.org/P9136 and previous config saved to /var/cache/conftool/dbconfig/20190920-052902-marostegui.json | [production] | 
            
  | 05:27 | <marostegui> | Analyze table enwiki.logging on db2102 - T223151 | [production] | 
            
  | 05:07 | <marostegui> | Remove temporary index on hiwikisource views T219374 | [production] | 
            
  | 05:07 | <marostegui> | Remove temporary index on hiwikisource views /usr/local/sbin/maintain-views --databases $a --replace-all --clean | [production] |