| 2020-10-29
      
      ยง | 
    
  | 23:59 | <eileen> | process-control config revision is 6891d35bce | [production] | 
            
  | 23:39 | <Urbanecm> | Evening B&C window done | [production] | 
            
  | 23:38 | <Urbanecm> | urbanecm@mwmaint1002:~$ mwscript namespaceDupes.php --wiki=trwikiquote --add-prefix=BROKEN --fix # T266605 # P13112 | [production] | 
            
  | 23:37 | <urbanecm@deploy1001> | Synchronized wmf-config/InitialiseSettings.php: ddb7e08e9c1d07f704c9f7585d8b6089f1895b5c: Add namespace aliases to Turkish Wikiquote (T266605) (duration: 00m 57s) | [production] | 
            
  | 23:36 | <eileen> | process-control config revision is 1114512f90 | [production] | 
            
  | 23:29 | <Urbanecm> | urbanecm@mwmaint1002:~$ mwscript namespaceDupes.php --wiki=trwikisource --add-prefix=BROKEN --fix # T266606 # P13111 | [production] | 
            
  | 23:27 | <urbanecm@deploy1001> | Synchronized wmf-config/InitialiseSettings.php: c3a8555154673c4c5a65f6ec2a1219d0832f48e0: Add namespace aliases to Turkish Wikisource (T266606) (duration: 00m 56s) | [production] | 
            
  | 23:23 | <Urbanecm> | urbanecm@mwmaint1002:~$ mwscript namespaceDupes.php --wiki=trwikibooks --fix # T266608 | [production] | 
            
  | 23:22 | <urbanecm@deploy1001> | Synchronized wmf-config/InitialiseSettings.php: 1800d11ec8c07ff6ccffe0fd03ce11e6786f8a6e: Add namespace aliases to Turkish Wikibooks (T266608) (duration: 00m 57s) | [production] | 
            
  | 23:22 | <eileen> | civicrm revision changed from e1d65b0f3a to 3317d30356, config revision is d70fe02cb9 | [production] | 
            
  | 23:18 | <Urbanecm> | urbanecm@mwmaint1002:~$ mwscript namespaceDupes.php --wiki=trwiktionary --fix     # T266609 | [production] | 
            
  | 23:17 | <urbanecm@deploy1001> | Synchronized wmf-config/InitialiseSettings.php: 090f75730727e7a3ca5a85af0ff9071213dd047f: Add namespace aliases to Turkish Wiktionary (T266609) (duration: 00m 58s) | [production] | 
            
  | 22:35 | <mutante> | mw1268 - depooled for T266164 | [production] | 
            
  | 22:34 | <dzahn@cumin1001> | conftool action : set/pooled=no; selector: name=mw1268.eqiad.wmnet | [production] | 
            
  | 22:33 | <dzahn@cumin1001> | END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) | [production] | 
            
  | 22:33 | <dzahn@cumin1001> | START - Cookbook sre.hosts.downtime | [production] | 
            
  | 22:32 | <mutante> | mw1269 rsyncd/ferm for scap proxy was enabled - mw1268 rsyncd/ferm for scan proxy was removed - deploy1001 scap-proxies dsh group was adjusted | [production] | 
            
  | 22:21 | <mutante> | replacing scap proxy for rack A7 eqiad because mw1268 needs to move physically (T266164) | [production] | 
            
  | 22:21 | <bstorm> | updated packages for thirdparty/kubeadm-k8s-1-17 to prepare for install T263284 | [production] | 
            
  | 22:10 | <razzi@cumin1001> | END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) | [production] | 
            
  | 22:08 | <razzi@cumin1001> | START - Cookbook sre.hosts.downtime | [production] | 
            
  | 22:07 | <dzahn@cumin1001> | END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) | [production] | 
            
  | 22:07 | <dzahn@cumin1001> | START - Cookbook sre.hosts.downtime | [production] | 
            
  | 22:06 | <mutante> | depooled mw1267 (T266164) | [production] | 
            
  | 22:06 | <dzahn@cumin1001> | conftool action : set/pooled=no; selector: name=mw1267.eqiad.wmnet | [production] | 
            
  | 22:04 | <mutante> | scandium - puppet disabled again (but only until tomorrow), downtimed in Icinga, for ongoing parsoid tests from testreduce1001 | [production] | 
            
  | 22:03 | <dzahn@cumin1001> | END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) | [production] | 
            
  | 22:03 | <dzahn@cumin1001> | START - Cookbook sre.hosts.downtime | [production] | 
            
  | 20:52 | <robh@cumin1001> | END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) | [production] | 
            
  | 20:50 | <robh@cumin1001> | START - Cookbook sre.hosts.downtime | [production] | 
            
  | 20:23 | <herron@cumin1001> | END (PASS) - Cookbook sre.dns.netbox (exit_code=0) | [production] | 
            
  | 20:17 | <herron@cumin1001> | START - Cookbook sre.dns.netbox | [production] | 
            
  | 20:09 | <robh@cumin1001> | END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) | [production] | 
            
  | 20:08 | <robh@cumin1001> | END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) | [production] | 
            
  | 20:06 | <robh@cumin1001> | END (FAIL) - Cookbook sre.hosts.downtime (exit_code=99) | [production] | 
            
  | 20:06 | <robh@cumin1001> | START - Cookbook sre.hosts.downtime | [production] | 
            
  | 20:06 | <robh@cumin1001> | START - Cookbook sre.hosts.downtime | [production] | 
            
  | 20:06 | <robh@cumin1001> | START - Cookbook sre.hosts.downtime | [production] | 
            
  | 19:31 | <cdanis@cumin1001> | END (PASS) - Cookbook sre.network.cf (exit_code=0) | [production] | 
            
  | 19:31 | <cdanis@cumin1001> | START - Cookbook sre.network.cf | [production] | 
            
  | 19:25 | <hnowlan@cumin1001> | END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) | [production] | 
            
  | 19:25 | <hnowlan@cumin1001> | START - Cookbook sre.hosts.downtime | [production] | 
            
  | 19:22 | <Urbanecm> | Start of `mwscript extensions/AbuseFilter/maintenance/updateVarDumps.php --wiki=$wiki --print-orphaned-records-to=/tmp/urbanecm/$wiki-orphaned.log --progress-markers > $wiki.log` in a tmux session on mwmaint1002 (wiki=ukwiki; T246539) | [production] | 
            
  | 19:13 | <Amir1> | rolling restart of ores uwsgi | [production] | 
            
  | 19:00 | <robh@cumin1001> | END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) | [production] | 
            
  | 18:58 | <robh@cumin1001> | START - Cookbook sre.hosts.downtime | [production] | 
            
  | 18:16 | <herron@cumin1001> | END (ERROR) - Cookbook sre.ganeti.makevm (exit_code=97) | [production] | 
            
  | 18:13 | <urbanecm@deploy1001> | Synchronized wmf-config/InitialiseSettings.php: Enable WikiLove on hewikiquote (T266744) (duration: 00m 57s) | [production] | 
            
  | 18:09 | <herron@cumin1001> | START - Cookbook sre.ganeti.makevm | [production] | 
            
  | 18:07 | <herron@cumin1001> | END (FAIL) - Cookbook sre.ganeti.makevm (exit_code=99) | [production] |