| 2017-10-04
      
      ยง | 
    
  | 14:47 | <XioNoX> | replacing faulty VC cable on fasw-c-eqiad | [production] | 
            
  | 14:45 | <bblack> | base package upgrades (+autoremove) on lvs3001-2 | [production] | 
            
  | 14:43 | <bblack> | base package upgrades (+autoremove) on lvs3004 | [production] | 
            
  | 14:41 | <bblack> | base package upgrades (+autoremove) on lvs3003 | [production] | 
            
  | 14:24 | <bblack> | upgrading nginx to 1.13.5-1+wmf1~jessie1 on cp4021 (first live cache, upload@ulsfo) | [production] | 
            
  | 14:18 | <bblack> | base package upgrades (+autoremove) on lvs2* | [production] | 
            
  | 14:10 | <bblack> | base package upgrades (+autoremove) on lvs4* | [production] | 
            
  | 13:47 | <zeljkof> | EU SWAT finished | [production] | 
            
  | 13:46 | <zfilipin@tin> | Synchronized php-1.31.0-wmf.2/extensions/Translate/tag/PageTranslationHooks.php: SWAT: [[gerrit:382095|Revert "Use Language type hint in hooks" (T177352)]] (duration: 00m 50s) | [production] | 
            
  | 13:45 | <zfilipin@tin> | Synchronized php-1.31.0-wmf.2/extensions/Translate/TranslateHooks.php: SWAT: [[gerrit:382095|Revert "Use Language type hint in hooks" (T177352)]] (duration: 00m 50s) | [production] | 
            
  | 13:41 | <zfilipin@tin> | Synchronized php-1.31.0-wmf.2/extensions/Translate/TranslateHooks.php: php-1.31.0-wmf.2/extensions/Translate/tag/PageTranslationHooks.php SWAT: [[gerrit:382095|Revert "Use Language type hint in hooks" (T177352)]] (duration: 00m 52s) | [production] | 
            
  | 13:26 | <zeljkof> | one more commit for EU SWAT | [production] | 
            
  | 13:26 | <marostegui> | Optimize table ores_classification on enwiki codfw master db2048 with replication - might generate lag - T159753 | [production] | 
            
  | 13:22 | <marostegui> | Optimize enwiki.ores_classification on db2069 | [production] | 
            
  | 13:06 | <zeljkof> | EU SWAT finished | [production] | 
            
  | 13:05 | <zfilipin@tin> | Synchronized wmf-config/throttle.php: SWAT: [[gerrit:382116|New throttle rule (T177370)]] (duration: 00m 53s) | [production] | 
            
  | 12:59 | <jynus> | upgrade and reboot labsdb1009 | [production] | 
            
  | 12:56 | <marostegui> | Optimize templatelinks and pagelinks tables on s2 and s7 - labsdb1010 - T174509 | [production] | 
            
  | 12:38 | <moritzm> | upgrading app servers in codfw to HHVM 3.18.5 | [production] | 
            
  | 12:21 | <moritzm> | upgrading image scalers mw1293-mw1295 to HHVM 3.18.5 | [production] | 
            
  | 12:12 | <moritzm> | upgrading HHVM on deployment servers to 3.18.5 | [production] | 
            
  | 12:10 | <elukey> | added two new mediawiki videoscalers - mw1307/1318 | [production] | 
            
  | 12:09 | <elukey@puppetmaster1001> | conftool action : set/pooled=yes; selector: name=mw1318.eqiad.wmnet | [production] | 
            
  | 12:09 | <elukey@puppetmaster1001> | conftool action : set/pooled=yes; selector: name=mw1307.eqiad.wmnet | [production] | 
            
  | 12:00 | <gehel> | mediawiki now uses the LVS endpoint for logstash - T175242 | [production] | 
            
  | 11:49 | <moritzm> | upgrading job runners mw1161-mw1167 to HHVM 3.18.5 | [production] | 
            
  | 11:34 | <moritzm> | installing ghostscript security updates | [production] | 
            
  | 11:13 | <marostegui@tin> | Synchronized wmf-config/db-eqiad.php: Restore db1087 original weight (duration: 00m 47s) | [production] | 
            
  | 10:33 | <marostegui@tin> | Synchronized wmf-config/db-eqiad.php: Increase db1087 weight (duration: 00m 51s) | [production] | 
            
  | 10:29 | <jynus> | upgrade and reboot labsdb1011 | [production] | 
            
  | 10:22 | <jynus> | draining labsdb1011 connections | [production] | 
            
  | 10:18 | <akosiaris> | T177374, fully depool wtp1001-wtp1024 | [production] | 
            
  | 10:18 | <akosiaris@puppetmaster1001> | conftool action : set/pooled=inactive; selector: name=wtp10([01][0-9]|2[0-4]).eqiad.wmnet | [production] | 
            
  | 10:03 | <moritzm> | install libidn security updates | [production] | 
            
  | 10:01 | <marostegui@tin> | Synchronized wmf-config/db-eqiad.php: Repool db1087 with low weight (duration: 00m 50s) | [production] | 
            
  | 09:54 | <_joe_> | restarting hhvm on canaries (both appservers and canaries) T107128 | [production] | 
            
  | 09:47 | <moritzm> | upgrading API app servers mw1189-mw1208 to HHVM 3.18.5 | [production] | 
            
  | 09:45 | <elukey> | rolling restart of aqs nodes to pick up the new logstash lvs config | [production] | 
            
  | 09:39 | <hoo> | Killed remaining dumpRdf runners on snapshot1007 after two crashed due to the db1087 depool. Auto-restart will do the rest. | [production] | 
            
  | 09:33 | <marostegui@tin> | Synchronized wmf-config/db-eqiad.php: Add db1104 to the config - T172679 (duration: 00m 50s) | [production] | 
            
  | 09:32 | <marostegui@tin> | Synchronized wmf-config/db-codfw.php: Add db1104 to the config - T172679 (duration: 00m 51s) | [production] | 
            
  | 09:25 | <moritzm> | installing ocaml security updates on trusty | [production] | 
            
  | 09:16 | <marostegui> | Reboot db1087 to pick up new kernel | [production] | 
            
  | 09:09 | <_joe_> | restarting hhvm on mwdebug*, T107128 | [production] | 
            
  | 09:07 | <marostegui> | Optimize templatelinks and pagelinks tables on db1097 (s4) - T174509 | [production] | 
            
  | 09:06 | <marostegui@tin> | Synchronized wmf-config/db-eqiad.php: Depool db1097 - T174509 (duration: 00m 50s) | [production] | 
            
  | 08:41 | <akosiaris@puppetmaster1001> | conftool action : set/pooled=no; selector: name=wtp10([01][0-9]|2[0-4]).eqiad.wmnet | [production] | 
            
  | 08:40 | <mobrovac@tin> | Finished deploy [restbase/deploy@8eb758a]: Switch the mobile feeds to the new storage schema and Cassandra 3 (duration: 10m 05s) | [production] | 
            
  | 08:36 | <moritzm> | upgrading app servers mw1180-mw1188, mw1209-mw1220 to HHVM 3.18.5 | [production] | 
            
  | 08:30 | <mobrovac@tin> | Started deploy [restbase/deploy@8eb758a]: Switch the mobile feeds to the new storage schema and Cassandra 3 | [production] |