| 2017-09-28
      
      § | 
    
  | 13:00 | <marostegui@tin> | Synchronized wmf-config/db-codfw.php: Depool db2053 db2046 - T174509 (duration: 00m 49s) | [production] | 
            
  | 12:48 | <dcausse> | restarting elastic on relforge servers to test a new version of the ltr plugin | [production] | 
            
  | 12:27 | <ema> | reboot cp402[2-6] to disable numa isolation | [production] | 
            
  | 10:30 | <gehel> | restart elasticsearch on relforge to validate new logging config - T175242 | [production] | 
            
  | 10:09 | <elukey> | incrementally add mw1312-17 api-appservers to serve live traffic (weights will be raised incrementally) | [production] | 
            
  | 10:00 | <elukey@puppetmaster1001> | conftool action : set/pooled=yes; selector: name=mw1308.eqiad.wmnet | [production] | 
            
  | 09:59 | <elukey> | added new mediawiki jobrunner - mw1308 | [production] | 
            
  | 09:52 | <ema> | upgrade pybal to 1.14.0 on lvs1009-10 | [production] | 
            
  | 09:49 | <aaron@tin> | Synchronized wmf-config/CommonSettings.php: Enable logging of post-send DB updates (duration: 00m 55s) | [production] | 
            
  | 09:42 | <ema> | upgrade pybal to 1.14.0 on lvs400[13] | [production] | 
            
  | 08:00 | <elukey@puppetmaster1001> | conftool action : set/pooled=yes; selector: name=mw1288.eqiad.wmnet | [production] | 
            
  | 07:27 | <moritzm> | upgrading app servers in deployment-prep to HHVM 3.18.5 | [production] | 
            
  | 07:14 | <moritzm> | installing apache updates on silver/wikitech.wikimedia.org | [production] | 
            
  | 06:59 | <moritzm> | installing apache updates on graphite* hosts | [production] | 
            
  | 06:28 | <elukey> | restart varnish backend on cp3032 | [production] | 
            
  | 05:54 | <marostegui> | Optimize tables pagelinks and templatelinks on dbstore2001 (s2) - T174509 | [production] | 
            
  | 05:53 | <marostegui> | Optimize tables pagelinks and templatelinks on dbstore2002 (s2) - T174509 | [production] | 
            
  | 05:43 | <marostegui> | Run maintain-views on labsdb1001, labsdb1003, labsdb1009, labsdb1010, labsdb1011 for hiwikivoyage - T173027 | [production] | 
            
  | 05:38 | <marostegui@tin> | Synchronized wmf-config/db-codfw.php: Depool db2049 and db2041 to optimize templatelinks and pagelinks tables - T174509 (duration: 00m 47s) | [production] | 
            
  | 05:29 | <marostegui@tin> | Synchronized wmf-config/db-codfw.php: Repool db2064 db2063 - T174509 (duration: 00m 48s) | [production] | 
            
  | 05:21 | <marostegui@tin> | Synchronized wmf-config/db-codfw.php: Repool db2076 db2067 db2060 - T174509 (duration: 00m 48s) | [production] | 
            
  | 05:19 | <tstarling@tin> | Finished scap: updating Vector skin for gerrit 381153 (duration: 20m 39s) | [production] | 
            
  | 04:59 | <tstarling@tin> | Started scap: updating Vector skin for gerrit 381153 | [production] | 
            
  | 03:57 | <bblack> | ulsfo dns-depooled at ~03:51 | [production] | 
            
  | 03:26 | <l10nupdate@tin> | ResourceLoader cache refresh completed at Thu Sep 28 03:26:18 UTC 2017 (duration 6m 10s) | [production] | 
            
  | 03:20 | <l10nupdate@tin> | scap sync-l10n completed (1.31.0-wmf.1) (duration: 15m 44s) | [production] | 
            
  | 02:42 | <l10nupdate@tin> | scap sync-l10n completed (1.30.0-wmf.19) (duration: 15m 24s) | [production] | 
            
  | 00:36 | <twentyafterfour> | upgrading phabricator, expect minimal downtime | [production] | 
            
  
    | 2017-09-27
      
      § | 
    
  | 23:39 | <robh> | cp4024 is running hardware testing, leave it alone T174891 | [production] | 
            
  | 23:17 | <catrope@tin> | Synchronized wmf-config/Wikibase.php: Make CirrusSearch default for wbsearchentities on testwikidatawiki T175741 (duration: 00m 48s) | [production] | 
            
  | 22:34 | <maxsem@tin> | Synchronized php-1.31.0-wmf.1/includes/EditPage.php: https://gerrit.wikimedia.org/r/#/c/381139/1 (duration: 00m 49s) | [production] | 
            
  | 19:14 | <demon@tin> | rebuilt wikiversions.php and synchronized wikiversions files: group1 -> wmf.1 | [production] | 
            
  | 19:13 | <demon@tin> | Synchronized php: symlink bump (duration: 00m 47s) | [production] | 
            
  | 19:10 | <demon@tin> | Synchronized php-1.31.0-wmf.1/maintenance/backup.inc: unbreak dumps (duration: 00m 49s) | [production] | 
            
  | 18:46 | <catrope@tin> | Finished scap: SWAT: T176762, T175358, T172023, T174719, and add html5-misnesting to Linter (duration: 22m 55s) | [production] | 
            
  | 18:39 | <bblack> | re-pooling upload@ulsfo (text@ulsfo remains pooled) | [production] | 
            
  | 18:23 | <catrope@tin> | Started scap: SWAT: T176762, T175358, T172023, T174719, and add html5-misnesting to Linter | [production] | 
            
  | 18:21 | <ejegg> | updated payments-wiki from 6104e3dea7a7051305c7d76f1e913b2410cbfcbf to c2a3d434d1234c3ae62b6b0359d69f302bca3bd6 | [production] | 
            
  | 17:40 | <ejegg> | updated SmashPig Adyen settings | [production] | 
            
  | 17:29 | <bblack> | uploaded nginx-1.13.5-1+wmf1 to stretch-wikimedia, and matching nginx-1.13.5-1+wmf1~jessie1 to jessie-wikimedia | [production] | 
            
  | 16:27 | <XioNoX> | setting local-as to selected transit BGP sessions - T167840 | [production] | 
            
  | 16:00 | <ema@neodymium> | conftool action : set/pooled=yes; selector: name=cp4026.ulsfo.wmnet | [production] | 
            
  | 16:00 | <ema@neodymium> | conftool action : set/pooled=yes; selector: name=cp4025.ulsfo.wmnet | [production] | 
            
  | 15:59 | <ema@neodymium> | conftool action : set/pooled=yes; selector: name=cp4023.ulsfo.wmnet | [production] | 
            
  | 15:58 | <ema@neodymium> | conftool action : set/pooled=yes; selector: name=cp4022.ulsfo.wmnet | [production] | 
            
  | 15:54 | <marostegui@tin> | Synchronized wmf-config/db-eqiad.php: Pool db1103 with low weight - T172679 (duration: 00m 47s) | [production] | 
            
  | 15:51 | <ema> | lvs4002: upgrade pybal to 1.14.0 | [production] | 
            
  | 15:48 | <ema> | lvs4004: upgrade pybal to 1.14.0 | [production] | 
            
  | 15:28 | <_joe_> | uploaded prometheus-statsd-exporter to stretch-wikimedia T175539 | [production] | 
            
  | 15:24 | <bblack> | rebooting cp402[2356] (bnx2x oops) | [production] |