| 2018-10-17
      
      § | 
    
  | 09:34 | <XioNoX> | update interfaces and BGP IPs for office-DC link (DC side, interfaces still disabled) - T205985 | [production] | 
            
  | 09:30 | <banyek> | truncating parsercache tables on pc2006 (T206740) | [production] | 
            
  | 09:12 | <_joe_> | reenabling puppet (not running it) in codfw | [production] | 
            
  | 09:12 | <_joe_> | change applied to all appservers serving traffic | [production] | 
            
  | 09:08 | <_joe_> | running puppet on all apaches (appserver/api) in eqiad to pick up the wikipedia.org vhost refactor | [production] | 
            
  | 09:05 | <_joe_> | running puppet on mwdebug1001, then testing again wikipedia.org for regressions | [production] | 
            
  | 09:04 | <_joe_> | puppet disabled on the appservers, now merging the wikipedia.org conversion to mediawiki::web::vhost | [production] | 
            
  | 08:43 | <mobrovac@deploy1001> | Started restart [proton/deploy@a657059]: (no justification provided) | [production] | 
            
  | 08:30 | <kartik@deploy1001> | Finished deploy [cxserver/deploy@b30a323]: Update cxserver to 29e01e4 (T206305, T204668) (duration: 03m 54s) | [production] | 
            
  | 08:26 | <kartik@deploy1001> | Started deploy [cxserver/deploy@b30a323]: Update cxserver to 29e01e4 (T206305, T204668) | [production] | 
            
  | 08:09 | <banyek> | stopping binlog purgers on the parsercache hosts (the binlogs will be kept for 24hrs) - T206740 | [production] | 
            
  | 08:00 | <banyek> | truncating parsercache tables on pc2005 (T206740) | [production] | 
            
  | 06:52 | <jynus> | fixing s8 master drifts T206743 | [production] | 
            
  | 02:10 | <ejegg> | updated payments-wiki from 7fb1aae963 to 0385ad02a7 | [production] | 
            
  | 01:24 | <legoktm@deploy1001> | Synchronized wmf-config/CommonSettings.php: Add REL1_32 to ExtensionDistributor (duration: 00m 59s) | [production] | 
            
  
    | 2018-10-16
      
      § | 
    
  | 22:11 | <ppchelko@deploy1001> | Finished deploy [restbase/deploy@d9e3a09]: Downgrade major-greater to minor-greater if no-cache is required, take 6 (duration: 01m 18s) | [production] | 
            
  | 22:09 | <ppchelko@deploy1001> | Started deploy [restbase/deploy@d9e3a09]: Downgrade major-greater to minor-greater if no-cache is required, take 6 | [production] | 
            
  | 22:09 | <ppchelko@deploy1001> | Finished deploy [restbase/deploy@d9e3a09]: Downgrade major-greater to minor-greater if no-cache is required, take 5 (duration: 05m 16s) | [production] | 
            
  | 22:04 | <ppchelko@deploy1001> | Started deploy [restbase/deploy@d9e3a09]: Downgrade major-greater to minor-greater if no-cache is required, take 5 | [production] | 
            
  | 22:04 | <ppchelko@deploy1001> | Finished deploy [restbase/deploy@d9e3a09]: Downgrade major-greater to minor-greater if no-cache is required, take 4 (duration: 03m 53s) | [production] | 
            
  | 22:00 | <ppchelko@deploy1001> | Started deploy [restbase/deploy@d9e3a09]: Downgrade major-greater to minor-greater if no-cache is required, take 4 | [production] | 
            
  | 22:00 | <ppchelko@deploy1001> | Finished deploy [restbase/deploy@d9e3a09]: Downgrade major-greater to minor-greater if no-cache is required, take 3 (duration: 04m 15s) | [production] | 
            
  | 21:58 | <twentyafterfour@deploy1001> | rebuilt and synchronized wikiversions files: group0 wikis to 1.32.0-wmf.24  refs T191072 | [production] | 
            
  | 21:55 | <ppchelko@deploy1001> | Started deploy [restbase/deploy@d9e3a09]: Downgrade major-greater to minor-greater if no-cache is required, take 3 | [production] | 
            
  | 21:55 | <ppchelko@deploy1001> | Finished deploy [restbase/deploy@d9e3a09]: Downgrade major-greater to minor-greater if no-cache is required, take 2 (duration: 09m 11s) | [production] | 
            
  | 21:46 | <ppchelko@deploy1001> | Started deploy [restbase/deploy@d9e3a09]: Downgrade major-greater to minor-greater if no-cache is required, take 2 | [production] | 
            
  | 21:45 | <ppchelko@deploy1001> | Finished deploy [restbase/deploy@d9e3a09]: Downgrade major-greater to minor-greater if no-cache is required (duration: 03m 53s) | [production] | 
            
  | 21:42 | <ppchelko@deploy1001> | Started deploy [restbase/deploy@d9e3a09]: Downgrade major-greater to minor-greater if no-cache is required | [production] | 
            
  | 21:18 | <twentyafterfour@deploy1001> | rebuilt and synchronized wikiversions files: group0 wikis to 1.32.0-wmf.26  refs T191072 | [production] | 
            
  | 20:55 | <twentyafterfour@deploy1001> | Finished scap: Syncing 1.32.0-wmf.26 refs T191072 (duration: 26m 32s) | [production] | 
            
  | 20:28 | <twentyafterfour@deploy1001> | Started scap: Syncing 1.32.0-wmf.26 refs T191072 | [production] | 
            
  | 20:14 | <shdubsh> | restarted pdfrender on scb1003 | [production] | 
            
  | 18:44 | <ppchelko@deploy1001> | Started restart [proton/deploy@a657059]: Try restarting again for metrics | [production] | 
            
  | 18:43 | <ppchelko@deploy1001> | Started restart [proton/deploy@a657059]: Try restarting again for metrics | [production] | 
            
  | 18:42 | <ppchelko@deploy1001> | Finished deploy [proton/deploy@a657059]: Try restarting for metrics (duration: 00m 20s) | [production] | 
            
  | 18:42 | <ppchelko@deploy1001> | Started deploy [proton/deploy@a657059]: Try restarting for metrics | [production] | 
            
  | 17:01 | <_joe_> | restarted pdfrender on scb1004 | [production] | 
            
  | 16:33 | <akosiaris> | depool restbase-async from eqiad in order to test traffic going to parsoid codfw | [production] | 
            
  | 16:15 | <_joe_> | disabled puppet on all appservers, merging wikidata apache change, re-enabling puppet on mwdebug1001 for testing | [production] | 
            
  | 14:51 | <mobrovac@deploy1001> | Finished deploy [proton/deploy@a657059]: Rollback to puppeteer v1.5.0 - T186748 (duration: 00m 49s) | [production] | 
            
  | 14:51 | <mobrovac@deploy1001> | Started deploy [proton/deploy@a657059]: Rollback to puppeteer v1.5.0 - T186748 | [production] | 
            
  | 14:28 | <godog> | roll-restart elasticsearch on logstash100[456] to change elasticsearch data dir - T206454 | [production] | 
            
  | 14:06 | <godog> | depool in turn logstash1008 and logstash1009 to change elasticsearch data dir - T206454 | [production] | 
            
  | 13:55 | <godog> | depool logstash1007 to change elasticsearch data dir - T206454 | [production] | 
            
  | 13:54 | <XioNoX> | router back and healthy, enable external BGP sessions on cr2-eqdfw - T203261 | [production] | 
            
  | 13:51 | <moritzm> | rebooting acamar for update to stretch-proposed-updates kernel | [production] | 
            
  | 13:44 | <XioNoX> | reboot cr2-eqdfw for upgrade - T203261 | [production] | 
            
  | 13:43 | <XioNoX> | disable external BGP sessions on cr2-eqdfw - T203261 | [production] | 
            
  | 13:43 | <anomie@deploy1001> | Synchronized wmf-config/InitialiseSettings.php: Setting comment table migration stage to write-new/read-both on group 0 (T166733) (duration: 00m 50s) | [production] | 
            
  | 13:33 | <XioNoX> | start install process on cr2-eqdfw (non impacting before reboot) - T203261 | [production] |