| 
      
        2018-08-24
      
      §
     | 
  
    
  | 10:47 | 
  <moritzm> | 
  reimage wtp2008-wtp2010 to stretch | 
  [production] | 
            
  | 09:28 | 
  <moritzm> | 
  reimage wtp2005-wtp2007 to stretch | 
  [production] | 
            
  | 09:09 | 
  <marostegui> | 
  Restart MySQL on db2035 (codfw s2 master) for mysql upgrade and pick up new mysql options after merging https://gerrit.wikimedia.org/r/455103 | 
  [production] | 
            
  | 09:04 | 
  <marostegui> | 
  Deploy schema change on db1095:3312 | 
  [production] | 
            
  | 07:56 | 
  <marostegui> | 
  Deploy schema change on db1122 | 
  [production] | 
            
  | 07:53 | 
  <moritzm> | 
  reimage wtp2002-wtp2004 to stretch | 
  [production] | 
            
  | 06:52 | 
  <marostegui> | 
  Deploy schema change on db1074 with replication (this will generate lag on s2 labs) | 
  [production] | 
            
  | 06:38 | 
  <moritzm> | 
  reimage wtp2001 to stretch | 
  [production] | 
            
  | 06:09 | 
  <moritzm> | 
  imported php-igbinary, libzip5, php-apcu-bc to thirdparty/php72 (T202704) | 
  [production] | 
            
  | 05:26 | 
  <marostegui> | 
  Deploy schema change on db1076 | 
  [production] | 
            
  | 00:21 | 
  <mutante> | 
  ms-be2043 - mount -a ; re-enabled puppet, running puppet | 
  [production] | 
            
  
    | 
      
        2018-08-23
      
      §
     | 
  
    
  | 23:47 | 
  <reedy@deploy1001> | 
  Synchronized wmf-config/InitialiseSettings.php: T202548 (duration: 01m 01s) | 
  [production] | 
            
  | 23:43 | 
  <Reedy> | 
  created wikilove tables on zh_yuewiki T202548 | 
  [production] | 
            
  | 23:42 | 
  <reedy@deploy1001> | 
  Synchronized wmf-config/InitialiseSettings.php: T201236 (duration: 00m 55s) | 
  [production] | 
            
  | 23:37 | 
  <reedy@deploy1001> | 
  Synchronized wmf-config/InitialiseSettings.php: T202599 (duration: 00m 53s) | 
  [production] | 
            
  | 23:34 | 
  <reedy@deploy1001> | 
  Synchronized wmf-config/InitialiseSettings.php: T202599 (duration: 00m 49s) | 
  [production] | 
            
  | 23:28 | 
  <Reedy> | 
  running `mwscript updateCollation.php --wiki=trwiki --previous-collation=uppercase` T184943 | 
  [production] | 
            
  | 23:28 | 
  <reedy@deploy1001> | 
  Synchronized wmf-config/InitialiseSettings.php: T184943 (duration: 00m 48s) | 
  [production] | 
            
  | 23:23 | 
  <reedy@deploy1001> | 
  Synchronized wmf-config/flaggedrevs.php: T202139 (duration: 00m 48s) | 
  [production] | 
            
  | 23:19 | 
  <reedy@deploy1001> | 
  Synchronized wmf-config/InitialiseSettings.php: T202680 (duration: 00m 48s) | 
  [production] | 
            
  | 23:16 | 
  <reedy@deploy1001> | 
  scap failed: average error rate on 3/11 canaries increased by 10x (rerun with --force to override this check, see https://logstash.wikimedia.org/goto/2cc7028226a539553178454fc2f14459 for details) | 
  [production] | 
            
  | 23:16 | 
  <reedy@deploy1001> | 
  sync-file aborted: (no justification provided) (duration: 00m 01s) | 
  [production] | 
            
  | 23:15 | 
  <reedy@deploy1001> | 
  sync-file aborted: (no justification provided) (duration: 00m 00s) | 
  [production] | 
            
  | 22:53 | 
  <XioNoX> | 
  Add v4 session in eqdfw to AS8075 | 
  [production] | 
            
  | 22:46 | 
  <XioNoX> | 
  Add v6 session in eqsin to 10089 | 
  [production] | 
            
  | 22:39 | 
  <XioNoX> | 
  deactivating down AMSIX peer (no reply to emails) | 
  [production] | 
            
  | 22:36 | 
  <XioNoX> | 
  clear peer 80.249.208.51 AS 8708 on cr2-esams | 
  [production] | 
            
  | 22:31 | 
  <thcipriani@deploy1001> | 
  rebuilt and synchronized wikiversions files: all wikis to 1.32.0-wmf.18 | 
  [production] | 
            
  | 22:27 | 
  <thcipriani@deploy1001> | 
  Synchronized php-1.32.0-wmf.18/extensions/FlaggedRevs/backend/FlaggedRevs.class.php: [[gerrit:455017|Follow-up 413e11e2f: Skip CurrentRevisionCallback if not stabilized]] T202659 (duration: 00m 56s) | 
  [production] | 
            
  | 19:34 | 
  <thcipriani@deploy1001> | 
  rebuilt and synchronized wikiversions files: revert all wikis to 1.32.0-wmf.18 | 
  [production] | 
            
  | 19:34 | 
  <ppchelko@deploy1001> | 
  Finished deploy [restbase/deploy@b2b61e8]: Resurrect MCS on wikivoyage, take 5, onthisday is timing out. Just push this through.. (duration: 03m 27s) | 
  [production] | 
            
  | 19:31 | 
  <ppchelko@deploy1001> | 
  Started deploy [restbase/deploy@b2b61e8]: Resurrect MCS on wikivoyage, take 5, onthisday is timing out. Just push this through.. | 
  [production] | 
            
  | 19:26 | 
  <thcipriani@deploy1001> | 
  rebuilt and synchronized wikiversions files: all wikis to 1.32.0-wmf.18 | 
  [production] | 
            
  | 18:54 | 
  <ppchelko@deploy1001> | 
  Finished deploy [restbase/deploy@b2b61e8]: Resurrect MCS on wikivoyage, take 4, onthisday is timing out. Just push this through.. (duration: 04m 39s) | 
  [production] | 
            
  | 18:50 | 
  <ppchelko@deploy1001> | 
  Started deploy [restbase/deploy@b2b61e8]: Resurrect MCS on wikivoyage, take 4, onthisday is timing out. Just push this through.. | 
  [production] | 
            
  | 18:48 | 
  <ppchelko@deploy1001> | 
  Finished deploy [restbase/deploy@b2b61e8]: Resurrect MCS on wikivoyage, take 3, onthisday is timing out. Just push this through.. (duration: 03m 59s) | 
  [production] | 
            
  | 18:44 | 
  <ppchelko@deploy1001> | 
  Started deploy [restbase/deploy@b2b61e8]: Resurrect MCS on wikivoyage, take 3, onthisday is timing out. Just push this through.. | 
  [production] | 
            
  | 18:41 | 
  <ppchelko@deploy1001> | 
  Finished deploy [restbase/deploy@b2b61e8]: Resurrect MCS on wikivoyage, take 3, onthisday is failing (duration: 03m 53s) | 
  [production] | 
            
  | 18:37 | 
  <thcipriani@deploy1001> | 
  Synchronized php: group1 wikis to 1.32.0-wmf.18 (duration: 00m 54s) | 
  [production] | 
            
  | 18:37 | 
  <ppchelko@deploy1001> | 
  Started deploy [restbase/deploy@b2b61e8]: Resurrect MCS on wikivoyage, take 3, onthisday is failing | 
  [production] | 
            
  | 18:37 | 
  <ppchelko@deploy1001> | 
  Finished deploy [restbase/deploy@b2b61e8]: Resurrect MCS on wikivoyage, take 2, onthisday is failing (duration: 06m 30s) | 
  [production] | 
            
  | 18:37 | 
  <thcipriani@deploy1001> | 
  rebuilt and synchronized wikiversions files: group1 wikis to 1.32.0-wmf.18 | 
  [production] | 
            
  | 18:33 | 
  <XioNoX> | 
  Equinix updated their MAC filter, IX sessions up - T196941 | 
  [production] | 
            
  | 18:33 | 
  <thcipriani> | 
  starting train a little early to play catchup | 
  [production] | 
            
  | 18:32 | 
  <RoanKattouw> | 
  Deployed patch for T199993 | 
  [production] | 
            
  | 18:30 | 
  <ppchelko@deploy1001> | 
  Started deploy [restbase/deploy@b2b61e8]: Resurrect MCS on wikivoyage, take 2, onthisday is failing | 
  [production] | 
            
  | 18:30 | 
  <ppchelko@deploy1001> | 
  Finished deploy [restbase/deploy@b2b61e8]: Resurrect MCS on wikivoyage (duration: 03m 54s) | 
  [production] | 
            
  | 18:30 | 
  <XioNoX> | 
  remove MAC filter workaround on cr2-eqdfw - T196941 | 
  [production] | 
            
  | 18:28 | 
  <thcipriani@deploy1001> | 
  Synchronized php-1.32.0-wmf.18/extensions/FlaggedRevs/backend/FlaggedRevs.class.php: [[gerrit:454868|Fix incorrect return value in CurrentRevisionCallback]] T202580 (duration: 00m 54s) | 
  [production] | 
            
  | 18:28 | 
  <RoanKattouw> | 
  Deployed patch for T151910 | 
  [production] |