| 2016-06-30
      
      ยง | 
    
  | 17:48 | <yurik> | deployed Kartotherian https://gerrit.wikimedia.org/r/#/c/296787/ | [production] | 
            
  | 17:10 | <yurik> | deployed Graphoid https://gerrit.wikimedia.org/r/#/c/296780/ | [production] | 
            
  | 17:07 | <jynus> | stopping slave on db1073 to test InnoDB compression T139055 | [production] | 
            
  | 16:44 | <dcausse> | restarting elastic1036 (master in eqiad) | [production] | 
            
  | 16:23 | <thcipriani@tin> | Synchronized wmf-config: SWAT:Revert "Use extension registration for TitleBlacklist" (duration: 00m 32s) | [production] | 
            
  | 16:22 | <thcipriani@tin> | Synchronized wmf-config/CommonSettings.php: SWAT:Revert "Use extension registration for TitleBlacklist" (duration: 00m 27s) | [production] | 
            
  | 16:17 | <dcausse> | truncating elastic logs on elastic1036 and elastic1021 | [production] | 
            
  | 16:16 | <thcipriani@tin> | Synchronized wmf-config: SWAT: [[gerrit:281240|Use extension registration for TitleBlacklist (T119117)]] PART II (duration: 00m 36s) | [production] | 
            
  | 16:15 | <thcipriani@tin> | Synchronized wmf-config/InitialiseSettings.php: SWAT: [[gerrit:281240|Use extension registration for TitleBlacklist (T119117)]] PART I (duration: 00m 39s) | [production] | 
            
  | 15:53 | <thcipriani@tin> | Synchronized wmf-config: SWAT: [[gerrit:281237|Use extension registration for LabeledSectionTransclusion (T119117)]] (duration: 00m 27s) | [production] | 
            
  | 15:48 | <thcipriani@tin> | Synchronized wmf-config: SWAT: [[gerrit:296419|Short array syntax]] (duration: 00m 30s) | [production] | 
            
  | 15:39 | <thcipriani@tin> | rebuilt wikiversions.php and synchronized wikiversions files: SWAT: [[gerrit:296744|Put wikidatawiki back on 1.28.0-wmf.8]] | [production] | 
            
  | 15:36 | <thcipriani@tin> | Synchronized php-1.28.0-wmf.7/extensions/Wikidata/extensions/Wikibase/repo/includes/WikibaseRepo.php: SWAT: [[gerrit:296701|Update Wikidata - Fix broken editing of statements (T138974)]] (duration: 00m 25s) | [production] | 
            
  | 15:35 | <akosiaris> | restarted (actually puppet did) gerrit after merging 4 related changes | [production] | 
            
  | 15:34 | <thcipriani@tin> | Synchronized php-1.28.0-wmf.8/extensions/Wikidata/extensions/Wikibase/repo/includes/WikibaseRepo.php: SWAT: [[gerrit:296701|Update Wikidata - Fix broken editing of statements (T138974)]] (duration: 00m 31s) | [production] | 
            
  | 15:27 | <thcipriani@tin> | Synchronized dblists/clldefault.dblist: SWAT: [[gerrit:296501|Deploy Compact Language Links as default (Stage 3.5) (T136677)]] (duration: 00m 26s) | [production] | 
            
  | 15:18 | <thcipriani@tin> | Synchronized wmf-config/throttle.php: SWAT: [[gerrit:296733|Delete old throttle rules]] (duration: 00m 25s) | [production] | 
            
  | 15:12 | <thcipriani@tin> | Synchronized static/images/project-logos/enwiktionary.png: SWAT: Revert [[gerrit:296403|Change project logo for enwikt (T138801)]] (duration: 00m 25s) | [production] | 
            
  | 15:07 | <thcipriani@tin> | Synchronized static/images/project-logos/enwiktionary.png: SWAT: [[gerrit:296403|Change project logo for enwikt (T138801)]] (duration: 00m 25s) | [production] | 
            
  | 15:04 | <moritzm> | rolling reboot of wtp2 for kernel security update | [production] | 
            
  | 14:49 | <mdholloway> | mobileapps finished deploying 43538aa | [production] | 
            
  | 14:46 | <moritzm> | pooling four additional jessie-based image scalers (mw1295-mw1298) | [production] | 
            
  | 14:45 | <mdholloway> | starting mobileapps deployment | [production] | 
            
  | 13:42 | <godog> | swift codfw-prod: ms-be202[234] weight 3000 | [production] | 
            
  | 13:10 | <jynus> | upgrading and restarting analytics1003 mysql tables | [production] | 
            
  | 11:59 | <moritzm> | pooling three additional jessie-based image scalers | [production] | 
            
  | 10:26 | <elukey> | rebooting stat100[234] and analytics1003 for kernel upgrades | [production] | 
            
  | 10:20 | <moritzm> | powercycling mw1016, stuck after reboot | [production] | 
            
  | 09:44 | <dcausse> | truncating current logs again on elastic1045 and elastic1036 | [production] | 
            
  | 09:37 | <moritzm> | powercycling mw1011, stuck after reboot | [production] | 
            
  | 09:21 | <dcausse> | truncating current logs on elastic1045 and elastic1036 | [production] | 
            
  | 09:19 | <mobrovac> | zotero deployed translators cde2f7531a4 | [production] | 
            
  | 09:13 | <godog> | reboot graphite2001 / graphite1001 to apply trusty kernel update | [production] | 
            
  | 09:13 | <dcausse> | deleting old logs on elastic1045 and elastic1036 | [production] | 
            
  | 06:57 | <moritzm> | powercycling elastic1015, stuck after reboot | [production] | 
            
  | 06:37 | <moritzm> | powercycling elastic1014, stuck after reboot | [production] | 
            
  | 06:26 | <moritzm> | resuming rolling restarts of elasticsearch cluster in eqiad and codfw | [production] | 
            
  | 06:18 | <moritzm> | rolling restart of mw1001-mw1016 for kernel secuity update | [production] | 
            
  | 03:00 | <l10nupdate@tin> | ResourceLoader cache refresh completed at Thu Jun 30 03:00:28 UTC 2016 (duration 7m 10s) | [production] | 
            
  | 02:53 | <mwdeploy@tin> | scap sync-l10n completed (1.28.0-wmf.8) (duration: 07m 08s) | [production] | 
            
  | 02:39 | <mwdeploy@tin> | scap sync-l10n completed (1.28.0-wmf.7) (duration: 17m 23s) | [production] | 
            
  | 01:33 | <twentyafterfour> | starting phd with only 4 taskmasters to help lighten the load | [production] | 
            
  | 01:30 | <twentyafterfour> | stopped phd on iridium to investigate large spike in sql insert volume | [production] | 
            
  | 01:18 | <mutante> | iridium back up, on 3.13.0-91 | [production] | 
            
  | 01:15 | <mutante> | rebooting iridium | [production] | 
            
  | 00:39 | <dereckson@tin> | Synchronized wmf-config/InitialiseSettings.php: Don't use always true wmgUseXFFBlocks anymore (2/2) (duration: 00m 25s) | [production] | 
            
  | 00:38 | <twentyafterfour> | Phabricator upgrade complete, service appears to be stable. | [production] | 
            
  | 00:32 | <dereckson@tin> | Synchronized wmf-config/CommonSettings.php: Don't use always true wmgUseXFFBlocks anymore (1/2) (duration: 00m 25s) | [production] | 
            
  | 00:30 | <dereckson@tin> | Synchronized wmf-config/CommonSettings.php: Don't use always true wmgUseXFFBlocks anymore (1/2) (duration: 00m 27s) | [production] | 
            
  | 00:27 | <twentyafterfour> | Taking phabricator offline momentarily for scheduled update. Expect less than 5 minutes of downtime. | [production] |