| 
      
        2016-07-01
      
      §
     | 
  
    
  | 09:38 | 
  <elukey> | 
  rebooted eventlog2001.codfw.wmnet for kernel upgrades | 
  [production] | 
            
  | 09:35 | 
  <moritzm> | 
  rolling reboot of swift backends in codfw | 
  [production] | 
            
  | 09:15 | 
  <moritzm> | 
  powercycling ms-fe2003, stuck after reboot | 
  [production] | 
            
  | 09:03 | 
  <moritzm> | 
  powercycling ms-fe2002, stuck after reboot | 
  [production] | 
            
  | 08:41 | 
  <moritzm> | 
  powercycling ms-fe2001, stuck after reboot | 
  [production] | 
            
  | 08:32 | 
  <moritzm> | 
  rolling reboot of swift frontends in codfw | 
  [production] | 
            
  | 06:28 | 
  <moritzm> | 
  resuming rolling reboots of elastic* clusters in eqiad and codfw | 
  [production] | 
            
  | 06:18 | 
  <moritzm> | 
  rolling reboot of wtp1* for kernel security update | 
  [production] | 
            
  | 02:44 | 
  <l10nupdate@tin> | 
  ResourceLoader cache refresh completed at Fri Jul  1 02:44:01 UTC 2016 (duration 5m 7s) | 
  [production] | 
            
  | 02:38 | 
  <mwdeploy@tin> | 
  scap sync-l10n completed (1.28.0-wmf.8) (duration: 17m 02s) | 
  [production] | 
            
  | 01:59 | 
  <ori@tin> | 
  Synchronized wmf-config/CommonSettings.php: I3a8057a8: Bump $wgResourceLoaderMaxQueryLength to 3,000 (duration: 00m 28s) | 
  [production] | 
            
  | 01:46 | 
  <aaron@tin> | 
  Synchronized wmf-config/InitialiseSettings.php: Enable LocalFile log (duration: 00m 32s) | 
  [production] | 
            
  | 01:08 | 
  <ori@tin> | 
  Synchronized wmf-config/InitialiseSettings.php: Ie8a71af5: HD logo for en.wiktionary (2/2) (duration: 00m 27s) | 
  [production] | 
            
  | 01:07 | 
  <ori@tin> | 
  Synchronized static/images/project-logos: Ie8a71af5: HD logo for en.wiktionary (1/2) (duration: 00m 28s) | 
  [production] | 
            
  | 01:04 | 
  <ori@tin> | 
  Synchronized php-1.28.0-wmf.8/extensions/WikimediaEvents/modules/ext.wikimediaEvents.deprecate.js: Ie28d823c: Log ResourceLoader URL-splitting (duration: 00m 32s) | 
  [production] | 
            
  | 00:20 | 
  <maxsem@tin> | 
  Finished scap: https://gerrit.wikimedia.org/r/#/c/296819/ - noop in prod (duration: 27m 27s) | 
  [production] | 
            
  
    | 
      
        2016-06-30
      
      §
     | 
  
    
  | 23:53 | 
  <maxsem@tin> | 
  Started scap: https://gerrit.wikimedia.org/r/#/c/296819/ - noop in prod | 
  [production] | 
            
  | 23:47 | 
  <maxsem@tin> | 
  Synchronized wmf-config/InitialiseSettings.php: https://gerrit.wikimedia.org/r/#/c/296257/ (duration: 00m 26s) | 
  [production] | 
            
  | 23:43 | 
  <maxsem@tin> | 
  Synchronized portals: (no message) (duration: 00m 27s) | 
  [production] | 
            
  | 23:43 | 
  <maxsem@tin> | 
  Synchronized portals/prod/wikipedia.org/assets: (no message) (duration: 00m 28s) | 
  [production] | 
            
  | 23:41 | 
  <ori> | 
  banned /static/images/project-logos/enwiktionary.png and /static/images/project-logos/adywiki.png | 
  [production] | 
            
  | 23:37 | 
  <maxsem@tin> | 
  Synchronized docroot/mediawiki/xml/sitelist-1.0/index.html: https://gerrit.wikimedia.org/r/#/c/296788/ (duration: 00m 24s) | 
  [production] | 
            
  | 23:27 | 
  <maxsem@tin> | 
  Synchronized static/images/project-logos/: (no message) (duration: 00m 27s) | 
  [production] | 
            
  | 23:12 | 
  <maxsem@tin> | 
  Synchronized static/images/project-logos/enwiktionary.png: https://gerrit.wikimedia.org/r/#/c/296757/ (duration: 00m 30s) | 
  [production] | 
            
  | 22:04 | 
  <krinkle@tin> | 
  Synchronized wmf-config/InitialiseSettings.php: test2wiki wgSquidMaxage (duration: 00m 28s) | 
  [production] | 
            
  | 21:00 | 
  <ebernhardson> | 
  change cluster.routing.allocation.disk.watermark.high on eqiad elasticsearch cluster to 80% | 
  [production] | 
            
  | 20:52 | 
  <aaron@tin> | 
  Synchronized php-1.28.0-wmf.8/includes/filerepo/file/LocalFile.php: 51d7fb48f2af31d69db115a8b3ed790cdaaf0d2e (duration: 00m 35s) | 
  [production] | 
            
  | 19:47 | 
  <aaron@tin> | 
  Synchronized wmf-config/InitialiseSettings.php: Set the SaveParse log (duration: 00m 26s) | 
  [production] | 
            
  | 19:43 | 
  <twentyafterfour> | 
  ran scap pull on mw2123 | 
  [production] | 
            
  | 19:42 | 
  <twentyafterfour> | 
  ran scap pull on mw2098 | 
  [production] | 
            
  | 19:42 | 
  <gehel> | 
  activating statement timeout limitations for kartotherian on maps cluster codfw (T138422) | 
  [production] | 
            
  | 19:38 | 
  <ostriches> | 
  mw2134: running sync-common, seems out of...sync :) | 
  [production] | 
            
  | 19:20 | 
  <twentyafterfour@tin> | 
  rebuilt wikiversions.php and synchronized wikiversions files: (no message) | 
  [production] | 
            
  | 19:19 | 
  <twentyafterfour> | 
  Deploying 1.28.0-wmf.8 to all wikimedia wikis. | 
  [production] | 
            
  | 19:18 | 
  <aaron@tin> | 
  Synchronized php-1.28.0-wmf.8/includes: adc4c90202d6c44aa58756e3c6bc35918afc5f75 (duration: 01m 19s) | 
  [production] | 
            
  | 18:24 | 
  <ori> | 
  restarted coal on graphite1001 and navtiming on hafnium due to inexplicably stopped metrics; nothing useful in logs. | 
  [production] | 
            
  | 17:48 | 
  <yurik> | 
  deployed Kartotherian https://gerrit.wikimedia.org/r/#/c/296787/ | 
  [production] | 
            
  | 17:10 | 
  <yurik> | 
  deployed Graphoid https://gerrit.wikimedia.org/r/#/c/296780/ | 
  [production] | 
            
  | 17:07 | 
  <jynus> | 
  stopping slave on db1073 to test InnoDB compression T139055 | 
  [production] | 
            
  | 16:44 | 
  <dcausse> | 
  restarting elastic1036 (master in eqiad) | 
  [production] | 
            
  | 16:23 | 
  <thcipriani@tin> | 
  Synchronized wmf-config: SWAT:Revert "Use extension registration for TitleBlacklist" (duration: 00m 32s) | 
  [production] | 
            
  | 16:22 | 
  <thcipriani@tin> | 
  Synchronized wmf-config/CommonSettings.php: SWAT:Revert "Use extension registration for TitleBlacklist" (duration: 00m 27s) | 
  [production] | 
            
  | 16:17 | 
  <dcausse> | 
  truncating elastic logs on elastic1036 and elastic1021 | 
  [production] | 
            
  | 16:16 | 
  <thcipriani@tin> | 
  Synchronized wmf-config: SWAT: [[gerrit:281240|Use extension registration for TitleBlacklist (T119117)]] PART II (duration: 00m 36s) | 
  [production] | 
            
  | 16:15 | 
  <thcipriani@tin> | 
  Synchronized wmf-config/InitialiseSettings.php: SWAT: [[gerrit:281240|Use extension registration for TitleBlacklist (T119117)]] PART I (duration: 00m 39s) | 
  [production] | 
            
  | 15:53 | 
  <thcipriani@tin> | 
  Synchronized wmf-config: SWAT: [[gerrit:281237|Use extension registration for LabeledSectionTransclusion (T119117)]] (duration: 00m 27s) | 
  [production] | 
            
  | 15:48 | 
  <thcipriani@tin> | 
  Synchronized wmf-config: SWAT: [[gerrit:296419|Short array syntax]] (duration: 00m 30s) | 
  [production] | 
            
  | 15:39 | 
  <thcipriani@tin> | 
  rebuilt wikiversions.php and synchronized wikiversions files: SWAT: [[gerrit:296744|Put wikidatawiki back on 1.28.0-wmf.8]] | 
  [production] | 
            
  | 15:36 | 
  <thcipriani@tin> | 
  Synchronized php-1.28.0-wmf.7/extensions/Wikidata/extensions/Wikibase/repo/includes/WikibaseRepo.php: SWAT: [[gerrit:296701|Update Wikidata - Fix broken editing of statements (T138974)]] (duration: 00m 25s) | 
  [production] | 
            
  | 15:35 | 
  <akosiaris> | 
  restarted (actually puppet did) gerrit after merging 4 related changes | 
  [production] |