| 2014-08-30
      
      § | 
    
  | 06:33 | <jgage> | analytics1021 back in service after election | [production] | 
            
  | 06:14 | <jgage> | upgraded & rebooted analytics1021 | [production] | 
            
  | 06:01 | <springle> | Synchronized wmf-config/db-eqiad.php: return db1037 to normal load (duration: 00m 06s) | [production] | 
            
  | 05:03 | <springle> | Synchronized wmf-config/db-eqiad.php: repool es1001 (duration: 00m 06s) | [production] | 
            
  | 04:06 | <springle> | upgrade es1001 to mariadb 10 | [production] | 
            
  | 03:56 | <springle> | xtrabackup clone db1037 to db1071 | [production] | 
            
  | 03:55 | <springle> | Synchronized wmf-config/db-eqiad.php: reduce db1037 load while cloning (duration: 00m 06s) | [production] | 
            
  | 03:31 | <springle> | Synchronized wmf-config/db-eqiad.php: pool db1073, depool db1071 (duration: 00m 07s) | [production] | 
            
  | 03:19 | <LocalisationUpdate> | ResourceLoader cache refresh completed at Sat Aug 30 03:17:57 UTC 2014 (duration 17m 56s) | [production] | 
            
  | 02:33 | <LocalisationUpdate> | completed (1.24wmf19) at 2014-08-30 02:32:06+00:00 | [production] | 
            
  | 02:21 | <LocalisationUpdate> | completed (1.24wmf18) at 2014-08-30 02:20:39+00:00 | [production] | 
            
  
    | 2014-08-29
      
      § | 
    
  | 21:15 | <ori> | Synchronized wmf-config: I812c0bb6c: Scrap unused Twemproxy config files (duration: 00m 04s) | [production] | 
            
  | 21:12 | <ori> | updated /a/common to {{Gerrit|I812c0bb6c}}: Scrap unused Twemproxy config files | [production] | 
            
  | 21:03 | <mutante> | restarted uwsgi on tungsten | [production] | 
            
  | 20:49 | <mutante> | tungsten extremely busy, graphite down, logging in since 5 minutes :p | [production] | 
            
  | 20:48 | <mutante> | powercycling ms-be1006 - BUG: soft lockup - CPU#0 stuck ... | [production] | 
            
  | 19:19 | <mutante> | installing package upgrades on iron, bast1001 | [production] | 
            
  | 18:41 | <aaron> | Synchronized php-1.24wmf18/maintenance/findMissingFiles.php: 994d4a556a070156fd04fb4951492f10696cc63c (duration: 00m 03s) | [production] | 
            
  | 18:30 | <ori> | Synchronized php-1.24wmf19/resources/src/mediawiki.action/mediawiki.action.view.redirect.js: I19221a25a: mediawiki.action.view.redirect: Work around a IE 10+ HTML5 history API bug (duration: 00m 06s) | [production] | 
            
  | 18:30 | <ori> | Synchronized php-1.24wmf18/resources/src/mediawiki.action/mediawiki.action.view.redirect.js: I19221a25a: mediawiki.action.view.redirect: Work around a IE 10+ HTML5 history API bug (duration: 00m 07s) | [production] | 
            
  | 15:36 | <hashar_> | Jenkins: pooled a new slave 10.68.16.162 as wikidata-jenkins3 on behalf of addshore / wmde | [production] | 
            
  | 15:04 | <_joe_> | shutting down mw1163, filled RT 8243 for repair. | [production] | 
            
  | 14:54 | <_joe_> | re-enabled mw1130 | [production] | 
            
  | 14:41 | <aude> | Synchronized wmf-config/Wikibase.php: enable Wikibase badges css, follow up from last night deploy (duration: 00m 06s) | [production] | 
            
  | 14:22 | <_joe_> | syncing mw1130 | [production] | 
            
  | 14:06 | <_joe_> | disable mw1130 from the api pool whil it gets resynced | [production] | 
            
  | 12:30 | <Krinkle> | Running extensions/GlobalCssJs/removeOldManualUserPages.php per [[m:GlobalCssJs]] | [production] | 
            
  | 11:06 | <springle> | Synchronized wmf-config/db-eqiad.php: repool db1070 (duration: 00m 09s) | [production] | 
            
  | 08:04 | <hashar> | Jenkins: in the jenkins-job-builder-config branch 'cloudbees' has been merged in 'master'. Unifying CI and browser tests jobs!  \\O/ | [production] | 
            
  | 07:05 | <_joe_> | re-enabling puppet on the jobrunner, to check if the luasandbox fix works | [production] | 
            
  | 06:33 | <springle> | Synchronized wmf-config/db-eqiad.php: return db1056 to normal load (duration: 00m 06s) | [production] | 
            
  | 04:14 | <LocalisationUpdate> | ResourceLoader cache refresh completed at Fri Aug 29 04:13:03 UTC 2014 (duration 13m 2s) | [production] | 
            
  | 03:32 | <springle> | xtrabackup clone db1056 to db1070 | [production] | 
            
  | 03:31 | <springle> | Synchronized wmf-config/db-eqiad.php: reduce db1056 load while cloning (duration: 00m 06s) | [production] | 
            
  | 03:15 | <LocalisationUpdate> | completed (1.24wmf19) at 2014-08-29 03:10:26+00:00 | [production] | 
            
  | 02:48 | <springle> | Synchronized wmf-config/db-eqiad.php: depool db1070. pool db1072. (duration: 00m 07s) | [production] | 
            
  | 02:38 | <LocalisationUpdate> | completed (1.24wmf18) at 2014-08-29 02:37:20+00:00 | [production] | 
            
  | 01:49 | <springle> | Synchronized wmf-config/db-eqiad.php: depool db1070. pool db1072. (duration: 00m 06s) | [production] | 
            
  | 01:27 | <godog> | repool ms-fe1002 | [production] | 
            
  | 01:07 | <cmjohnson1> | shutting down ms-fe1002 to relocate racks | [production] | 
            
  | 01:04 | <godog> | depool ms-fe1002 | [production] | 
            
  | 01:02 | <godog> | repool ms-fe1001 | [production] | 
            
  | 00:57 | <ori> | Synchronized php-1.24wmf18/extensions/WikimediaEvents: Ib44fe0898: Inject 'wgPoweredByHHVM' JS config var if powered by HHVM (duration: 00m 03s) | [production] | 
            
  | 00:56 | <ori> | Synchronized php-1.24wmf19/extensions/WikimediaEvents: Ib44fe0898: Inject 'wgPoweredByHHVM' JS config var if powered by HHVM (duration: 00m 04s) | [production] | 
            
  | 00:38 | <cmjohnson1> | shutting down ms-fe1001 for rack relocation | [production] | 
            
  | 00:34 | <godog> | depool ms-fe1001 | [production] | 
            
  | 00:32 | <godog> | repool ms-fe1004 | [production] | 
            
  | 00:27 | <mutante> | restarting gmetad on nickel | [production] | 
            
  | 00:04 | <cmjohnson1> | shutting down ms-fe1004 to relocate racks | [production] |