| 2014-10-29
      
      § | 
    
  | 23:42 | <ejegg> | updated tool from 19928683a8112e9aadd71ba47f199885ba517a02 to 419fb7aa32c6d0776056968378e358ee01985565 | [production] | 
            
  | 23:38 | <maxsem> | Synchronized php-1.25wmf6/extensions/MobileFrontend/: (no message) (duration: 00m 07s) | [production] | 
            
  | 23:35 | <maxsem> | Synchronized php-1.25wmf5/extensions/MobileFrontend/: (no message) (duration: 00m 04s) | [production] | 
            
  | 23:13 | <catrope> | Synchronized php-1.25wmf6/extensions/VisualEditor: SWAT (duration: 00m 04s) | [production] | 
            
  | 23:00 | <mutante> | restarting nginx on cp1044 | [production] | 
            
  | 22:11 | <AaronSchulz> | Re-running setZoneAccess.php for swift | [production] | 
            
  | 22:04 | <Krinkle> | git-deploy: Deploying integration/slave-scripts a6a23ac1ec | [production] | 
            
  | 20:28 | <subbu> | reverted parsoid to version 617e9e61b625f25d79dfaab08830c396537be632 (due to stuck processes) | [production] | 
            
  | 20:16 | <reedy> | Synchronized wmf-config/mc-labs.php: noop for prod (duration: 00m 17s) | [production] | 
            
  | 20:07 | <arlolra> | updated Parsoid to version 4e21bdb6fccc377468fd3d1cbc656fb64464ea78 | [production] | 
            
  | 19:45 | <reedy> | Synchronized wmf-config/InitialiseSettings.php: (no message) (duration: 00m 16s) | [production] | 
            
  | 19:39 | <reedy> | Synchronized wmf-config/InitialiseSettings.php: (no message) (duration: 00m 16s) | [production] | 
            
  | 19:26 | <reedy> | Synchronized wmf-config/InitialiseSettings.php: (no message) (duration: 00m 15s) | [production] | 
            
  | 19:17 | <ori> | upgraded HHVM to 3.3.0+dfsg1-1+wm1 | [production] | 
            
  | 18:58 | <reedy> | rebuilt wikiversions.cdb and synchronized wikiversions files: group0 to 1.25wmf6 | [production] | 
            
  | 18:57 | <reedy> | rebuilt wikiversions.cdb and synchronized wikiversions files: wikipedias to 1.25wmf5 | [production] | 
            
  | 18:47 | <reedy> | Finished scap: testwiki to 1.25wmf6 and build l10n cache (duration: 28m 30s) | [production] | 
            
  | 18:18 | <reedy> | Started scap: testwiki to 1.25wmf6 and build l10n cache | [production] | 
            
  | 17:24 | <cmjohnson> | shutting down to replace ssds in elastic1002,1007,1014 | [production] | 
            
  | 17:07 | <ori> | Synchronized wmf-config/CommonSettings.php: I8dd62e2cc: Re-enable hhvm beta feature on Wikidata (duration: 00m 06s) | [production] | 
            
  | 16:20 | <manybubbles> | elastic101[7-9] look good to me - adding them to the cluster | [production] | 
            
  | 16:17 | <manybubbles> | shutting down elasticsearch on elastic1002 - its empty and ready to have its disk upgraded/hyper threading enabled | [production] | 
            
  | 16:05 | <manybubbles> | ignore my last log message about 1017 - typod | [production] | 
            
  | 16:05 | <manybubbles> | shutting down elasticsearch on elastic1007 - its empty and ready to have its disk upgraded/hyper threading enabled | [production] | 
            
  | 16:04 | <manybubbles> | shutting down elasticsearch on elastic1014 - its empty and ready to have its disk upgraded/hyper threading enabled | [production] | 
            
  | 16:04 | <manybubbles> | shutting down elasticsearch on elastic1017 - its empty and ready to have its disk upgraded/hyper threading enabled | [production] | 
            
  | 15:39 | <manybubbles> | start moving shards back to elastic1001 and elastic1008 now that they are up with hyperthreading on | [production] | 
            
  | 15:37 | <Reedy> | deleted php-1.24wmf21 from mediawiki-installation | [production] | 
            
  | 15:36 | <Reedy> | deleted php-1.24wmf20 from mediawiki-installation | [production] | 
            
  | 15:35 | <Reedy> | deleted php-1.24wmf19 from mediawiki-installation | [production] | 
            
  | 15:35 | <akosiaris> | uploaded apertium-apy_0.1+svn~57689-1 on apt.wikimedia.org | [production] | 
            
  | 15:23 | <manybubbles> | unbanned elastic1013 now that it is back with hyper threading on | [production] | 
            
  | 15:21 | <reedy> | Purged l10n cache for 1.25wmf3 | [production] | 
            
  | 15:20 | <reedy> | Purged l10n cache for 1.25wmf2 | [production] | 
            
  | 15:19 | <bd808> | Restarted logstash on logstash1002 to fix OCG and hadoop log events not being recorded | [production] | 
            
  | 15:15 | <bd808> | Restarted logstash on logstash1001. No MW events were being added to the index. | [production] | 
            
  | 15:10 | <anomie> | Synchronized wmf-config/throttle.php: SWAT: Raise account creation throttle at cawiki temporarily [[gerrit:169708]] (duration: 00m 09s) | [production] | 
            
  | 15:07 | <anomie> | Synchronized php-1.25wmf5/extensions/Wikidata: SWAT: Fix WikiData "add links" widget JS error [[gerrit:169700]] (duration: 00m 15s) | [production] | 
            
  | 15:07 | <Reedy> | Killed old (pre 1.25) l10nupdate cache dirs from tin:/var/lib/l10nupdate | [production] | 
            
  | 15:00 | <manybubbles> | started moving shard off of elastic1001, elastic1008, and elastic1013 so we can bounce them to enable hyper threading | [production] | 
            
  | 14:55 | <manybubbles> | started rolling shards back to elastic1001, elastic1008, and elastic1013 after hard drive upgrade | [production] | 
            
  | 14:21 | <ottomata> | set request.required.acks = 2 for all varnishkafkas | [production] | 
            
  | 13:22 | <manybubbles> | lowered replication on logstash's template for new indexes from 3 way to 2 way | [production] | 
            
  | 13:20 | <demon> | Synchronized wmf-config/lucene-production.php: unbreak lsearchd for commons, enwikitionary, etc (duration: 00m 04s) | [production] | 
            
  | 13:11 | <manybubbles> | lowered redundancy on logstash from 3 way to 2 way | [production] | 
            
  | 13:01 | <cmjohnson> | powering down/replacing elastic1017 and elastic1018 | [production] | 
            
  | 12:59 | <cmjohnson> | disabling puppet on elastic1017 and 1018 | [production] |