| 2015-01-23
      
      § | 
    
  | 23:53 | <reedy> | Synchronized wmf-config/: More config updates (duration: 00m 06s) | [production] | 
            
  | 23:43 | <reedy> | Synchronized wmf-config/: Config updates (duration: 00m 06s) | [production] | 
            
  | 23:34 | <godog> | halting lsearchd machines | [production] | 
            
  | 23:23 | <_joe_> | repooling 10 appservers depooled for no apparent reason, and no entry in the SAL | [production] | 
            
  | 22:57 | <ori> | Synchronized wmf-config/CommonSettings.php: I50931db37: Route all counter stats to tungsten:3811 (duration: 00m 07s) | [production] | 
            
  | 22:57 | <Reedy> | updateCollation.php for plwikisource complete | [production] | 
            
  | 22:52 | <godog> | restarting graphite on tungsten, webapp stuck and no graphs | [production] | 
            
  | 22:49 | <Reedy> | running mwscript updateCollation.php --wiki=plwikisource --previous-collation=uppercase in screen as reedy on tin | [production] | 
            
  | 22:48 | <reedy> | Synchronized wmf-config/InitialiseSettings.php: plwikisource collation update (duration: 00m 06s) | [production] | 
            
  | 22:41 | <reedy> | Synchronized 404.html: updates (duration: 00m 06s) | [production] | 
            
  | 22:41 | <reedy> | Synchronized docroot and w: Update docroot files (duration: 00m 05s) | [production] | 
            
  | 22:38 | <reedy> | Synchronized wmf-config/interwiki.cdb: Updating interwiki cache (duration: 00m 05s) | [production] | 
            
  | 21:55 | <godog> | removed puppet stored config for search* and searchidx* | [production] | 
            
  | 21:34 | <_joe_> | installing a new hhvm package on the canary appservers | [production] | 
            
  | 21:21 | <_joe_> | uploaded new hhvm package to apt.w.o | [production] | 
            
  | 20:30 | <rmoen> | Synchronized php-1.25wmf15/extensions/MobileFrontend/: updating mobilefrontend credits (duration: 00m 06s) | [production] | 
            
  | 20:09 | <csteipp> | deployed patch for T64685 | [production] | 
            
  | 19:44 | <ejegg> | updated payments from 46bd1611c56d6e31594d01aa345c35dd45dcf676 to 4743b32c9091d6f2169bea3173e75aa5d2f36eb7 | [production] | 
            
  | 19:03 | <ebernhardson> | Synchronized php-1.25wmf14/extensions/Flow: Bump flow submodule in 1.25wmf14 (duration: 00m 07s) | [production] | 
            
  | 19:02 | <ebernhardson> | Synchronized php-1.25wmf15/extensions/Flow/: Bump flow submodule in 1.25wmf15 (duration: 00m 08s) | [production] | 
            
  | 17:59 | <mutante> | apt-get clean, free some diskspace on antimony | [production] | 
            
  | 17:17 | <bd808> | logstash1002 elasticsearch rejoined cluster after restart | [production] | 
            
  | 17:14 | <bd808> | logstash elasticsearch cluster split brained; logstash1002 thinks it is a lone master | [production] | 
            
  | 07:20 | <ori> | restarted puppetmaster and apache2 on palladium. | [production] | 
            
  | 04:03 | <LocalisationUpdate> | ResourceLoader cache refresh completed at Fri Jan 23 04:03:45 UTC 2015 (duration 3m 44s) | [production] | 
            
  | 02:19 | <LocalisationUpdate> | completed (1.25wmf15) at 2015-01-23 02:19:45+00:00 | [production] | 
            
  | 02:19 | <l10nupdate> | Synchronized php-1.25wmf15/cache/l10n: (no message) (duration: 00m 01s) | [production] | 
            
  | 02:11 | <LocalisationUpdate> | completed (1.25wmf14) at 2015-01-23 02:11:43+00:00 | [production] | 
            
  | 02:11 | <l10nupdate> | Synchronized php-1.25wmf14/cache/l10n: (no message) (duration: 00m 01s) | [production] | 
            
  
    | 2015-01-22
      
      § | 
    
  | 23:27 | <legoktm> | restarted the job runner service | [production] | 
            
  | 19:37 | <demon> | Synchronized wmf-config/CommonSettings.php: (no message) (duration: 00m 05s) | [production] | 
            
  | 18:39 | <ori> | ran 'hdel jobqueue:aggregator:h-ready-queues:v2 LocalRenameUserJob/vewikimedia' on rdb1001 | [production] | 
            
  | 18:08 | <Krenair> | Deployed patch for T87304 | [production] | 
            
  | 12:58 | <Krenair> | Run https://phabricator.wikimedia.org/T87040#984282 again to stop GWToolset extension flooding commons log | [production] | 
            
  | 04:15 | <LocalisationUpdate> | ResourceLoader cache refresh completed at Thu Jan 22 04:15:02 UTC 2015 (duration 15m 1s) | [production] | 
            
  | 02:19 | <LocalisationUpdate> | completed (1.25wmf15) at 2015-01-22 02:19:19+00:00 | [production] | 
            
  | 02:19 | <l10nupdate> | Synchronized php-1.25wmf15/cache/l10n: (no message) (duration: 00m 04s) | [production] | 
            
  | 02:11 | <LocalisationUpdate> | completed (1.25wmf14) at 2015-01-22 02:11:09+00:00 | [production] | 
            
  | 02:11 | <l10nupdate> | Synchronized php-1.25wmf14/cache/l10n: (no message) (duration: 00m 01s) | [production] | 
            
  | 01:25 | <springle> | ongoing schema changes T86415 externallinks | [production] | 
            
  | 01:12 | <akosiaris> | applied base::firewall to all bastions hosts. This is bast*, iron, hooft | [production] | 
            
  | 01:11 | <springle> | dump db2019 to dbstore2001 | [production] |