| 2015-08-11
      
      § | 
    
  | 17:13 | <bd808> | logstash cluster recovered after upgrade of elasticsearch on logstash1004 | [production] | 
            
  | 16:42 | <bd808> | upgraded elasticsearch to 1.7.1 on logstash1004; logstash-2015.08.11 shard recovering | [production] | 
            
  | 16:42 | <mutante> | restarted Apache on Etherpad | [production] | 
            
  | 16:38 | <bd808> | upgraded elasticsearch to 1.7.1 on logstash1003 | [production] | 
            
  | 16:37 | <bd808> | upgraded elaasticsearch to 1.7.1 on logstash1002 | [production] | 
            
  | 16:36 | <bd808> | upgraded elaasticsearch to 1.7.1 on logstash1001 | [production] | 
            
  | 16:23 | <bd808> | logstash upgrade on logstash1003 complete | [production] | 
            
  | 16:20 | <bd808> | logstash upgrade on logstash1002 complete | [production] | 
            
  | 16:16 | <bd808> | logstash upgrade on logstash1001 complete | [production] | 
            
  | 15:50 | <jynus> | nuking db1002-db1007 on icinga | [production] | 
            
  | 15:49 | <bd808> | upgrading logstash on logstash1001 | [production] | 
            
  | 15:47 | <bd808> | Trebuchet deploy of logstash/plugins: Add logstash-filter-prune 0.1.5 (36144b2) | [production] | 
            
  | 15:36 | <bd808> | Disabled puppet on logstash100[1-3] in preparation for upgrade to 1.5.3 | [production] | 
            
  | 15:31 | <bd808@tin> | Synchronized wmf-config/InitialiseSettings.php: logging: Only send info and higher to logstash by default (4388a84) 2/2 (actually rebased this time) (duration: 00m 11s) | [production] | 
            
  | 15:30 | <bd808@tin> | Synchronized wmf-config/logging.php: logging: Only send info and higher to logstash by default (4388a84) 1/2 (actually rebased this time) (duration: 00m 11s) | [production] | 
            
  | 15:17 | <bd808@tin> | Synchronized wmf-config/InitialiseSettings.php: Touched wmf-config/InitialiseSettings.php (duration: 00m 13s) | [production] | 
            
  | 15:12 | <bd808@tin> | Synchronized wmf-config/InitialiseSettings.php: logging: Only send info and higher to logstash by default (4388a84) 2/2 (duration: 00m 12s) | [production] | 
            
  | 15:11 | <bd808@tin> | Synchronized wmf-config/logging.php: logging: Only send info and higher to logstash by default (4388a84) 1/2 (duration: 00m 12s) | [production] | 
            
  | 10:45 | <jynus> | general maintenance on db1042 (restart, upgrade, db reconstruction) | [production] | 
            
  | 10:38 | <godog> | upgrade cassandra on restbase1007 | [production] | 
            
  | 10:31 | <godog> | upgrade cassandra on restbase1002 | [production] | 
            
  | 10:25 | <godog> | upgrade cassandra on restbase1001 | [production] | 
            
  | 09:56 | <paravoid> | switched routing-system autonomous-system to eqiad's subAS on cr1-eqiad/cr2--eqiad | [production] | 
            
  | 09:09 | <godog> | reboot ms-be2009, cpu soft lockup | [production] | 
            
  | 05:27 | <l10nupdate@tin> | ResourceLoader cache refresh completed at Tue Aug 11 05:27:33 UTC 2015 (duration 27m 32s) | [production] | 
            
  | 02:26 | <l10nupdate@tin> | LocalisationUpdate completed (1.26wmf17) at 2015-08-11 02:26:58+00:00 | [production] | 
            
  | 02:23 | <l10nupdate@tin> | Synchronized php-1.26wmf17/cache/l10n: l10nupdate for 1.26wmf17 (duration: 06m 48s) | [production] | 
            
  | 01:20 | <ori@tin> | Synchronized php-1.26wmf17/includes/resourceloader/ResourceLoader.php: I2089b21fc: Revert resourceloader: Add must-revalidate to Cache-Control (duration: 00m 12s) | [production] | 
            
  | 00:10 | <mutante> | apache restart on krypton | [production] | 
            
  
    | 2015-08-10
      
      § | 
    
  | 23:53 | <ebernhardson@tin> | Synchronized wmf-config/CirrusSearch-common.php: Limit the number of states in a cirrussearch query (duration: 00m 11s) | [production] | 
            
  | 23:44 | <krenair@tin> | Synchronized php-1.26wmf17/extensions/TimedMediaHandler/TimedMediaIframeOutput.php: https://gerrit.wikimedia.org/r/#/c/230656/ (duration: 00m 12s) | [production] | 
            
  | 23:40 | <ori@tin> | Synchronized multiversion/MWMultiVersion.php: I511999: Convert multiversion scripts to use wikiversions.php (duration: 00m 12s) | [production] | 
            
  | 23:11 | <krenair@tin> | Synchronized wmf-config/InitialiseSettings.php: (no message) (duration: 00m 12s) | [production] | 
            
  | 23:07 | <krenair@tin> | Synchronized wmf-config: https://gerrit.wikimedia.org/r/#/c/228040/ (duration: 00m 14s) | [production] | 
            
  | 23:04 | <ori> | deployed scap a404a39b32... Build wikiversions.php in addition to wikiversions.cdb | [production] | 
            
  | 22:22 | <mutante> | restart gitblit | [production] | 
            
  | 21:53 | <mutante> | krypton unloaded mod proxy_balancer | [production] | 
            
  | 20:57 | <ori> | Synchronized php-1.26wmf17/includes/cache/MessageCache.php: I2089b21fc: MessageCache: use APC for local caching, rather than files (duration: 00m 12s) | [production] | 
            
  | 20:12 | <subbu> | deployed parsoid version 7b554ce2f | [production] | 
            
  | 19:57 | <yurik> | synced new kartotherian | [production] | 
            
  | 19:22 | <ori> | Synchronized php-1.26wmf17/includes: I9a1aa76de: Moved ObjectCacheSessionHandler renewal logic to wfSetupSession() (duration: 00m 16s) | [production] | 
            
  | 17:12 | <akosiaris> | stopped postgres on maps-test200{2,3,4} | [production] | 
            
  | 16:59 | <ori> | Synchronized php-1.26wmf17/includes/OutputPage.php: I2089b21fc: Load mediawiki.legacy.commonPrint styles with a media type property (2/2) (duration: 00m 11s) | [production] | 
            
  | 16:58 | <ori> | Synchronized php-1.26wmf17/resources/Resources.php: I2089b21fc: Load mediawiki.legacy.commonPrint styles with a media type property (1/2) (duration: 00m 11s) | [production] | 
            
  | 16:50 | <ori> | Synchronized php-1.26wmf17/extensions/wikihiero: I2089b21fc: Updated mediawiki/core Project: mediawiki/extensions/wikihiero (duration: 00m 12s) | [production] | 
            
  | 15:11 | <thcipriani> | Synchronized php-1.26wmf17/extensions/ContentTranslation/api/ApiContentTranslationPublish.php: SWAT: Enable scrubWikitext=1 in HTML to wikitext conversion using parsoid [[gerrit:230381]] (duration: 00m 13s) | [production] | 
            
  | 14:47 | <akosiaris> | running an rsync from nas1001-a to local disks on helium | [production] | 
            
  | 14:42 | <ottomata> | restarted all varnishkafka instances to pick up proper confs (puppet should have done this!) | [production] | 
            
  | 14:29 | <ottomata> | starting upgrade of existing kafka cluster to 0.8.2.1 jessie - https://etherpad.wikimedia.org/p/kafka_0.8.2.1_migration2 | [production] | 
            
  | 12:38 | <bblack> | deployed nginx-1.9.3-1+wmf2 to cp1065, cp1070, cp1071 (1x each text, upload, misc) for validation | [production] |