| 2015-05-14
      
      § | 
    
  | 23:35 | <demon> | Synchronized wmf-config/InitialiseSettings.php: (no message) (duration: 00m 11s) | [production] | 
            
  | 23:20 | <ori> | Depooled mw1169; HHVM deadlock à la T89912. Leaving it depooled to investigate. | [production] | 
            
  | 23:05 | <demon> | Synchronized wmf-config/InitialiseSettings.php: (no message) (duration: 00m 11s) | [production] | 
            
  | 23:05 | <demon> | Synchronized w/static/images/project-logos/urwikiquote.png: (no message) (duration: 00m 14s) | [production] | 
            
  | 23:03 | <demon> | Synchronized wmf-config/InitialiseSettings.php: (no message) (duration: 00m 17s) | [production] | 
            
  | 22:26 | <ori> | Synchronized wmf-config/StartProfiler.php: Icbf826a7: 1:1000 request profiling via xhprof (duration: 00m 12s) | [production] | 
            
  | 22:23 | <gwicke> | deployed RESTBase v0.6.3 (fd942ac38ad) | [production] | 
            
  | 22:20 | <ori> | Synchronized php-1.26wmf6/extensions/CirrusSearch/includes/ElasticsearchIntermediary.php: (no message) (duration: 00m 15s) | [production] | 
            
  | 21:39 | <manybubbles> | I'm going to be done doing rolling restarts for a couple of hours. If someone wants to pick them up and do the next one after the cluster goes green again then be my guest. | [production] | 
            
  | 21:35 | <manybubbles> | es-tool restart-fast on elastic1016 | [production] | 
            
  | 21:27 | <ori> | Synchronized php-1.26wmf6/extensions/CirrusSearch/includes/ElasticsearchIntermediary.php: (no message) (duration: 00m 12s) | [production] | 
            
  | 21:27 | <ori> | Synchronized php-1.26wmf5/extensions/CirrusSearch/includes/ElasticsearchIntermediary.php: (no message) (duration: 00m 12s) | [production] | 
            
  | 21:14 | <ori> | Synchronized php-1.26wmf6/extensions/CirrusSearch/includes/ElasticsearchIntermediary.php: I3df6713a1: Log request times to StatsD (duration: 00m 13s) | [production] | 
            
  | 21:14 | <ori> | Synchronized php-1.26wmf5/extensions/CirrusSearch/includes/ElasticsearchIntermediary.php: I3df6713a1: Log request times to StatsD (duration: 00m 15s) | [production] | 
            
  | 21:11 | <manybubbles> | elastic1015 es-tool restart-fast | [production] | 
            
  | 19:43 | <robh> | mass unsubcription in listadmins list, resulting in unsupressed mass unsubscribe notices to all listadmin email address (sorry about the emails!) | [production] | 
            
  | 19:24 | <legoktm> | Synchronized php-1.26wmf5/skins/Nostalgia/skin.json: touch (duration: 00m 17s) | [production] | 
            
  | 19:15 | <legoktm> | debugging on tin / mw1017 for nostalgiawiki issue | [production] | 
            
  | 16:59 | <^d> | elasticsearch: set transient cluster.routing.allocation.node_concurrent_recoveries on prod cluster to 8 (default: 2) to speed up recoveries. | [production] | 
            
  | 16:52 | <kartik> | Finished scap: Update ContentTranslation (duration: 44m 07s) | [production] | 
            
  | 16:29 | <andrewbogott> | disabling puppet on labnet1001 for testing | [production] | 
            
  | 16:14 | <godog> | es-tool restart-fast on elastic1014 | [production] | 
            
  | 16:08 | <kartik> | Started scap: Update ContentTranslation | [production] | 
            
  | 15:46 | <thcipriani> | Synchronized php-1.26wmf5/extensions/Translate: SWAT update translate to a6f0a63 [[gerrit:210919]] (duration: 00m 15s) | [production] | 
            
  | 15:12 | <thcipriani> | Synchronized wmf-config/InitialiseSettings.php: SWAT enable new article campaign except bawiki [[gerrit:210916]] (duration: 00m 12s) | [production] | 
            
  | 15:04 | <thcipriani> | Synchronized wmf-config/InitialiseSettings.php: Open external links on votewiki in new tab [[gerrit:210849]] (duration: 00m 12s) | [production] | 
            
  | 15:00 | <godog> | es-tool restart-fast on elastic1013 | [production] | 
            
  | 14:48 | <andyrussg> | Synchronized php-1.26wmf6/extensions/CentralNotice/: Update CentralNotice (duration: 00m 13s) | [production] | 
            
  | 14:34 | <paravoid> | reimaging multatuli | [production] | 
            
  | 14:34 | <jynus> | migrating data db from virt1000 to db1009 | [production] | 
            
  | 14:23 | <bblack> | restarted ganglia-monitor on eeden | [production] | 
            
  | 14:21 | <andyrussg> | Synchronized php-1.26wmf5/extensions/CentralNotice/: Update CentralNotice (duration: 00m 12s) | [production] | 
            
  | 14:16 | <godog> | es-tool restart-fast on elastic1012 | [production] | 
            
  | 14:12 | <paravoid> | switching ns2 back to eeden | [production] | 
            
  | 13:56 | <cmjohnson1> | upgrading tellurium to trusty | [production] | 
            
  | 13:41 | <cmjohnson1> | power cycling barium | [production] | 
            
  | 13:40 | <godog> | es-root restart-fast on elastic1011 | [production] | 
            
  | 13:21 | <paravoid> | reimaging eeden with jessie | [production] | 
            
  | 12:59 | <paravoid> | switching ns2 to multatuli | [production] | 
            
  | 12:53 | <jynus> | disabling temporarily Ichinga check for MySQL running on db1009 until data is migrated from virt1000 and host sent to production | [production] | 
            
  | 12:40 | <akosiaris> | uploaded to apt.wikimedia.org jessie-wikimedia: apertium-pt-gl_0.9.2~r60358-1 | [production] | 
            
  | 12:36 | <godog> | es-tool restart-fast on elastic1010 | [production] | 
            
  | 11:40 | <manybubbles> | restarting elasticsearch on elastic1009 | [production] | 
            
  | 05:07 | <LocalisationUpdate> | ResourceLoader cache refresh completed at Thu May 14 05:06:09 UTC 2015 (duration 6m 8s) | [production] | 
            
  | 02:55 | <manybubbles> | restarting elasticsearch on elastic1008 | [production] | 
            
  | 02:51 | <LocalisationUpdate> | completed (1.26wmf6) at 2015-05-14 02:49:53+00:00 | [production] | 
            
  | 02:47 | <l10nupdate> | Synchronized php-1.26wmf6/cache/l10n: (no message) (duration: 04m 16s) | [production] | 
            
  | 02:44 | <springle> | xtrabackup clone db1056 to db1019 | [production] |