| 
      
        2015-08-13
      
      §
     | 
  
    
  | 21:37 | 
  <ori@tin> | 
  Synchronized php-1.26wmf18/includes/OutputPage.php: Test impact of I5e6c79c (duration: 00m 12s) | 
  [production] | 
            
  | 21:16 | 
  <mutante> | 
  torrus broken - doing https://wikitech.wikimedia.org/wiki/Torrus#Deadlock_problem | 
  [production] | 
            
  | 21:14 | 
  <mutante> | 
  service gitblit restart on antimony (maybe that should be paging :) | 
  [production] | 
            
  | 21:06 | 
  <bd808> | 
  `sudo /etc/init.d/ganglia-monitor restart` on logstash100[1-6] fixed ganglia data loss | 
  [production] | 
            
  | 20:46 | 
  <mutante> | 
  killed ganglia aggregator for logstash on carbon | 
  [production] | 
            
  | 20:40 | 
  <bd808> | 
  ganglia not getting elasticsearch jvm data for logstash cluster since 2015-08-13T12:00 -- https://ganglia.wikimedia.org/latest/?c=Logstash+cluster+eqiad&&m=es_heap_used | 
  [production] | 
            
  | 19:56 | 
  <twentyafterfour@tin> | 
  rebuilt wikiversions.cdb and synchronized wikiversions files: all wikis to 1.26wmf18 | 
  [production] | 
            
  | 19:38 | 
  <demon@tin> | 
  Synchronized php-1.26wmf18/extensions/CirrusSearch/: (no message) (duration: 00m 11s) | 
  [production] | 
            
  | 19:35 | 
  <demon@tin> | 
  Synchronized php-1.26wmf18/extensions/Graph: (no message) (duration: 00m 10s) | 
  [production] | 
            
  | 19:31 | 
  <demon@tin> | 
  Synchronized php-1.26wmf18/extensions/Graph: (no message) (duration: 00m 11s) | 
  [production] | 
            
  | 18:32 | 
  <ori@tin> | 
  Synchronized php-1.26wmf18/extensions/SyntaxHighlight_GeSHi/extension.json: If0851400: Fix-up for I2de8a400d: explicitly declare module position (duration: 00m 12s) | 
  [production] | 
            
  | 17:47 | 
  <kaldari@tin> | 
  Synchronized wmf-config/InitialiseSettings.php: syncing InitialiseSettings for WikidataPageBanner (duration: 00m 12s) | 
  [production] | 
            
  | 17:46 | 
  <kaldari@tin> | 
  Finished scap: (no message) (duration: 50m 05s) | 
  [production] | 
            
  | 16:55 | 
  <kaldari@tin> | 
  Started scap: (no message) | 
  [production] | 
            
  | 16:54 | 
  <kaldari@tin> | 
  Synchronized wmf-config/InitialiseSettings.php: syncing InitialiseSettings for WikidataPageBanner off (duration: 00m 11s) | 
  [production] | 
            
  | 16:51 | 
  <kaldari@tin> | 
  Synchronized wmf-config/CommonSettings.php: syncing CommonSettings for WikidataPageBanner (duration: 00m 12s) | 
  [production] | 
            
  | 16:50 | 
  <kaldari@tin> | 
  Synchronized wmf-config/InitialiseSettings.php: syncing InitialiseSettings for WikidataPageBanner (duration: 00m 12s) | 
  [production] | 
            
  | 16:50 | 
  <kaldari@tin> | 
  Synchronized wmf-config/extension-list: syncing extension-list for WikidataPageBanner (duration: 00m 11s) | 
  [production] | 
            
  | 16:31 | 
  <kaldari@tin> | 
  Synchronized php-1.26wmf18/.gitmodules: (no message) (duration: 00m 11s) | 
  [production] | 
            
  | 16:30 | 
  <kaldari@tin> | 
  Synchronized php-1.26wmf17/.gitmodules: (no message) (duration: 00m 13s) | 
  [production] | 
            
  | 16:29 | 
  <kaldari@tin> | 
  Synchronized php-1.26wmf17/extensions/WikidataPageBanner: (no message) (duration: 00m 12s) | 
  [production] | 
            
  | 16:29 | 
  <kaldari@tin> | 
  Synchronized php-1.26wmf18/extensions/WikidataPageBanner: (no message) (duration: 00m 12s) | 
  [production] | 
            
  | 16:24 | 
  <demon@tin> | 
  Synchronized wmf-config/: undeploy wikigrok (duration: 00m 12s) | 
  [production] | 
            
  | 16:12 | 
  <yurik> | 
  sync deployed tilerator | 
  [production] | 
            
  | 15:20 | 
  <thcipriani@tin> | 
  Synchronized php-1.26wmf17/extensions/ContentTranslation/modules/tools/ext.cx.tools.images.js: SWAT: Images: validate image id before adapting to prevent js error [[gerrit:231229]] (duration: 00m 11s) | 
  [production] | 
            
  | 15:10 | 
  <thcipriani@tin> | 
  Synchronized php-1.26wmf18/extensions/ContentTranslation/modules/tools/ext.cx.tools.images.js: SWAT: Images: validate image id before adapting to prevent js error [[gerrit:231230]] (duration: 00m 12s) | 
  [production] | 
            
  | 15:04 | 
  <andrewbogott> | 
  rebooting labvirt1002 | 
  [production] | 
            
  | 13:35 | 
  <jynus> | 
  kill custom query hiting s6 master from terbium. Use of a slave is required. | 
  [production] | 
            
  | 13:11 | 
  <andrewbogott> | 
  graceful’d apache2 on labcontrol1001 | 
  [production] | 
            
  | 12:42 | 
  <andrewbogott> | 
  restarted keystone on labcontrol1001 | 
  [production] | 
            
  | 12:39 | 
  <hoo> | 
  Restarted apache2 on silver | 
  [production] | 
            
  | 09:35 | 
  <akosiaris> | 
  restarting apertium on sca1001 | 
  [production] | 
            
  | 08:16 | 
  <_joe_> | 
  removing all stale aggregator configs from netmon1001 | 
  [production] | 
            
  | 08:15 | 
  <godog> | 
  upgrade cassandra on restbase1009 | 
  [production] | 
            
  | 08:11 | 
  <godog> | 
  upgrade cassandra on restbase1006 | 
  [production] | 
            
  | 08:07 | 
  <godog> | 
  upgrade cassandra on restbase1005 | 
  [production] | 
            
  | 08:00 | 
  <l10nupdate@tin> | 
  ResourceLoader cache refresh completed at Thu Aug 13 08:00:40 UTC 2015 (duration 0m 39s) | 
  [production] | 
            
  | 07:36 | 
  <_joe_> | 
  killing all gmond instances on netmon1001, trying to fix ganglia-monitor-aggregator | 
  [production] | 
            
  | 06:48 | 
  <matt_flaschen> | 
  Stopped Support desk LQT->Flow conversion for tonight | 
  [production] | 
            
  | 05:03 | 
  <ori@tin> | 
  Synchronized php-1.26wmf17/includes/cache/MessageCache.php: 5f1ab59d31: MessageCache: derive the hash from the cache contents (duration: 00m 12s) | 
  [production] | 
            
  | 05:02 | 
  <ori@tin> | 
  Synchronized php-1.26wmf18/includes/cache/MessageCache.php: 5f1ab59d31: MessageCache: derive the hash from the cache contents (duration: 00m 12s) | 
  [production] | 
            
  | 03:04 | 
  <l10nupdate@tin> | 
  LocalisationUpdate completed (1.26wmf18) at 2015-08-13 03:04:52+00:00 | 
  [production] | 
            
  | 03:01 | 
  <l10nupdate@tin> | 
  Synchronized php-1.26wmf18/cache/l10n: l10nupdate for 1.26wmf18 (duration: 06m 14s) | 
  [production] | 
            
  | 02:44 | 
  <l10nupdate@tin> | 
  LocalisationUpdate completed (1.26wmf17) at 2015-08-13 02:44:49+00:00 | 
  [production] | 
            
  | 02:38 | 
  <l10nupdate@tin> | 
  Synchronized php-1.26wmf17/cache/l10n: l10nupdate for 1.26wmf17 (duration: 10m 47s) | 
  [production] | 
            
  | 01:26 | 
  <matt_flaschen> | 
  Restarted conversion of support desk from LQT->Flow using convertLqtPageOnLocalWiki.php, using hhvm on mw1041 | 
  [production] | 
            
  | 01:16 | 
  <ori@tin> | 
  Synchronized wmf-config/StartProfiler.php: I482b120289: Ensure all Xenon records begin with the script base name (duration: 00m 12s) | 
  [production] | 
            
  | 01:07 | 
  <ori> | 
  Depooled mw1041 so it can be set aside for LQT->Flow conversion script (T108601) | 
  [production] |