| 2014-09-03
      
      § | 
    
  | 23:04 | <maxsem> | Synchronized wmf-config/InitialiseSettings.php: https://gerrit.wikimedia.org/r/#/c/157855/ https://gerrit.wikimedia.org/r/#/c/158265/ (duration: 00m 04s) | [production] | 
            
  | 21:09 | <reedy> | Synchronized wmf-config/InitialiseSettings.php: Disable GlobalUsage on labswiki (duration: 00m 15s) | [production] | 
            
  | 20:59 | <reedy> | Synchronized wmf-config/: (no message) (duration: 00m 15s) | [production] | 
            
  | 20:47 | <reedy> | Synchronized wmf-config/InitialiseSettings.php: (no message) (duration: 00m 15s) | [production] | 
            
  | 20:45 | <reedy> | Synchronized wmf-config/InitialiseSettings.php: touch (duration: 00m 15s) | [production] | 
            
  | 20:38 | <andrew> | Synchronized wmf-config/CommonSettings.php: (no message) (duration: 00m 05s) | [production] | 
            
  | 20:38 | <andrew> | Synchronized wmf-config/InitialiseSettings.php: (no message) (duration: 00m 04s) | [production] | 
            
  | 20:37 | <andrew> | Synchronized wmf-config/wikitech.php: (no message) (duration: 00m 04s) | [production] | 
            
  | 20:16 | <subbu> | deployed Parsoid version 78e55c6b (deploy repo sha c0761179) | [production] | 
            
  | 18:52 | <yurik> | Synchronized wmf-config: enabling graph ext on zerowiki & collabwiki (duration: 01m 06s) | [production] | 
            
  | 18:52 | <MaxSem> | Running sync-common on mw1163 | [production] | 
            
  | 18:48 | <yurik> | Synchronized php-1.24wmf18/extensions/Graph/: (no message) (duration: 01m 09s) | [production] | 
            
  | 18:47 | <yurik> | Synchronized php-1.24wmf19/extensions/Graph/: (no message) (duration: 01m 05s) | [production] | 
            
  | 16:52 | <andrew> | Synchronized wmf-config/wikitech.php: (no message) (duration: 00m 03s) | [production] | 
            
  | 16:52 | <andrew> | Synchronized private/WikitechPrivateLdapSettings.php: (no message) (duration: 00m 03s) | [production] | 
            
  | 16:51 | <andrew> | Synchronized private/WikitechPrivateSettings.php: (no message) (duration: 00m 05s) | [production] | 
            
  | 16:51 | <andrew> | Synchronized wmf-config/wikitech.php: (no message) (duration: 00m 03s) | [production] | 
            
  | 16:19 | <andrew> | Synchronized wmf-config/wikitech.php: (no message) (duration: 00m 03s) | [production] | 
            
  | 16:18 | <andrew> | Synchronized wmf-config/wikitech.php: (no message) (duration: 00m 04s) | [production] | 
            
  | 16:16 | <andrew> | Synchronized wmf-config/wikitech.php: (no message) (duration: 00m 05s) | [production] | 
            
  | 15:42 | <_joe_> | mw1020 correctly reimaged, putting it in the hhvm pool | [production] | 
            
  | 15:28 | <manybubbles> | Synchronized wmf-config/InitialiseSettings.php: SWAT - Update another cirrus config - this time maybe it will work (duration: 00m 05s) | [production] | 
            
  | 15:12 | <manybubbles> | deployed throttling for Cirrus job named cirrusSearchLinksUpdate - it handles updating the index when a transcluded page changes - we'll have to check on the backlog over the next few hours/days to see if it stabilizes | [production] | 
            
  | 15:11 | <manybubbles> | Synchronized php-1.24wmf19/extensions/Wikidata/: (no message) (duration: 00m 07s) | [production] | 
            
  | 15:07 | <manybubbles> | mw1020 gets WARNING: REMOTE HOST IDENTIFICATION HAS CHANGED!  during sync-dir call | [production] | 
            
  | 15:07 | <manybubbles> | Synchronized wmf-config/: SWAT deploy cirrus config changes - make sure to get mw1020 (duration: 00m 04s) | [production] | 
            
  | 15:05 | <manybubbles> | https://gerrit.wikimedia.org/r/#/c/157861/ didn't work as expected - dropped everything out of using the all field...... | [production] | 
            
  | 15:03 | <manybubbles> | Synchronized wmf-config/: SWAT deploy cirrus config changes (duration: 00m 06s) | [production] | 
            
  | 14:53 | <cmjohnson1> | running sync-common on mw1178 | [production] | 
            
  | 14:52 | <cmjohnson1> | adding mw1178 back to pybal | [production] | 
            
  | 12:42 | <_joe_> | typo: mw1020, not mw1120 | [production] | 
            
  | 12:41 | <_joe_> | mw1120: remove from pybal, schedule downtime, reimage to HAT | [production] | 
            
  | 11:23 | <godog> | run gmond on elastic1002 manually to debug ES collector issues | [production] | 
            
  | 11:17 | <godog> | run gmond on elastic1001 manually to debug ES collector issues | [production] | 
            
  | 07:55 | <_joe_> | re-enabling mw1192, what we were seeing was probably load and not anything else | [production] | 
            
  | 06:57 | <ori> | restarted memcached on virt1000 due to cache pollution from migration (different memc drivers w/different encoding) | [production] | 
            
  | 04:55 | <LocalisationUpdate> | ResourceLoader cache refresh completed at Wed Sep  3 04:53:50 UTC 2014 (duration 53m 49s) | [production] | 
            
  | 03:51 | <LocalisationUpdate> | completed (1.24wmf19) at 2014-09-03 03:50:17+00:00 | [production] | 
            
  | 03:17 | <LocalisationUpdate> | completed (1.24wmf18) at 2014-09-03 03:16:37+00:00 | [production] | 
            
  | 02:43 | <LocalisationUpdate> | completed (1.24wmf15) at 2014-09-03 02:42:24+00:00 | [production] | 
            
  | 00:18 | <mutante> | deleted PDF files older than 3d and a huge 1G one on ocg1001 in reaction to monitoring complaints | [production] | 
            
  | 00:00 | <ori> | Synchronized php-1.24wmf18/extensions/WikimediaEvents: Update WikimediaEvents for cherry-picks (duration: 00m 03s) | [production] |