| 
      
        2014-09-03
      
      §
     | 
  
    
  | 15:07 | 
  <manybubbles> | 
  mw1020 gets WARNING: REMOTE HOST IDENTIFICATION HAS CHANGED!  during sync-dir call | 
  [production] | 
            
  | 15:07 | 
  <manybubbles> | 
  Synchronized wmf-config/: SWAT deploy cirrus config changes - make sure to get mw1020 (duration: 00m 04s) | 
  [production] | 
            
  | 15:05 | 
  <manybubbles> | 
  https://gerrit.wikimedia.org/r/#/c/157861/ didn't work as expected - dropped everything out of using the all field...... | 
  [production] | 
            
  | 15:03 | 
  <manybubbles> | 
  Synchronized wmf-config/: SWAT deploy cirrus config changes (duration: 00m 06s) | 
  [production] | 
            
  | 14:53 | 
  <cmjohnson1> | 
  running sync-common on mw1178  | 
  [production] | 
            
  | 14:52 | 
  <cmjohnson1> | 
  adding mw1178 back to pybal | 
  [production] | 
            
  | 12:42 | 
  <_joe_> | 
  typo: mw1020, not mw1120  | 
  [production] | 
            
  | 12:41 | 
  <_joe_> | 
  mw1120: remove from pybal, schedule downtime, reimage to HAT | 
  [production] | 
            
  | 11:23 | 
  <godog> | 
  run gmond on elastic1002 manually to debug ES collector issues | 
  [production] | 
            
  | 11:17 | 
  <godog> | 
  run gmond on elastic1001 manually to debug ES collector issues | 
  [production] | 
            
  | 07:55 | 
  <_joe_> | 
  re-enabling mw1192, what we were seeing was probably load and not anything else | 
  [production] | 
            
  | 06:57 | 
  <ori> | 
  restarted memcached on virt1000 due to cache pollution from migration (different memc drivers w/different encoding) | 
  [production] | 
            
  | 04:55 | 
  <LocalisationUpdate> | 
  ResourceLoader cache refresh completed at Wed Sep  3 04:53:50 UTC 2014 (duration 53m 49s) | 
  [production] | 
            
  | 03:51 | 
  <LocalisationUpdate> | 
  completed (1.24wmf19) at 2014-09-03 03:50:17+00:00 | 
  [production] | 
            
  | 03:17 | 
  <LocalisationUpdate> | 
  completed (1.24wmf18) at 2014-09-03 03:16:37+00:00 | 
  [production] | 
            
  | 02:43 | 
  <LocalisationUpdate> | 
  completed (1.24wmf15) at 2014-09-03 02:42:24+00:00 | 
  [production] | 
            
  | 00:18 | 
  <mutante> | 
  deleted PDF files older than 3d and a huge 1G one on ocg1001 in reaction to monitoring complaints | 
  [production] | 
            
  | 00:00 | 
  <ori> | 
  Synchronized php-1.24wmf18/extensions/WikimediaEvents: Update WikimediaEvents for cherry-picks (duration: 00m 03s) | 
  [production] | 
            
  
    | 
      
        2014-09-02
      
      §
     | 
  
    
  | 23:49 | 
  <ori> | 
  Synchronized php-1.24wmf19/extensions/WikimediaEvents: Update WikimediaEvents for cherry-picks (duration: 00m 03s) | 
  [production] | 
            
  | 23:33 | 
  <reedy> | 
  Synchronized wmf-config/wikitech.php: (no message) (duration: 00m 13s) | 
  [production] | 
            
  | 23:22 | 
  <catrope> | 
  Synchronized php-1.24wmf19/includes/OutputPage.php: 5094c0d9c (duration: 00m 05s) | 
  [production] | 
            
  | 23:14 | 
  <Krinkle> | 
  Running extensions/GlobalCssJs/removeOldManualUserPages.php per [[m:GlobalCssJs]] | 
  [production] | 
            
  | 22:49 | 
  <reedy> | 
  Synchronized wmf-config/wikitech.php: (no message) (duration: 00m 14s) | 
  [production] | 
            
  | 22:37 | 
  <reedy> | 
  Synchronized wmf-config/InitialiseSettings.php: (no message) (duration: 00m 13s) | 
  [production] | 
            
  | 22:26 | 
  <reedy> | 
  Synchronized wmf-config/wikitech.php: (no message) (duration: 00m 13s) | 
  [production] | 
            
  | 22:10 | 
  <reedy> | 
  Synchronized docroot and w: (no message) (duration: 00m 14s) | 
  [production] | 
            
  | 21:58 | 
  <reedy> | 
  Synchronized wmf-config/CommonSettings.php: (no message) (duration: 00m 21s) | 
  [production] | 
            
  | 21:56 | 
  <reedy> | 
  Synchronized wmf-config/CommonSettings.php: (no message) (duration: 00m 24s) | 
  [production] | 
            
  | 21:51 | 
  <reedy> | 
  Synchronized wmf-config/CommonSettings.php: (no message) (duration: 00m 25s) | 
  [production] | 
            
  | 21:45 | 
  <reedy> | 
  Synchronized wmf-config/InitialiseSettings.php: (no message) (duration: 00m 23s) | 
  [production] | 
            
  | 21:37 | 
  <reedy> | 
  Synchronized wmf-config/db-eqiad.php: Wikitech db (duration: 00m 22s) | 
  [production] | 
            
  | 21:34 | 
  <bd808> | 
  Finished scap: no-op scap to build l10n for wikitech (duration: 55m 48s) | 
  [production] | 
            
  | 20:39 | 
  <bd808> | 
  Started scap: no-op scap to build l10n for wikitech | 
  [production] | 
            
  | 20:35 | 
  <bd808> | 
  Synchronized wmf-config/wikitech.php: eebc99a Require before instatiate (duration: 00m 04s) | 
  [production] | 
            
  | 20:32 | 
  <bd808> | 
  Synchronized private/PrivateSettings.php: Absolute path for WikitechPrivateSettings.php (duration: 00m 05s) | 
  [production] | 
            
  | 20:12 | 
  <reedy> | 
  rebuilt wikiversions.cdb and synchronized wikiversions files: (no message) | 
  [production] | 
            
  | 20:05 | 
  <MaxSem> | 
  Running cleanupPageProps.php everywhere | 
  [production] | 
            
  | 19:51 | 
  <MaxSem> | 
  Running cleanupPageProps.php on mw.org and meta | 
  [production] | 
            
  | 19:14 | 
  <reedy> | 
  Synchronized wmf-config/Wikibase.php: Bump epoch (duration: 00m 14s) | 
  [production] | 
            
  | 19:12 | 
  <reedy> | 
  rebuilt wikiversions.cdb and synchronized wikiversions files: Non wikipedias to 1.24wmf19, added labswiki too | 
  [production] | 
            
  | 18:56 | 
  <bd808> | 
  Synchronized fishbowl.dblist: Add labswiki (wikitech) (duration: 00m 05s) | 
  [production] | 
            
  | 18:25 | 
  <andrew> | 
  Synchronized wmf-config/InitialiseSettings.php: (no message) (duration: 00m 08s) | 
  [production] | 
            
  | 17:49 | 
  <reedy> | 
  Synchronized wmf-config/InitialiseSettings.php: touch (duration: 00m 14s) | 
  [production] | 
            
  | 17:39 | 
  <andrew> | 
  Synchronized multiversion/MWMultiVersion.php: (no message) (duration: 00m 04s) | 
  [production] | 
            
  | 17:14 | 
  <andrew> | 
  Finished scap: Deploying wikitech config (duration: 33m 03s) | 
  [production] | 
            
  | 17:01 | 
  <bd808> | 
  Fetched f711ea7 to /a/common on tin; not syncing because of in-process scap. | 
  [production] | 
            
  | 16:41 | 
  <andrew> | 
  Started scap: Deploying wikitech config | 
  [production] | 
            
  | 16:20 | 
  <andrew> | 
  Started scap: Deploying wikitech config | 
  [production] | 
            
  | 16:17 | 
  <ottomata> | 
  installing newer version of webstatscollector on oxygen and gadolinium, restarting filter process on oxygen | 
  [production] | 
            
  | 16:08 | 
  <andrew> | 
  Synchronized /a/common/private/WikitechPrivateSettings.php: (no message) (duration: 00m 04s) | 
  [production] |