| 2014-10-23
      
      § | 
    
  | 23:39 | <catrope> | Synchronized php-1.25wmf4/extensions/CentralAuth/: SWAT (duration: 00m 04s) | [production] | 
            
  | 23:38 | <catrope> | Synchronized php-1.25wmf4/extensions/AntiSpoof/: SWAT (duration: 00m 06s) | [production] | 
            
  | 23:29 | <catrope> | Synchronized php-1.25wmf5/extensions/TimedMediaHandler/: SWAT (duration: 00m 04s) | [production] | 
            
  | 23:29 | <catrope> | Synchronized php-1.25wmf5/extensions/UploadWizard/: SWAT (duration: 00m 06s) | [production] | 
            
  | 23:28 | <catrope> | Synchronized php-1.25wmf4/extensions/UploadWizard/: SWAT (duration: 00m 04s) | [production] | 
            
  | 23:28 | <catrope> | Synchronized php-1.25wmf4/extensions/TimedMediaHandler/: SWAT (duration: 00m 04s) | [production] | 
            
  | 23:27 | <catrope> | Synchronized php-1.25wmf4/includes/api/ApiFormatBase.php: SWAT (duration: 00m 04s) | [production] | 
            
  | 22:42 | <hashar> | Jenkins is all good now. | [production] | 
            
  | 22:36 | <hashar> | Jenkins restarting | [production] | 
            
  | 22:28 | <hashar> | preparing jenkins for restart | [production] | 
            
  | 21:54 | <hashar> | Jenkins  the Gearman plugin is holding a lock on deployment-bastion slave that prevents it from running any job :-/ | [production] | 
            
  | 21:51 | <ejegg> | updated civicrm from ad3386cd0f9b776e2fded7c4e6b1195e05ed669c to 937df4dacae0dd620ae9e8fed13566d51c1b18a4 | [production] | 
            
  | 21:46 | <springle> | Synchronized wmf-config/db-eqiad.php: depool db1018 (duration: 00m 06s) | [production] | 
            
  | 21:43 | <hashar> | Jenkins: disabling / reenabling Gearman plugin | [production] | 
            
  | 21:35 | <hashar> | Jenkins: disconnected / reconnected slave node  deployment-bastion.eqiad | [production] | 
            
  | 21:15 | <awight> | updated crm from 03b15f7dad58ce61894d632e8fbebd2ae76ae4d0 to ad3386cd0f9b776e2fded7c4e6b1195e05ed669c | [production] | 
            
  | 21:04 | <ejegg> | updated civicrm from 0a3ab0f18ce726898d14adcbe6ab08411c9e3e82 to 03b15f7dad58ce61894d632e8fbebd2ae76ae4d0 | [production] | 
            
  | 19:29 | <reedy> | rebuilt wikiversions.cdb and synchronized wikiversions files: group0 to 1.25wmf5 | [production] | 
            
  | 19:26 | <reedy> | rebuilt wikiversions.cdb and synchronized wikiversions files: wikipedias to 1.25wmf4 | [production] | 
            
  | 19:19 | <reedy> | Finished scap: testwiki to 1.25wmf5 (duration: 32m 55s) | [production] | 
            
  | 18:46 | <reedy> | Started scap: testwiki to 1.25wmf5 | [production] | 
            
  | 18:34 | <awight> | updated crm from d6a75b6df4482de61da372fa653902db7ca12766 to 0a3ab0f18ce726898d14adcbe6ab08411c9e3e82 | [production] | 
            
  | 18:20 | <tgr> | Synchronized wmf-config/InitialiseSettings.php: Disable ImageMetrics on non-public wikis (duration: 00m 05s) | [production] | 
            
  | 18:03 | <tgr> | Synchronized wmf-config/InitialiseSettings.php: Enable ImageMetrics on all wikis (duration: 00m 05s) | [production] | 
            
  | 17:14 | <tgr> | Synchronized wmf-config/InitialiseSettings.php: Enable ImageMetrics on group0 (duration: 00m 05s) | [production] | 
            
  | 17:08 | <tgr> | Finished scap: Deploying ImageMetrics extension (duration: 32m 04s) | [production] | 
            
  | 16:54 | <paravoid> | cr2-ulsfo: upgrading junos again | [production] | 
            
  | 16:36 | <tgr> | Started scap: Deploying ImageMetrics extension | [production] | 
            
  | 15:46 | <paravoid> | preparing to upgrade JunOS on cr2-ulsfo | [production] | 
            
  | 15:31 | <springle> | Synchronized wmf-config/db-eqiad.php: db1065 to normal load (duration: 00m 08s) | [production] | 
            
  | 15:19 | <anomie> | Synchronized php-1.25wmf4/api.php: SWAT: Include ApiMain construction in api.php try-catch block [[gerrit:168296]] (duration: 00m 09s) | [production] | 
            
  | 15:19 | <anomie> | Synchronized php-1.25wmf4/includes/api/ApiMain.php: SWAT: Include ApiMain construction in api.php try-catch block [[gerrit:168128]] (duration: 00m 09s) | [production] | 
            
  | 15:11 | <anomie> | Synchronized php-1.25wmf4/includes/api/ApiFormatFeedWrapper.php: SWAT: Fix ApiFormatFeedWrapper [[gerrit:168128]] (duration: 00m 09s) | [production] | 
            
  | 14:25 | <ottomata> | varnishkafka request.required.acks is now 2 for text, mobile, and bits. | [production] | 
            
  | 12:46 | <hashar> | killed left over java/jenkins process on gallium | [production] | 
            
  | 12:09 | <Krinkle> | Zuul/Jenkins stuck. Tried various gearman/zuul resets. Restarting Jenkins now. | [production] | 
            
  | 07:25 | <_joe_> | restarted hhvm on mw1114, depooled the server | [production] | 
            
  | 05:39 | <Tim> | on mw1189 testing some URLs at a high rate, attempting to induce measurable memory leak | [production] | 
            
  | 05:06 | <Tim> | reverted unexplained uncomitted modification of palladium:/srv/pybal-config/pybal/eqiad/api which repooled mw1189 | [production] | 
            
  | 03:41 | <LocalisationUpdate> | ResourceLoader cache refresh completed at Thu Oct 23 03:41:49 UTC 2014 (duration 41m 48s) | [production] | 
            
  | 03:06 | <cscott> | Synchronized wmf-config/filebackend.php: fix using a file from commons with file name length between 140 and 159 (duration: 00m 20s) | [production] | 
            
  | 03:01 | <Krinkle> | git-deploy: Deploying integration/slave-scripts 157ef23 | [production] | 
            
  | 02:32 | <springle> | Synchronized wmf-config/db-eqiad.php: repool db1065, warm up (duration: 00m 06s) | [production] |