| 2014-07-25
      
      § | 
    
  | 22:52 | <mutante> | Bugzilla - upgraded to 4.4.5 | [production] | 
            
  | 22:41 | <mutante> | ocg - deleted old log dirs | [production] | 
            
  | 19:28 | <hashar> | Jenkins : disabling gearman plugin and reenabling it (just uncheck/save/check a box in  https://integration.wikimedia.org/ci/configure ) | [production] | 
            
  | 19:25 | <hashar> | zuul@gallium:/etc/zuul/wikimedia$ echo status|nc -q 3 localhost 4730|wc -l   ... Yields: 0 .  Which mean jobs are no more registered for some reason. | [production] | 
            
  | 19:24 | <hashar> | Jenkins stalled again yeahhhhh | [production] | 
            
  | 16:59 | <mutante> | powercycled ms-be1010 - unresponsive to ssh, nothing on mgmt | [production] | 
            
  | 16:28 | <MaxSem> | Updating PageImages data for mainspace on Commons from terbium | [production] | 
            
  | 13:09 | <_joe_> | re-enabling puppet, test run on the test host was fine. | [production] | 
            
  | 13:03 | <_joe_> | stopping puppet on all appservers - will reactivate after testing | [production] | 
            
  | 11:26 | <reedy> | Synchronized docroot and w: (no message) (duration: 00m 13s) | [production] | 
            
  | 10:51 | <hashar> | contint: manually cleared /tmp on the 3 labs jenkins slaves. | [production] | 
            
  | 10:47 | <hashar> | integration-slave1001.eqiad.wmflabs  is out of disk space ( / /dev/vda1) | [production] | 
            
  | 07:29 | <springle> | shutdown tantalum per mwalker request | [production] | 
            
  | 04:19 | <LocalisationUpdate> | ResourceLoader cache refresh completed at Fri Jul 25 04:18:45 UTC 2014 (duration 18m 44s) | [production] | 
            
  | 03:31 | <LocalisationUpdate> | completed (1.24wmf15) at 2014-07-25 03:30:33+00:00 | [production] | 
            
  | 02:48 | <LocalisationUpdate> | completed (1.24wmf14) at 2014-07-25 02:47:17+00:00 | [production] | 
            
  | 01:22 | <ori> | Synchronized wmf-config/CommonSettings.php: Ic29ae11fa: On Labs, disable LuaSandbox's profiling feature to isolate bug 68413 (duration: 00m 04s) | [production] | 
            
  | 00:15 | <mutante> | imported jouncebot from github - https://gerrit.wikimedia.org/r/#/q/project:wikimedia/bots/jouncebot,n,z | [production] | 
            
  | 00:03 | <K4-713> | updated fundraising civicrm to 0639c11636d9 | [production] | 
            
  
    | 2014-07-24
      
      § | 
    
  | 23:26 | <mutante> | created gerrit project for jouncebot | [production] | 
            
  | 23:06 | <maxsem> | Synchronized wmf-config: https://gerrit.wikimedia.org/r/149180 (duration: 00m 05s) | [production] | 
            
  | 21:53 | <reedy> | Synchronized wmf-config/: (no message) (duration: 00m 14s) | [production] | 
            
  | 20:41 | <mutante> | rebooted wm-bot instance | [production] | 
            
  | 20:21 | <bblack> | restarted backend varnish for parsoid on cp1058 | [production] | 
            
  | 20:20 | <bblack> | restarted backend varnish for parsoid on cp1045 | [production] | 
            
  | 20:08 | <reedy> | Synchronized php-1.24wmf15/extensions/Translate: (no message) (duration: 00m 15s) | [production] | 
            
  | 20:00 | <reedy> | Synchronized php-1.24wmf15: (no message) (duration: 00m 59s) | [production] | 
            
  | 19:58 | <reedy> | Synchronized php-1.24wmf14: (no message) (duration: 01m 11s) | [production] | 
            
  | 19:24 | <hashar> | restarted Zuul | [production] | 
            
  | 18:44 | <ori> | restarted jobrunners for 01c70b1a892ac3944655f84449e89e4508894101 | [production] | 
            
  | 18:42 | <AaronSchulz> | Updated jobrunners to 01c70b1a892ac3944655f84449e89e4508894101 | [production] | 
            
  | 18:39 | <reedy> | Synchronized wmf-config/: (no message) (duration: 00m 14s) | [production] | 
            
  | 18:34 | <aaron> | Synchronized php-1.24wmf14/includes/jobqueue/aggregator/JobQueueAggregatorRedis.php: ca031131396ee1830e239d0b6a314bb571840c11 (duration: 00m 06s) | [production] | 
            
  | 18:26 | <reedy> | Synchronized wmf-config/InitialiseSettings.php: (no message) (duration: 00m 14s) | [production] | 
            
  | 18:24 | <reedy> | rebuilt wikiversions.cdb and synchronized wikiversions files: group0 to 1.24wmf15 | [production] | 
            
  | 18:23 | <ori> | Purged apache from SSL cluster; provisioned as a side-effect of I0b02a46f3 + I76a0d237f | [production] | 
            
  | 18:21 | <godog> | updated swift ring to bring ms-be1013 weight to 2300 | [production] | 
            
  | 18:17 | <reedy> | rebuilt wikiversions.cdb and synchronized wikiversions files: Wikipedias to 1.24wmf14 | [production] | 
            
  | 18:03 | <reedy> | Finished scap: testwiki to 1.24wmf15 and build l10n cache (duration: 31m 12s) | [production] | 
            
  | 17:32 | <reedy> | Started scap: testwiki to 1.24wmf15 and build l10n cache | [production] |