| 2012-11-26
      
      § | 
    
  | 19:10 | <logmsgbot_> | reedy Started syncing Wikimedia installation... : Rebuild localisation cache for 1.21wmf5 | [production] | 
            
  | 18:58 | <logmsgbot_> | reedy synchronized php-1.21wmf5/cache/l10n/ | [production] | 
            
  | 18:47 | <logmsgbot_> | reedy synchronized php-1.21wmf5/extensions/Wikibase | [production] | 
            
  | 18:45 | <logmsgbot_> | reedy synchronized php-1.21wmf5/extensions/Diff | [production] | 
            
  | 18:37 | <logmsgbot_> | aaron synchronized php-1.21wmf5/includes/filerepo/file/LocalFile.php  'deployed 1fa41352d4e0b3cd2e53e7d8d485ac9098b8bfcc' | [production] | 
            
  | 18:31 | <logmsgbot_> | reedy Started syncing Wikimedia installation... : Build localisation cache for 1.21wmf5 | [production] | 
            
  | 18:16 | <logmsgbot_> | reedy rebuilt wikiversions.cdb and synchronized wikiversions files: test2wiki to 1.21wmf5 for l10n stuffs | [production] | 
            
  | 18:15 | <logmsgbot_> | aaron synchronized php-1.21wmf4/thumb.php  'deployed 81c1d0133f74eec600277ab744a9730c4e974e47' | [production] | 
            
  | 18:14 | <logmsgbot_> | reedy synchronized php-1.21wmf5  'Initial sync of php-1.21wmf5' | [production] | 
            
  | 18:03 | <logmsgbot_> | aaron synchronized php-1.21wmf5/extensions/FlaggedRevs | [production] | 
            
  | 18:02 | <logmsgbot_> | reedy synchronized wmf-config/ExtensionMessages-1.21wmf5.php | [production] | 
            
  | 18:01 | <logmsgbot_> | reedy synchronized live-1.5/static-1.21wmf5/ | [production] | 
            
  | 17:58 | <logmsgbot_> | aaron synchronized php-1.21wmf4/extensions/FlaggedRevs | [production] | 
            
  | 17:55 | <mutante> | authdns-update - adding wikipedia.bg | [production] | 
            
  | 16:29 | <mark> | Dist-upgraded & rebooted eqiad upload Varnish servers | [production] | 
            
  | 15:26 | <Jeff_Green> | dist-upgrades  & reboots for payments100[1-4], pay-lvs100[12] | [production] | 
            
  | 02:24 | <logmsgbot_> | LocalisationUpdate completed (1.21wmf4) at Mon Nov 26 02:23:58 UTC 2012 | [production] | 
            
  
    | 2012-11-23
      
      § | 
    
  | 23:15 | <logmsgbot_> | olivneh synchronized wmf-config/InitialiseSettings.php  'Enabling PostEdit on ptwiki & svwiki' | [production] | 
            
  | 18:28 | <logmsgbot_> | maxsem synchronized php-1.21wmf4/includes/Message.php  'Debugging' | [production] | 
            
  | 16:20 | <logmsgbot_> | maxsem synchronized php-1.21wmf4/includes/Message.php  'Debugging' | [production] | 
            
  | 15:09 | <mark> | Dist-upgraded and rebooted all eqiad bits servers (new Varnish package) | [production] | 
            
  | 15:04 | <logmsgbot_> | maxsem synchronized php-1.21wmf4/extensions/CategoryTree/  'https://gerrit.wikimedia.org/r/#/c/34668/' | [production] | 
            
  | 14:57 | <mark> | Dist-upgraded and rebooted all pmtpa bits servers (new Varnish package) | [production] | 
            
  | 14:33 | <mark> | Dist-upgraded and rebooted all esams bits servers (new Varnish package) | [production] | 
            
  | 14:05 | <mark> | Built new varnish 3.0.3plus~rc1-wm6 packages with fixed epoll deadlock, and inserted it into the precise-wikimedia APT repository | [production] | 
            
  | 04:20 | <Tim> | on fenari: updated the "search" dsh node group based on nmap -sP and fixed the remaining search servers | [production] | 
            
  | 04:04 | <Tim> | oh yeah, and I upgraded lucene to my version with the timeouts, deployed to pmtpa only via puppet | [production] | 
            
  | 04:02 | <Tim> | many lucene search servers failed to bind to port 1099 when they were restarted by the upgrade, restarting manually | [production] | 
            
  | 02:24 | <logmsgbot_> | LocalisationUpdate completed (1.21wmf4) at Fri Nov 23 02:24:34 UTC 2012 | [production] | 
            
  
    | 2012-11-22
      
      § | 
    
  | 14:52 | <apergos> | msbe8 and msbe10 installed, not yet deployed | [production] | 
            
  | 14:12 | <hashar> | jenkins: configure jobbuilder-bot user permissions | [production] | 
            
  | 13:39 | <hashar> | Jenkins: updated zuul-bot user permission so it can trigger jobs. | [production] | 
            
  | 12:17 | <hashar> | Installed plugins on Jenkins for Zuul deployment: notification, build-timeout | [production] | 
            
  | 12:06 | <hashar> | restarted Jenkins to load in the new zuul jobs. | [production] | 
            
  | 09:23 | <apergos> | fixed perms on srv284 php-1.*wmf*  and wmf-config, test (were 700 instead of 777) | [production] | 
            
  | 02:24 | <logmsgbot_> | LocalisationUpdate completed (1.21wmf4) at Thu Nov 22 02:24:22 UTC 2012 | [production] | 
            
  | 01:29 | <mutante> | sync-apache srv284-only, start apache (was missing all.conf), repool | [production] | 
            
  | 01:15 | <mutante> | rebooting srv193 (test.wp) for upgrade | [production] | 
            
  | 00:56 | <mutante> | repooled mw58,mw59 (upgrades) srv284 (hw ticket was resolved, reinstalled) | [production] | 
            
  | 00:07 | <mutante> | powercycling kaulen, this time no console output at all | [production] |