| 2013-08-15
      
      § | 
    
  | 21:50 | <olivneh> | Finished syncing Wikimedia installation... : E3 deploy: GuidedTour & GettingStarted | [production] | 
            
  | 21:38 | <olivneh> | Started syncing Wikimedia installation... : E3 deploy: GuidedTour & GettingStarted | [production] | 
            
  | 21:24 | <apergos> | live hacked /etc/nagios/puppet_servicegroups.cfg and /etc/nagios/puppet_hostgroups.cfg on neon to add host and service group 'cache_misc_eqiad', icinga wouldn't start without it | [production] | 
            
  | 21:15 | <ori-l> | previous two syncs: timeouts on srv281, mw1089, mw1173 | [production] | 
            
  | 21:15 | <olivneh> | synchronized php-1.22wmf12/extensions/GuidedTour  'E3 deploy: GuidedTour to master' | [production] | 
            
  | 21:13 | <olivneh> | synchronized php-1.22wmf12/extensions/GettingStarted  'E3 deploy: GettingStarted to master' | [production] | 
            
  | 19:48 | <paravoid> | ceph: adding osd.93 | [production] | 
            
  | 19:40 | <Reedy> | Added wb_property_info table to wikidatawiki and testwikidatawiki | [production] | 
            
  | 18:47 | <paravoid> | rebooting stafford & sockpuppet for kernel upgrades | [production] | 
            
  | 18:20 | <reedy> | rebuilt wikiversions.cdb and synchronized wikiversions files: 1.22wmf13 phase1 | [production] | 
            
  | 18:04 | <cmjohnson1> | powering down ms-be1008 to update hard drive firmware | [production] | 
            
  | 17:58 | <reedy> | synchronized php-1.22wmf13/includes/specials/SpecialNewimages.php | [production] | 
            
  | 16:35 | <reedy> | rebuilt wikiversions.cdb and synchronized wikiversions files: revert test2wiki to 1.22wmf12 till window | [production] | 
            
  | 16:28 | <reedy> | Finished syncing Wikimedia installation... : test2wiki to 1.22wmf13 and build l10n cache | [production] | 
            
  | 16:14 | <reedy> | Started syncing Wikimedia installation... : test2wiki to 1.22wmf13 and build l10n cache | [production] | 
            
  | 16:08 | <reedy> | synchronized php-1.22wmf13/ | [production] | 
            
  | 15:38 | <reedy> | synchronized docroot and w | [production] | 
            
  | 15:37 | <reedy> | synchronized php-1.22wmf13/ | [production] | 
            
  | 08:13 | <springle> | starting pt-table-checksum on db1034 bug 52853 | [production] | 
            
  | 07:02 | <springle> | delaying slave db52 during bug 52853 investigation | [production] | 
            
  | 06:47 | <tstarling> | synchronized wmf-config/db-eqiad.php  'depooling db1009 at springle's request' | [production] | 
            
  | 06:46 | <tstarling> | synchronized wmf-config/CommonSettings.php | [production] | 
            
  | 06:45 | <tstarling> | synchronized wmf-config/CirrusSearch-production.php | [production] | 
            
  | 06:44 | <tstarling> | synchronized wmf-config/CirrusSearch-common.php | [production] | 
            
  | 06:43 | <tstarling> | synchronized wmf-config/InitialiseSettings.php | [production] | 
            
  | 06:42 | <tstarling> | synchronized wmf-config/InitialiseSettings-labs.php | [production] | 
            
  | 06:41 | <Tim> | deploying CirrusSearch configuration changes (fa2991591a2eb5c8c461e471af49c62d428bc530) | [production] | 
            
  | 02:54 | <paravoid> | rebooting iron, kernel upgrade | [production] | 
            
  | 02:43 | <paravoid> | rebooting bast1001, kernel upgrade | [production] | 
            
  | 02:31 | <paravoid> | rebooting fenari, kernel upgrade | [production] | 
            
  | 02:20 | <LocalisationUpdate> | ResourceLoader cache refresh completed at Thu Aug 15 02:20:39 UTC 2013 | [production] | 
            
  | 02:08 | <LocalisationUpdate> | completed (1.22wmf12) at Thu Aug 15 02:08:17 UTC 2013 | [production] | 
            
  
    | 2013-08-14
      
      § | 
    
  | 17:42 | <csteipp> | synchronized php-1.22wmf12/includes | [production] | 
            
  | 12:23 | <mark> | Moved non-https, non-IPv6 eqiad traffic for *.wikimedia.org (wikimedialb) to text-varnish, not caching login.wikimedia.org | [production] | 
            
  | 11:13 | <paravoid> | swift->ceph thumb sync (swiftrepl @ ms-fe1002) | [production] | 
            
  | 10:59 | <akosiaris> | stoping etherpad-lite for maintainance (character set hell) | [production] | 
            
  | 10:48 | <paravoid> | upgrading ceph to 0.67 | [production] | 
            
  | 10:01 | <mark> | Moved non-https, non-IPv6 eqiad traffic for *.wikimedia.org (wikimedialb) back to Squid | [production] | 
            
  | 09:40 | <mark> | Moved non-https, non-IPv6 eqiad traffic for *.wikimedia.org (wikimedialb) to text-varnish | [production] | 
            
  | 02:18 | <LocalisationUpdate> | ResourceLoader cache refresh completed at Wed Aug 14 02:18:04 UTC 2013 | [production] | 
            
  
    | 2013-08-13
      
      § | 
    
  | 22:55 | <cmjohnson1> | authdns update | [production] | 
            
  | 18:51 | <RobH> | wikipedia.in is now working, huzzah. | [production] | 
            
  | 18:40 | <RobH> | updated apache redirects, but dsh stuff wont workfor me so hacking an apache gracefull all via salt | [production] | 
            
  | 17:48 | <RobH> | rob is testing his new ssh settings to see if he can dsh graceful all apaches without errors, no actual changes are being made | [production] | 
            
  | 08:51 | <akosiaris1> | taking down epl.wikimedia.org for maintanance | [production] | 
            
  | 07:29 | <akosiaris> | enabled https redir for epl.wikimedia.org. | [production] | 
            
  | 05:59 | <apergos> | ran puppet on antimony and restarted apache to pick up new robots.txt (see r/78919 ) | [production] | 
            
  | 05:56 | <apergos> | restarted apache on stafford, puppet was dead | [production] | 
            
  | 02:16 | <LocalisationUpdate> | ResourceLoader cache refresh completed at Tue Aug 13 02:15:58 UTC 2013 | [production] | 
            
  | 02:05 | <LocalisationUpdate> | completed (1.22wmf12) at Tue Aug 13 02:05:45 UTC 2013 | [production] |