| 2013-09-05
      
      § | 
    
  | 22:44 | <csteipp> | synchronized php-1.22wmf16/includes/specials | [production] | 
            
  | 22:43 | <csteipp> | synchronized php-1.22wmf16/includes/actions | [production] | 
            
  | 22:16 | <spage> | synchronized wmf-config/InitialiseSettings.php  'E3 deploy GuidedTour to 7 more wikis' | [production] | 
            
  | 22:11 | <spage> | Finished syncing Wikimedia installation... : Deploying latest GuidedTour to wmf15 and wmf16 | [production] | 
            
  | 21:59 | <spage> | Started syncing Wikimedia installation... : Deploying latest GuidedTour to wmf15 and wmf16 | [production] | 
            
  | 21:57 | <mutante> | rolled back SSL cert on blog for now to discuss techblog.wm issue which would not be covered by cert but is just a redirect | [production] | 
            
  | 21:40 | <mutante> | replaced SSL cert on blog.wikimedia.org, don't use star cert, have separate new one | [production] | 
            
  | 21:01 | <reedy> | synchronized wmf-config/InitialiseSettings.php | [production] | 
            
  | 20:51 | <reedy> | synchronized php-1.22wmf15/extensions/ArticleFeedbackv5/ | [production] | 
            
  | 20:34 | <reedy> | synchronized php-1.22wmf16/extensions/ArticleFeedbackv5/ | [production] | 
            
  | 19:10 | <reedy> | rebuilt wikiversions.cdb and synchronized wikiversions files: all wikipedias to 1.22wmf15 | [production] | 
            
  | 19:01 | <reedy> | rebuilt wikiversions.cdb and synchronized wikiversions files: testwiki, mediawikiwiki, test2wiki, loginwiki and testwikidatawiki to 1.22wmf16 | [production] | 
            
  | 18:58 | <^d> | gerrit back up | [production] | 
            
  | 18:47 | <^d> | gerrit coming down for a short bit. moving data around. | [production] | 
            
  | 18:42 | <reedy> | synchronized php-1.22wmf16/extensions/UploadWizard/ | [production] | 
            
  | 18:27 | <olivneh> | synchronized wmf-config/InitialiseSettings.php  'Change I34d1f29d2: clean-up of InitialiseSettings.php' | [production] | 
            
  | 18:26 | <olivneh> | synchronized wmf-config/CommonSettings.php  'Increase rate of NavigationTiming events' | [production] | 
            
  | 18:03 | <Ryan_Lane> | adding virt12 to the virt node pool | [production] | 
            
  | 17:22 | <akosiaris> | upload kafka 0.8-20130903-1 at apt.wikimedia.org, component universe | [production] | 
            
  | 16:41 | <cmjohnson1> | powering down sq36 to swap disk | [production] | 
            
  | 16:26 | <reedy> | rebuilt wikiversions.cdb and synchronized wikiversions files: testwiki back to 1.22wmf15 till deployment window | [production] | 
            
  | 16:23 | <reedy> | synchronized php-1.22wmf16/extensions/  'Minor wikibase updates' | [production] | 
            
  | 16:10 | <reedy> | Finished syncing Wikimedia installation... : testwiki to 1.22wmf16 and build l10n cache | [production] | 
            
  | 15:51 | <reedy> | Started syncing Wikimedia installation... : testwiki to 1.22wmf16 and build l10n cache | [production] | 
            
  | 15:33 | <Nemo_bis> | etherpad.wikimedia.org down (error 503) | [production] | 
            
  | 15:28 | <cmjohnson1> | replacing disk slot 0 ms-be1011 | [production] | 
            
  | 15:18 | <reedy> | synchronized docroot and w | [production] | 
            
  | 15:17 | <reedy> | synchronized php-1.22wmf16  'Initial file sync' | [production] | 
            
  | 14:12 | <paravoid> | recreating mediawiki cgroup lost after cgroup-bin upgrade; thumbnail issues fixed | [production] | 
            
  | 13:14 | <paravoid> | adjusting depool-threshold, restarting pybal on lvs1003 | [production] | 
            
  | 12:13 | <paravoid> | pushing new swift object/account/container rings: setting ms-be9's sde1 to 33, swapping ms-be5's sda/b <-> sdm/n, also 33 | [production] | 
            
  | 10:21 | <apergos> | lanthanum bios processor settings set to 'custom' and c states disabled (attempt to fix power limit notification issue) | [production] | 
            
  | 09:57 | <springle> | leaving sync_binlog=0 on db36 and db38 so replication keeps up. to be reviewed | [production] | 
            
  | 09:05 | <hashar_> | jenkins: killed two requesthandler threads that were eating CPU power. | [production] | 
            
  | 02:47 | <LocalisationUpdate> | ResourceLoader cache refresh completed at Thu Sep  5 02:47:15 UTC 2013 | [production] | 
            
  | 02:30 | <LocalisationUpdate> | completed (1.22wmf14) at Thu Sep  5 02:30:03 UTC 2013 | [production] | 
            
  | 02:16 | <LocalisationUpdate> | completed (1.22wmf15) at Thu Sep  5 02:15:59 UTC 2013 | [production] | 
            
  | 01:42 | <^d> | gallium: updated git remotes in /srv/ssd/zuul/git/* to not point to old manganese box and point to gerrit.wm.o instead | [production] | 
            
  
    | 2013-09-04
      
      § | 
    
  | 23:17 | <^d> | restarting gerrit one last time | [production] | 
            
  | 23:04 | <^d> | apache stopped on manganese | [production] | 
            
  | 23:01 | <^d> | stopped puppet on manganese | [production] | 
            
  | 21:23 | <maxsem> | Finished syncing Wikimedia installation... : Weekly mobile deployment | [production] | 
            
  | 21:11 | <maxsem> | Started syncing Wikimedia installation... : Weekly mobile deployment | [production] | 
            
  | 19:41 | <Ryan_Lane> | upgraded wiktech-static to 1.22wmf15 | [production] | 
            
  | 19:16 | <andrewbogott> | turning on pluginsync, which will (temporarily) make puppet even slower | [production] | 
            
  | 19:10 | <andrewbogott> | Moved morebots from wikitech-static to toollabs | [production] | 
            
  | 06:26 | <apergos> | truncated fact_values puppet table and reset auto increment to start at 1, puppet was broken on all hosts, see http://projects.puppetlabs.com/issues/9225 | [production] | 
            
  | 02:22 | <LocalisationUpdate> | ResourceLoader cache refresh completed at Wed Sep  4 02:21:58 UTC 2013 | [production] | 
            
  | 02:11 | <LocalisationUpdate> | completed (1.22wmf14) at Wed Sep  4 02:11:48 UTC 2013 | [production] | 
            
  | 02:06 | <LocalisationUpdate> | completed (1.22wmf15) at Wed Sep  4 02:06:47 UTC 2013 | [production] |