| 2013-01-15
      
      § | 
    
  | 04:50 | <binasher> | set pc[1-3] to replicate from pc100[1-3], full master/master all the way across the sky | [production] | 
            
  | 02:26 | <LocalisationUpdate> | completed (1.21wmf7) at Tue Jan 15 02:26:37 UTC 2013 | [production] | 
            
  | 02:16 | <LeslieCarr> | rebooting neon | [production] | 
            
  | 02:02 | <LeslieCarr> | created a new lvm for /var/log on neon, copied files over, and restarted processes.  some file permission issues and incorrect file owners may remain | [production] | 
            
  | 01:39 | <LeslieCarr> | restarting neon | [production] | 
            
  | 01:23 | <aaron> | synchronized wmf-config/InitialiseSettings.php  'Set sqlbagostuff log' | [production] | 
            
  | 01:12 | <mutante> | neon - changing logrotate config for atop to rotate 7 instead of 14 | [production] | 
            
  | 01:09 | <mutante> | deleting atop.log.1* in /var/log on neon to free disk space | [production] | 
            
  | 00:47 | <binasher> | the production persistent parsercache is now on pc[1-3], replicated to pc100[1-3] | [production] | 
            
  | 00:43 | <asher> | synchronized wmf-config/CommonSettings.php  'deploying db parsercache, sharded and replicated' | [production] | 
            
  
    | 2013-01-14
      
      § | 
    
  | 23:18 | <Tim> | changed CNAME for search.wikimedia.org to point to wikimedia-lb instead of ekrem | [production] | 
            
  | 22:46 | <mutante> | installing apache,mysql-common,perl,sudo package updates on sanger | [production] | 
            
  | 22:45 | <mutante> | killed java process on sanger, restarted opendj | [production] | 
            
  | 22:10 | <hashar> | pullen {{gerrit|43849}} on fenari (simply changes some comments) | [production] | 
            
  | 22:04 | <Reedy> | Modified rc_params on huwiki to make it a blob | [production] | 
            
  | 21:30 | <Jeff_Green> | tearing down community-analytics vhost and cname | [production] | 
            
  | 21:26 | <binasher> | rebooting pc1 | [production] | 
            
  | 20:36 | <reedy> | cleared profiling data | [production] | 
            
  | 20:33 | <RobH> | xenon & caesium added to parsoid pybal config | [production] | 
            
  | 20:27 | <reedy> | synchronized wmf-config/InitialiseSettings.php  'Enable WikibaseClient on huwiki' | [production] | 
            
  | 20:19 | <reedy> | synchronized wmf-config/InitialiseSettings.php | [production] | 
            
  | 20:07 | <reedy> | synchronized wmf-config/ | [production] | 
            
  | 19:24 | <reedy> | synchronized php-1.21wmf7/extensions/Wikibase | [production] | 
            
  | 19:09 | <cmjohnson1> | provision sq48 | [production] | 
            
  | 19:05 | <reedy> | rebuilt wikiversions.cdb and synchronized wikiversions files: Rest of the 'pedias to 1.21wmf7 | [production] | 
            
  | 18:29 | <Ryan_Lane> | adding glusterfs-client glusterfs-common glusterfs-server and glusterfs-dbg for lucid and precise to our repo | [production] | 
            
  | 17:20 | <reedy> | synchronized php-1.21wmf7/includes/ChangesList.php | [production] | 
            
  | 16:55 | <ottomata> | packet loss on oxygen after adding new wikipedia zero filters.  Stopping puppet to temporarily comment them out and make sure they are the problem. | [production] | 
            
  | 16:53 | <cmjohnson1> | powercycling db1037 to verify raid cfg | [production] | 
            
  | 16:48 | <Reedy> | Populated huwiki sites and site_identifier tables from testwiki tables | [production] | 
            
  | 13:34 | <hashar> | upgrade PEAR packages on gallium {{bug|43957}} | [production] | 
            
  | 13:33 | <hashar> | upgrade PEAR packages on gallium | [production] | 
            
  | 13:20 | <hashar> | jenkins: gating jobs now always report a message, even if tests complete after the change has been merged in {{gerrit|43407}} | [production] | 
            
  | 08:29 | <hashar> | gallium: removed /mnt/jenkins-tmp tmpfs, replaced by /var/lib/jenkins/tmpfs {{bug|43825}} | [production] | 
            
  | 04:05 | <tstarling> | synchronized docroot | [production] | 
            
  | 03:53 | <tstarling> | synchronized docroot/search.wikimedia.org/index.php | [production] | 
            
  | 02:50 | <LocalisationUpdate> | completed (1.21wmf6) at Mon Jan 14 02:50:08 UTC 2013 | [production] | 
            
  | 02:25 | <LocalisationUpdate> | completed (1.21wmf7) at Mon Jan 14 02:25:38 UTC 2013 | [production] | 
            
  | 01:25 | <tstarling> | synchronized php-1.21wmf7/includes/GlobalFunctions.php | [production] | 
            
  | 01:24 | <tstarling> | synchronized php-1.21wmf7/includes/DefaultSettings.php | [production] | 
            
  | 01:24 | <tstarling> | synchronized php-1.21wmf7/bin/ulimit5.sh | [production] | 
            
  | 01:22 | <tstarling> | synchronized php-1.21wmf6/includes/GlobalFunctions.php | [production] | 
            
  | 01:21 | <tstarling> | synchronized php-1.21wmf6/includes/DefaultSettings.php | [production] | 
            
  | 01:21 | <tstarling> | synchronized php-1.21wmf6/bin/ulimit5.sh | [production] | 
            
  | 00:43 | <Tim> | patched @requires handling out of phpunit on gallium so that it stops segfaulting and accepts Id9f2fea7 | [production] |