| 
      
        2012-03-15
      
      ยง
     | 
  
    
  | 22:57 | 
  <catrope> | 
  synchronized php-1.19/extensions/ArticleFeedback/modules/jquery.articleFeedback/jquery.articleFeedback.js  | 
  [production] | 
            
  | 22:48 | 
  <mutante> | 
  purging Lucene monitoring on indexer from db9, remove duplicate service definitions manually anyways (still tons left), run purge script, reload Nagios.. | 
  [production] | 
            
  | 22:24 | 
  <catrope> | 
  synchronized php-1.19/resources/startup.js  'touch' | 
  [production] | 
            
  | 22:23 | 
  <catrope> | 
  synchronized wmf-config/CommonSettings.php  'Raise AFTv4 event logging percentage from 5% to 25%' | 
  [production] | 
            
  | 22:21 | 
  <mutante> | 
  getting rid of Swift HTTP checks on non production machines manually (come on spence _purge_ ;P) | 
  [production] | 
            
  | 22:07 | 
  <catrope> | 
  synchronized php-1.19/resources/startup.js  'touch' | 
  [production] | 
            
  | 22:04 | 
  <catrope> | 
  synchronized wmf-config/CommonSettings.php  'Raise AFTv4 event logging percentage from 1% to 5%' | 
  [production] | 
            
  | 21:44 | 
  <catrope> | 
  synchronized php-1.19/resources/startup.js  'touch' | 
  [production] | 
            
  | 21:28 | 
  <catrope> | 
  synchronized php-1.19/extensions/ArticleFeedbackv5/ArticleFeedbackv5.hooks.php  '[[rev:113961|r113961]]' | 
  [production] | 
            
  | 21:25 | 
  <pgehres> | 
  K4-713 synchronized payments cluster to [[rev:113956|r113956]]  | 
  [production] | 
            
  | 21:25 | 
  <pgehres> | 
  disabled credit cards on donate.wikimedia.org | 
  [production] | 
            
  | 21:21 | 
  <catrope> | 
  synchronized php-1.19/extensions/ArticleFeedbackv5/ArticleFeedbackv5.hooks.php  'fix fatal' | 
  [production] | 
            
  | 21:20 | 
  <catrope> | 
  synchronized wmf-config/CommonSettings.php  'Bump AFTv4 event logging percentage from 0.27% to 1%' | 
  [production] | 
            
  | 21:19 | 
  <Ryan_Lane> | 
  rebalancing instances gluster volume | 
  [production] | 
            
  | 21:19 | 
  <RoanKattouw> | 
  That was [[rev:113959|r113959]] | 
  [production] | 
            
  | 21:18 | 
  <catrope> | 
  synchronized php-1.19/extensions/ArticleFeedback/modules/ext.articleFeedback/ext.articleFeedback.js  | 
  [production] | 
            
  | 21:11 | 
  <catrope> | 
  synchronized php-1.19/extensions/ArticleFeedback/modules/ext.articleFeedback/ext.articleFeedback.js  '[[rev:113958|r113958]]' | 
  [production] | 
            
  | 21:09 | 
  <catrope> | 
  synchronized php-1.19/extensions/ArticleFeedbackv5/  '[[rev:113957|r113957]]' | 
  [production] | 
            
  | 20:46 | 
  <mark> | 
  bits.pmtpa cluster back online | 
  [production] | 
            
  | 20:44 | 
  <RobH> | 
  dns update for silver and zhen servers | 
  [production] | 
            
  | 20:37 | 
  <reedy> | 
  synchronized php-1.19/extensions/WikimediaMaintenance/cleanupBug31576.php  | 
  [production] | 
            
  | 19:54 | 
  <RobH> | 
  sq67-sq70 have been reinstalled, but not signed in puppet, not sure if they are ready for that or if there are other items mark needs to change first | 
  [production] | 
            
  | 19:11 | 
  <RobH> | 
  working on sq67-sq70 reinstalls, disregard alerts | 
  [production] | 
            
  | 19:00 | 
  <RobH> | 
  db1022 resetup and redeployed per rt 2537 and assigned back to asher | 
  [production] | 
            
  | 18:51 | 
  <reedy> | 
  synchronizing Wikimedia installation... : Running scap to deal with message changes earlier | 
  [production] | 
            
  | 18:19 | 
  <RobH> | 
  db1022 coming down for reinstall and resetup of raid per rt 2537 | 
  [production] | 
            
  | 17:55 | 
  <reedy> | 
  synchronized php-1.19/extensions/CentralAuth/  '[[rev:113940|r113940]]' | 
  [production] | 
            
  | 17:54 | 
  <reedy> | 
  synchronized php-1.19/extensions/CheckUser/  '[[rev:113940|r113940]]' | 
  [production] | 
            
  | 17:53 | 
  <reedy> | 
  synchronized php-1.19/extensions/wikihiero/modules/ext.wikihiero.css  '[[rev:113940|r113940]]' | 
  [production] | 
            
  | 17:52 | 
  <reedy> | 
  synchronized php-1.19/extensions/NewUserMessage/NewUserMessage.class.php  '[[rev:113940|r113940]]' | 
  [production] | 
            
  | 17:41 | 
  <reedy> | 
  synchronized php-1.19/includes/RecentChange.php  '[[rev:113938|r113938]]' | 
  [production] | 
            
  | 17:38 | 
  <reedy> | 
  synchronized php-1.19/resources/mediawiki/mediawiki.util.js  '[[rev:113936|r113936]]' | 
  [production] | 
            
  | 17:37 | 
  <reedy> | 
  synchronized php-1.19/includes/specials/SpecialUndelete.php  '[[rev:113936|r113936]]' | 
  [production] | 
            
  | 17:32 | 
  <reedy> | 
  synchronized php-1.19/languages/messages/  '[[rev:113935|r113935]]' | 
  [production] | 
            
  | 17:31 | 
  <reedy> | 
  synchronized php-1.19/resources/  '[[rev:113935|r113935]]' | 
  [production] | 
            
  | 17:31 | 
  <reedy> | 
  synchronized php-1.19/includes/  '[[rev:113935|r113935]]' | 
  [production] | 
            
  | 17:16 | 
  <reedy> | 
  synchronized php-1.19/includes/SkinTemplate.php  '[[rev:113932|r113932]]' | 
  [production] | 
            
  | 16:13 | 
  <reedy> | 
  synchronized php-1.19/extensions/WikimediaMaintenance/cleanupBug31576.php  '[[rev:113929|r113929]]' | 
  [production] | 
            
  | 15:15 | 
  <mark> | 
  Created git repo operations/debs/varnish in gerrit | 
  [production] | 
            
  | 14:06 | 
  <apergos> | 
  disabled moodbar temporarily on en wikii, see [[bugzilla:35245|bug 35245]] | 
  [production] | 
            
  | 14:02 | 
  <ariel> | 
  synchronized wmf-config/InitialiseSettings.php  'emergency disable of feedback dashboard (right config var this time?)' | 
  [production] | 
            
  | 13:51 | 
  <ariel> | 
  synchronized wmf-config/InitialiseSettings.php  'emergency disable of feedback dashboard' | 
  [production] | 
            
  | 13:11 | 
  <apergos> | 
  on screen as root on dataset1001, copying to gluster volume; if this causes problems feel free to shoot it. ( cp -a 20120211 /mnt/glusterpublicdata/public/enwiki/ ) | 
  [production] | 
            
  | 09:08 | 
  <mutante> | 
  ran puppet on mw102 | 
  [production] | 
            
  | 08:12 | 
  <mutante> | 
  installing apache,apt,cron,mysql-client upgrades on spence | 
  [production] | 
            
  | 07:01 | 
  <mutante> | 
  uprading apache and apt on hume | 
  [production] | 
            
  | 02:17 | 
  <LocalisationUpdate> | 
  completed (1.19) at Thu Mar 15 02:17:35 UTC 2012 | 
  [production] | 
            
  | 01:26 | 
  <Ryan_Lane> | 
  labsconsole was missing libapache2-mod-php5. puppet must have tried to upgrade a package unsuccessfully | 
  [production] | 
            
  | 01:22 | 
  <mutante> | 
  planet back up (installed libapache2-mod-php5 which installed apache2-mpm-prefork and removed apache2-mpm-worker) | 
  [production] | 
            
  | 01:19 | 
  <mutante> | 
  planet down - apache on singer, syntax error in site config "Invalid command 'php_admin_flag'" | 
  [production] |