| 
      
        2009-11-12
      
      §
     | 
  
    
  | 20:06 | 
  <robh> | 
  synchronized php-1.5/wmf-config/InitialiseSettings.php  'tinkering with skwikiquote logo settings to force change' | 
  [production] | 
            
  | 19:55 | 
  <robh> | 
  synchronized php-1.5/wmf-config/InitialiseSettings.php  '21431 Set logo for Bengali Wikibooks' | 
  [production] | 
            
  | 19:10 | 
  <robh> | 
  synchronized php-1.5/wmf-config/InitialiseSettings.php  'bug 21262 Set q:sk: logo' | 
  [production] | 
            
  | 19:03 | 
  <robh> | 
  synchronized php-1.5/wmf-config/InitialiseSettings.php  'setting ru.wikiversity to the default engligh logo until they have a localized version' | 
  [production] | 
            
  | 18:57 | 
  <robh> | 
  synchronized php-1.5/wmf-config/InitialiseSettings.php  'Adding back in ImportSources for new ru.wikiversity' | 
  [production] | 
            
  | 18:39 | 
  <midom> | 
  synchronized php/cache/interwiki.cdb  | 
  [production] | 
            
  | 18:28 | 
  <Rob> | 
  bad php error pushed by me, rolled it back, things should come back up now | 
  [production] | 
            
  | 18:28 | 
  <root> | 
  ran sync-common-all  | 
  [production] | 
            
  | 18:22 | 
  <root> | 
  ran sync-common-all  | 
  [production] | 
            
  | 16:59 | 
  <andrew> | 
  synchronized php-1.5/wmf-config/InitialiseSettings.php  'LiquidThreads_alpha stuff doesn't seem to have taken effect, turned it off for lqt labs for now, will have another stab later' | 
  [production] | 
            
  | 16:50 | 
  <andrew> | 
  synchronized php-1.5/wmf-config/liquidthreads.php  'Fix name of LiquidThreads alpha variable (wmgLiquidThreadsAlpha)' | 
  [production] | 
            
  | 16:49 | 
  <andrew> | 
  synchronized php-1.5/wmf-config/InitialiseSettings.php  'Fix name of LiquidThreads alpha variable (wmgLiquidThreadsAlpha)' | 
  [production] | 
            
  | 16:47 | 
  <andrew> | 
  synchronized php-1.5/extensions/LiquidThreads_alpha/classes/View.php  'commit live hack in r58954' | 
  [production] | 
            
  | 16:29 | 
  <Andrew> | 
  Re-scapping to update localisation for LiquidThreads alpha (which is technically a "new extension") | 
  [production] | 
            
  | 16:26 | 
  <Andrew> | 
  tomasz has left some non-group-writeable dirs around in our checkout, please change your umask drwxr-xr-x   3 tfinc     wikidev   32 Nov  9 06:44 GeoLite | 
  [production] | 
            
  | 16:21 | 
  <Andrew> | 
  Which one is used is controlled by a new variable, wmgLiquidThreads_alpha -- true to use the alpha. Only activated on liquidthreads_labswikimedia. Scapping to apply updates. | 
  [production] | 
            
  | 16:20 | 
  <Andrew> | 
  Split LiquidThreads to LiquidThreads_alpha and LiquidThreads, LiquidThreads_alpha being the most recent version. | 
  [production] | 
            
  | 15:37 | 
  <Rob> | 
  bayes back online, let the statistic-crunching resume =] | 
  [production] | 
            
  | 15:29 | 
  <Rob> | 
  updating dns to reflect new mgmt ip for bayes | 
  [production] | 
            
  | 03:29 | 
  <tstarling> | 
  synchronized php-1.5/wmf-config/InitialiseSettings.php  'turning $wgHtml5 back off again due to bugs' | 
  [production] | 
            
  | 01:37 | 
  <tstarling> | 
  synchronized php-1.5/wmf-config/InitialiseSettings.php  'Enabling $wgHtml5' | 
  [production] | 
            
  | 00:15 | 
  <tfinc> | 
  synchronized php-1.5/extensions/ContributionTracking/ContributionTracking_body.php  | 
  [production] | 
            
  
    | 
      
        2009-11-09
      
      §
     | 
  
    
  | 23:15 | 
  <andrew> | 
  synchronized php-1.5/wmf-config/InitialiseSettings.php  'Disabling GlobalUsage due to major scaling issues, discussion on private-l' | 
  [production] | 
            
  | 22:56 | 
  <tstarling> | 
  synchronized docroot/secure/keys.html  | 
  [production] | 
            
  | 22:55 | 
  <tstarling> | 
  synchronized docroot/secure/keys.txt  | 
  [production] | 
            
  | 20:57 | 
  <Rob> | 
  wordpress upgraded for techblog.  by upgraded we mean new install and manual copy of existing uplaoded files and customizations. | 
  [production] | 
            
  | 20:51 | 
  <Rob> | 
  techblog accessibility still spotty.  Wordpress upgrades are sometimes painful. | 
  [production] | 
            
  | 20:12 | 
  <Rob> | 
  messing with updating wordpress for techblog.  It failed before so techblog will be up and down during the next few minutes | 
  [production] | 
            
  | 20:11 | 
  <Fred> | 
  raised the number of apache threads on Singer to accommodate secure traffic. | 
  [production] | 
            
  | 19:29 | 
  <mark> | 
  Disconnected drbd resource nfshome on nfs2: RAID1 resync was still running, waiting for it to finish before attempting DRBD resync | 
  [production] | 
            
  | 19:15 | 
  <tfinc> | 
  synchronized php-1.5/extensions/ContributionReporting/ContributionHistory_body.php  | 
  [production] | 
            
  | 18:59 | 
  <mark> | 
  Stopped NFS kernel server on db20 (yes, that's /home) | 
  [production] | 
            
  | 18:34 | 
  <mark> | 
  Turned off swap on db20: block device needed for DRBD external metadata | 
  [production] | 
            
  | 17:04 | 
  <mark> | 
  OS-installed nfs2 | 
  [production] | 
            
  | 16:40 | 
  <mark> | 
  Running restart of puppetd across the cluster | 
  [production] | 
            
  | 16:35 | 
  <mark> | 
  Running backup of db20 /home | 
  [production] | 
            
  | 16:28 | 
  <mark> | 
  Running dist-upgrade on locke | 
  [production] | 
            
  | 16:00 | 
  <mark> | 
  fsck repaired /var/backup on mchenry, filesystem remounted | 
  [production] | 
            
  | 15:55 | 
  <mark> | 
  Added tridge to the ALL node group | 
  [production] | 
            
  | 15:49 | 
  <mark> | 
  dist-upgrade and reboot of tridge | 
  [production] | 
            
  | 15:42 | 
  <mark> | 
  Running new fsck on mchenry while the system is up | 
  [production] | 
            
  | 15:41 | 
  <mark> | 
  /var/backups filesystem on mchenry is corrupt | 
  [production] | 
            
  | 15:22 | 
  <mark> | 
  Reset DRAC password of sanger | 
  [production] | 
            
  | 15:18 | 
  <mark> | 
  Rebooting mchenry | 
  [production] | 
            
  | 15:16 | 
  <mark> | 
  Running apt-get dist-upgrade on mchenry | 
  [production] | 
            
  | 15:06 | 
  <mark> | 
  Rebooting sanger | 
  [production] |